Sep 11 03:53:21.605947 ip-10-0-130-195 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 03:53:21.983280 ip-10-0-130-195 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 03:53:21.983280 ip-10-0-130-195 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 03:53:21.983280 ip-10-0-130-195 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 03:53:21.983280 ip-10-0-130-195 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 03:53:21.983280 ip-10-0-130-195 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 03:53:21.984767 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.984677    2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 03:53:21.988530 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988507    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 03:53:21.988530 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988529    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 03:53:21.988530 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988533    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 03:53:21.988643 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988536    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 03:53:21.988643 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988539    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 03:53:21.988643 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988547    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 03:53:21.988643 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988550    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 03:53:21.988643 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988552    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 03:53:21.988643 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988555    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 03:53:21.988643 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988558    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 03:53:21.988643 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988562    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 03:53:21.988643 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988564    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 03:53:21.988643 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988567    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 03:53:21.988643 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988569    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 03:53:21.988643 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988572    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 03:53:21.988643 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988575    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 03:53:21.988643 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988578    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 03:53:21.988643 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988580    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 03:53:21.988643 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988583    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 03:53:21.988643 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988585    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 03:53:21.988643 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988588    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 03:53:21.988643 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988591    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 03:53:21.988643 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988593    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 03:53:21.989129 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988596    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 03:53:21.989129 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988611    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 03:53:21.989129 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988614    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 03:53:21.989129 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988617    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 03:53:21.989129 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988620    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 03:53:21.989129 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988622    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 03:53:21.989129 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988625    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 03:53:21.989129 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988627    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 03:53:21.989129 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988630    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 03:53:21.989129 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988633    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 03:53:21.989129 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988635    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 03:53:21.989129 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988637    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 03:53:21.989129 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988640    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 03:53:21.989129 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988644    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 03:53:21.989129 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988647    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 03:53:21.989129 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988650    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 03:53:21.989129 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988653    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 03:53:21.989129 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988656    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 03:53:21.989129 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988659    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 03:53:21.989129 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988662    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 03:53:21.989962 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988664    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 03:53:21.989962 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988667    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 03:53:21.989962 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988670    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 03:53:21.989962 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988672    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 03:53:21.989962 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988675    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 03:53:21.989962 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988678    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 03:53:21.989962 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988680    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 03:53:21.989962 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988683    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 03:53:21.989962 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988686    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 03:53:21.989962 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988688    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 03:53:21.989962 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988692    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 03:53:21.989962 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988697    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 03:53:21.989962 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988699    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 03:53:21.989962 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988703    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 03:53:21.989962 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988705    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 03:53:21.989962 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988708    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 03:53:21.989962 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988711    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 03:53:21.989962 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988714    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 03:53:21.989962 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988717    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 03:53:21.989962 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988719    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 03:53:21.990507 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988722    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 03:53:21.990507 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988725    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 03:53:21.990507 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988728    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 03:53:21.990507 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988731    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 03:53:21.990507 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988733    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 03:53:21.990507 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988739    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 03:53:21.990507 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988743    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 03:53:21.990507 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988746    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 03:53:21.990507 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988751    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 03:53:21.990507 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988754    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 03:53:21.990507 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988757    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 03:53:21.990507 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988760    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 03:53:21.990507 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988763    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 03:53:21.990507 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988768    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 03:53:21.990507 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988770    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 03:53:21.990507 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988773    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 03:53:21.990507 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988776    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 03:53:21.990507 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988779    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 03:53:21.990507 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988782    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 03:53:21.991087 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988785    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 03:53:21.991087 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988788    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 03:53:21.991087 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988790    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 03:53:21.991087 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988793    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 03:53:21.991087 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988796    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 03:53:21.991087 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988798    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 03:53:21.991087 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988801    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 03:53:21.991087 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988803    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 03:53:21.991087 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988805    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 03:53:21.991087 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988808    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 03:53:21.991087 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988811    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 03:53:21.991087 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988814    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 03:53:21.991087 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988816    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 03:53:21.991087 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988819    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 03:53:21.991087 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988821    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 03:53:21.991087 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988824    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 03:53:21.991087 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.988826    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 03:53:21.991087 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991018    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 03:53:21.991087 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991031    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 03:53:21.991547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991035    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 03:53:21.991547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991039    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 03:53:21.991547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991043    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 03:53:21.991547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991045    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 03:53:21.991547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991048    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 03:53:21.991547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991051    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 03:53:21.991547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991054    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 03:53:21.991547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991057    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 03:53:21.991547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991060    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 03:53:21.991547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991062    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 03:53:21.991547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991065    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 03:53:21.991547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991069    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 03:53:21.991547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991072    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 03:53:21.991547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991075    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 03:53:21.991547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991078    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 03:53:21.991547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991081    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 03:53:21.991547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991083    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 03:53:21.991547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991086    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 03:53:21.991547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991089    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 03:53:21.992046 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991092    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 03:53:21.992046 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991095    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 03:53:21.992046 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991098    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 03:53:21.992046 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991101    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 03:53:21.992046 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991104    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 03:53:21.992046 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991107    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 03:53:21.992046 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991110    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 03:53:21.992046 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991112    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 03:53:21.992046 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991115    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 03:53:21.992046 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991117    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 03:53:21.992046 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991121    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 03:53:21.992046 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991124    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 03:53:21.992046 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991127    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 03:53:21.992046 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991129    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 03:53:21.992046 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991132    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 03:53:21.992046 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991135    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 03:53:21.992046 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991138    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 03:53:21.992046 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991143    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 03:53:21.992046 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991147    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 03:53:21.992537 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991150    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 03:53:21.992537 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991152    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 03:53:21.992537 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991155    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 03:53:21.992537 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991158    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 03:53:21.992537 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991161    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 03:53:21.992537 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991163    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 03:53:21.992537 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991166    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 03:53:21.992537 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991168    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 03:53:21.992537 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991171    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 03:53:21.992537 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991173    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 03:53:21.992537 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991177    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 03:53:21.992537 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991181    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 03:53:21.992537 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991186    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 03:53:21.992537 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991189    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 03:53:21.992537 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991191    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 03:53:21.992537 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991194    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 03:53:21.992537 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991197    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 03:53:21.992537 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991200    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 03:53:21.992537 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991202    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 03:53:21.992537 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991205    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 03:53:21.993050 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991207    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 03:53:21.993050 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991210    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 03:53:21.993050 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991212    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 03:53:21.993050 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991218    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 03:53:21.993050 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991222    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 03:53:21.993050 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991226    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 03:53:21.993050 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991229    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 03:53:21.993050 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991234    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 03:53:21.993050 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991237    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 03:53:21.993050 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991240    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 03:53:21.993050 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991243    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 03:53:21.993050 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991246    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 03:53:21.993050 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991248    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 03:53:21.993050 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991251    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 03:53:21.993050 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991254    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 03:53:21.993050 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991256    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 03:53:21.993050 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991258    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 03:53:21.993050 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991261    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 03:53:21.993050 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991264    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 03:53:21.993536 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991267    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 03:53:21.993536 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991269    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 03:53:21.993536 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991272    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 03:53:21.993536 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991276    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 03:53:21.993536 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991280    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 03:53:21.993536 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991282    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 03:53:21.993536 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991284    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 03:53:21.993536 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991287    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 03:53:21.993536 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991290    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 03:53:21.993536 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991293    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 03:53:21.993536 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991295    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 03:53:21.993536 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991298    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 03:53:21.993536 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991301    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 03:53:21.993536 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991303    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 03:53:21.993536 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991306    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 03:53:21.993536 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991309    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 03:53:21.993536 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991313    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 03:53:21.993536 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991315    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 03:53:21.993536 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991318    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 03:53:21.993536 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991321    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 03:53:21.994052 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991765    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 03:53:21.994052 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991771    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 03:53:21.994052 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991774    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 03:53:21.994052 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991777    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 03:53:21.994052 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991780    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 03:53:21.994052 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991783    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 03:53:21.994052 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991786    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 03:53:21.994052 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991789    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 03:53:21.994052 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991791    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 03:53:21.994052 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991794    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 03:53:21.994052 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991797    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 03:53:21.994052 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991800    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 03:53:21.994052 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991803    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 03:53:21.994052 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991805    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 03:53:21.994052 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991808    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 03:53:21.994052 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991811    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 03:53:21.994052 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991814    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 03:53:21.994052 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991816    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 03:53:21.994052 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991819    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 03:53:21.994052 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991822    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 03:53:21.994547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991824    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 03:53:21.994547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991827    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 03:53:21.994547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991829    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 03:53:21.994547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991832    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 03:53:21.994547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991834    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 03:53:21.994547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991837    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 03:53:21.994547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991839    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 03:53:21.994547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991842    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 03:53:21.994547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991847    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 03:53:21.994547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991849    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 03:53:21.994547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991852    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 03:53:21.994547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991855    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 03:53:21.994547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991858    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 03:53:21.994547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991861    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 03:53:21.994547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991863    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 03:53:21.994547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991866    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 03:53:21.994547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991869    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 03:53:21.994547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991871    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 03:53:21.994547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991874    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 03:53:21.994547 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991876    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 03:53:21.995091 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991879    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 03:53:21.995091 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991882    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 03:53:21.995091 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991884    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 03:53:21.995091 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991887    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 03:53:21.995091 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991891    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 03:53:21.995091 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991895    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 03:53:21.995091 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991898    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 03:53:21.995091 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991901    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 03:53:21.995091 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991904    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 03:53:21.995091 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991909    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 03:53:21.995091 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991912    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 03:53:21.995091 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991915    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 03:53:21.995091 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991919    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 03:53:21.995091 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991922    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 03:53:21.995091 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991925    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 03:53:21.995091 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991928    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 03:53:21.995091 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991931    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 03:53:21.995091 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991934    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 03:53:21.995091 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991937    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 03:53:21.995570 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991940    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 03:53:21.995570 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991944    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 03:53:21.995570 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991947    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 03:53:21.995570 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991950    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 03:53:21.995570 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991954    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 03:53:21.995570 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991958    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 03:53:21.995570 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991961    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 03:53:21.995570 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991964    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 03:53:21.995570 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991967    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 03:53:21.995570 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991969    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 03:53:21.995570 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991972    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 03:53:21.995570 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991974    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 03:53:21.995570 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991977    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 03:53:21.995570 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991979    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 03:53:21.995570 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991982    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 03:53:21.995570 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991985    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 03:53:21.995570 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991987    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 03:53:21.995570 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991990    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 03:53:21.995570 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991993    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 03:53:21.995570 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991995    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 03:53:21.996075 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.991998    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 03:53:21.996075 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992000    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 03:53:21.996075 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992003    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 03:53:21.996075 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992006    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 03:53:21.996075 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992009    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 03:53:21.996075 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992011    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 03:53:21.996075 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992014    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 03:53:21.996075 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992016    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 03:53:21.996075 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992019    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 03:53:21.996075 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992022    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 03:53:21.996075 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992024    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 03:53:21.996075 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992027    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 03:53:21.996075 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992029    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 03:53:21.996075 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992033    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 03:53:21.996075 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992035    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 03:53:21.996075 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992038    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 03:53:21.996075 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992040    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 03:53:21.996075 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992043    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 03:53:21.996075 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992045    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 03:53:21.996075 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992048    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 03:53:21.996593 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992128    2558 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 03:53:21.996593 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992163    2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 03:53:21.996593 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992170    2558 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 03:53:21.996593 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992175    2558 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 03:53:21.996593 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992179    2558 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 03:53:21.996593 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992183    2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 03:53:21.996593 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992187    2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 03:53:21.996593 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992191    2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 03:53:21.996593 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992194    2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 03:53:21.996593 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992198    2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 03:53:21.996593 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992201    2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 03:53:21.996593 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992204    2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 03:53:21.996593 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992208    2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 03:53:21.996593 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992211    2558 flags.go:64] FLAG: --cgroup-root=""
Sep 11 03:53:21.996593 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992214    2558 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 03:53:21.996593 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992216    2558 flags.go:64] FLAG: --client-ca-file=""
Sep 11 03:53:21.996593 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992220    2558 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 03:53:21.996593 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992223    2558 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 03:53:21.996593 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992227    2558 flags.go:64] FLAG: --cluster-domain=""
Sep 11 03:53:21.996593 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992230    2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 03:53:21.996593 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992234    2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 03:53:21.996593 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992237    2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 03:53:21.996593 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992240    2558 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 03:53:21.996593 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992244    2558 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 03:53:21.997232 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992247    2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 03:53:21.997232 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992251    2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 03:53:21.997232 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992255    2558 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 03:53:21.997232 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992258    2558 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 03:53:21.997232 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992261    2558 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 03:53:21.997232 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992264    2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 03:53:21.997232 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992267    2558 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 03:53:21.997232 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992270    2558 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 03:53:21.997232 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992274    2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 03:53:21.997232 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992277    2558 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 03:53:21.997232 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992280    2558 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 03:53:21.997232 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992283    2558 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 03:53:21.997232 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992286    2558 flags.go:64] FLAG: --enable-server="true"
Sep 11 03:53:21.997232 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992288    2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 03:53:21.997232 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992320    2558 flags.go:64] FLAG: --event-burst="100"
Sep 11 03:53:21.997232 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992324    2558 flags.go:64] FLAG: --event-qps="50"
Sep 11 03:53:21.997232 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992327    2558 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 03:53:21.997232 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992331    2558 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 03:53:21.997232 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992334    2558 flags.go:64] FLAG: --eviction-hard=""
Sep 11 03:53:21.997232 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992338    2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 03:53:21.997232 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992340    2558 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 03:53:21.997232 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992344    2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 03:53:21.997232 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992346    2558 flags.go:64] FLAG: --eviction-soft=""
Sep 11 03:53:21.997232 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992349    2558 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 03:53:21.997232 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992352    2558 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 03:53:21.997877 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992356    2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 03:53:21.997877 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992359    2558 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 03:53:21.997877 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992361    2558 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 03:53:21.997877 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992366    2558 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 03:53:21.997877 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992370    2558 flags.go:64] FLAG: --feature-gates=""
Sep 11 03:53:21.997877 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992373    2558 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 03:53:21.997877 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992377    2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 03:53:21.997877 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992380    2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 03:53:21.997877 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992383    2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 03:53:21.997877 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992386    2558 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 03:53:21.997877 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992389    2558 flags.go:64] FLAG: --help="false"
Sep 11 03:53:21.997877 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992392    2558 flags.go:64] FLAG: --hostname-override="ip-10-0-130-195.ec2.internal"
Sep 11 03:53:21.997877 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992396    2558 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 03:53:21.997877 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992399    2558 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 03:53:21.997877 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992401    2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 03:53:21.997877 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992405    2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 03:53:21.997877 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992408    2558 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 03:53:21.997877 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992411    2558 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 03:53:21.997877 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992414    2558 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 03:53:21.997877 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992417    2558 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 03:53:21.997877 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992420    2558 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 03:53:21.997877 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992423    2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 03:53:21.997877 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992426    2558 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 03:53:21.997877 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992429    2558 flags.go:64] FLAG: --kube-reserved=""
Sep 11 03:53:21.998479 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992432    2558 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 03:53:21.998479 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992435    2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 03:53:21.998479 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992438    2558 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 03:53:21.998479 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992441    2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 03:53:21.998479 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992444    2558 flags.go:64] FLAG: --lock-file=""
Sep 11 03:53:21.998479 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992446    2558 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 03:53:21.998479 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992449    2558 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 03:53:21.998479 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992452    2558 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 03:53:21.998479 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992458    2558 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 03:53:21.998479 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992461    2558 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 03:53:21.998479 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992465    2558 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 03:53:21.998479 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992468    2558 flags.go:64] FLAG: --logging-format="text"
Sep 11 03:53:21.998479 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992471    2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 03:53:21.998479 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992475    2558 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 03:53:21.998479 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992477    2558 flags.go:64] FLAG: --manifest-url=""
Sep 11 03:53:21.998479 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992480    2558 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 03:53:21.998479 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992484    2558 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 03:53:21.998479 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992487    2558 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 03:53:21.998479 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992491    2558 flags.go:64] FLAG: --max-pods="110"
Sep 11 03:53:21.998479 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992494    2558 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 03:53:21.998479 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992497    2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 03:53:21.998479 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992500    2558 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 03:53:21.998479 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992503    2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 03:53:21.998479 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992506    2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 03:53:21.998479 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992509    2558 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 03:53:21.999111 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992512    2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 03:53:21.999111 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992521    2558 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 03:53:21.999111 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992524    2558 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 03:53:21.999111 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992527    2558 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 03:53:21.999111 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992530    2558 flags.go:64] FLAG: --pod-cidr=""
Sep 11 03:53:21.999111 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992533    2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 03:53:21.999111 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992538    2558 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 03:53:21.999111 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992541    2558 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 03:53:21.999111 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992544    2558 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 03:53:21.999111 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992547    2558 flags.go:64] FLAG: --port="10250"
Sep 11 03:53:21.999111 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992550    2558 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 03:53:21.999111 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992553    2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fa1e6a0cf9f64e46"
Sep 11 03:53:21.999111 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992556    2558 flags.go:64] FLAG: --qos-reserved=""
Sep 11 03:53:21.999111 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992559    2558 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 03:53:21.999111 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992563    2558 flags.go:64] FLAG: --register-node="true"
Sep 11 03:53:21.999111 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992566    2558 flags.go:64] FLAG: --register-with-taints=""
Sep 11 03:53:21.999111 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992569    2558 flags.go:64] FLAG: --registry-burst="10"
Sep 11 03:53:21.999111 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992573    2558 flags.go:64] FLAG: --registry-qps="5"
Sep 11 03:53:21.999111 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992577    2558 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 03:53:21.999111 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992580    2558 flags.go:64] FLAG: --reserved-memory=""
Sep 11 03:53:21.999111 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992583    2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 03:53:21.999111 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992586    2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 03:53:21.999111 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992589    2558 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 03:53:21.999111 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992592    2558 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 03:53:21.999111 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992595    2558 flags.go:64] FLAG: --runonce="false"
Sep 11 03:53:21.999785 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992611    2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 03:53:21.999785 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992614    2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 03:53:21.999785 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992617    2558 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 03:53:21.999785 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992620    2558 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 03:53:21.999785 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992623    2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 03:53:21.999785 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992626    2558 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 03:53:21.999785 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992630    2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 03:53:21.999785 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992633    2558 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 03:53:21.999785 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992636    2558 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 03:53:21.999785 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992639    2558 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 03:53:21.999785 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992642    2558 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 03:53:21.999785 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992645    2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 03:53:21.999785 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992648    2558 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 03:53:21.999785 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992650    2558 flags.go:64] FLAG: --system-cgroups=""
Sep 11 03:53:21.999785 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992653    2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 03:53:21.999785 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992658    2558 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 03:53:21.999785 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992661    2558 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 03:53:21.999785 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992664    2558 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 03:53:21.999785 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992668    2558 flags.go:64] FLAG: --tls-min-version=""
Sep 11 03:53:21.999785 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992671    2558 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 03:53:21.999785 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992673    2558 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 03:53:21.999785 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992676    2558 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 03:53:21.999785 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992679    2558 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 03:53:21.999785 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992682    2558 flags.go:64] FLAG: --v="2"
Sep 11 03:53:21.999785 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992686    2558 flags.go:64] FLAG: --version="false"
Sep 11 03:53:22.000426 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992691    2558 flags.go:64] FLAG: --vmodule=""
Sep 11 03:53:22.000426 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992696    2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 03:53:22.000426 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.992699    2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 03:53:22.000426 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992814    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 03:53:22.000426 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992818    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 03:53:22.000426 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992821    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 03:53:22.000426 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992824    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 03:53:22.000426 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992827    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 03:53:22.000426 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992830    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 03:53:22.000426 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992833    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 03:53:22.000426 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992837    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 03:53:22.000426 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992840    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 03:53:22.000426 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992842    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 03:53:22.000426 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992845    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 03:53:22.000426 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992848    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 03:53:22.000426 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992850    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 03:53:22.000426 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992853    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 03:53:22.000426 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992855    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 03:53:22.000426 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992858    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 03:53:22.000426 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992861    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 03:53:22.000947 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992864    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 03:53:22.000947 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992867    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 03:53:22.000947 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992870    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 03:53:22.000947 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992872    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 03:53:22.000947 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992875    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 03:53:22.000947 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992878    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 03:53:22.000947 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992880    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 03:53:22.000947 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992883    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 03:53:22.000947 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992886    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 03:53:22.000947 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992888    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 03:53:22.000947 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992891    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 03:53:22.000947 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992894    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 03:53:22.000947 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992898    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 03:53:22.000947 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992902    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 03:53:22.000947 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992905    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 03:53:22.000947 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992907    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 03:53:22.000947 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992910    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 03:53:22.000947 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992913    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 03:53:22.000947 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992917    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 03:53:22.001412 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992920    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 03:53:22.001412 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992924    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 03:53:22.001412 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992927    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 03:53:22.001412 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992930    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 03:53:22.001412 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992933    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 03:53:22.001412 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992935    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 03:53:22.001412 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992938    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 03:53:22.001412 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992940    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 03:53:22.001412 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992943    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 03:53:22.001412 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992945    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 03:53:22.001412 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992948    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 03:53:22.001412 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992950    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 03:53:22.001412 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992953    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 03:53:22.001412 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992956    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 03:53:22.001412 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992959    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 03:53:22.001412 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992961    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 03:53:22.001412 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992964    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 03:53:22.001412 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992966    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 03:53:22.001412 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992969    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 03:53:22.001412 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992971    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 03:53:22.002002 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992974    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 03:53:22.002002 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992976    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 03:53:22.002002 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992979    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 03:53:22.002002 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992982    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 03:53:22.002002 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992984    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 03:53:22.002002 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992988    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 03:53:22.002002 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992992    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 03:53:22.002002 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992996    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 03:53:22.002002 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.992999    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 03:53:22.002002 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.993002    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 03:53:22.002002 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.993006    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 03:53:22.002002 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.993009    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 03:53:22.002002 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.993012    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 03:53:22.002002 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.993015    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 03:53:22.002002 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.993018    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 03:53:22.002002 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.993021    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 03:53:22.002002 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.993025    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 03:53:22.002002 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.993029    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 03:53:22.002002 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.993032    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 03:53:22.002995 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.993034    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 03:53:22.002995 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.993037    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 03:53:22.002995 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.993039    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 03:53:22.002995 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.993042    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 03:53:22.002995 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.993045    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 03:53:22.002995 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.993047    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 03:53:22.002995 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.993050    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 03:53:22.002995 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.993052    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 03:53:22.002995 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.993056    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 03:53:22.002995 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.993059    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 03:53:22.002995 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.993061    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 03:53:22.002995 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.993064    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 03:53:22.002995 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.993067    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 03:53:22.002995 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.993069    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 03:53:22.002995 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.993072    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 03:53:22.002995 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.993075    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 03:53:22.002995 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.993077    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 03:53:22.002995 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.993080    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 03:53:22.002995 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.993083    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 03:53:22.002995 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.993087    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 03:53:22.003513 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.993090    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 03:53:22.003513 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.993097    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 03:53:22.003513 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.993100    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 03:53:22.003513 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:21.993102    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 03:53:22.003513 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:21.993855    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 03:53:22.003513 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.000880    2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 03:53:22.003513 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.000899    2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 03:53:22.003513 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.001619    2558 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 03:53:22.003513 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.001626    2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 03:53:22.003513 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001694    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 03:53:22.003513 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001701    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 03:53:22.003513 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001705    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 03:53:22.003513 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001709    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 03:53:22.003513 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001712    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 03:53:22.003904 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001715    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 03:53:22.003904 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001718    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 03:53:22.003904 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001721    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 03:53:22.003904 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001723    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 03:53:22.003904 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001726    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 03:53:22.003904 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001729    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 03:53:22.003904 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001732    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 03:53:22.003904 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001735    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 03:53:22.003904 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001737    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 03:53:22.003904 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001740    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 03:53:22.003904 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001743    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 03:53:22.003904 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001746    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 03:53:22.003904 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001749    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 03:53:22.003904 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001752    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 03:53:22.003904 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001755    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 03:53:22.003904 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001757    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 03:53:22.003904 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001760    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 03:53:22.003904 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001763    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 03:53:22.003904 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001766    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 03:53:22.003904 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001770    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 03:53:22.004436 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001774    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 03:53:22.004436 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001777    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 03:53:22.004436 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001780    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 03:53:22.004436 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001783    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 03:53:22.004436 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001786    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 03:53:22.004436 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001789    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 03:53:22.004436 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001792    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 03:53:22.004436 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001794    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 03:53:22.004436 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001797    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 03:53:22.004436 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001801    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 03:53:22.004436 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001803    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 03:53:22.004436 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001806    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 03:53:22.004436 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001809    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 03:53:22.004436 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001812    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 03:53:22.004436 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001814    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 03:53:22.004436 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001817    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 03:53:22.004436 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001820    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 03:53:22.004436 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001823    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 03:53:22.004436 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001826    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 03:53:22.004937 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001828    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 03:53:22.004937 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001831    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 03:53:22.004937 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001834    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 03:53:22.004937 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001837    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 03:53:22.004937 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001840    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 03:53:22.004937 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001842    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 03:53:22.004937 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001845    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 03:53:22.004937 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001848    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 03:53:22.004937 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001851    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 03:53:22.004937 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001854    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 03:53:22.004937 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001857    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 03:53:22.004937 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001860    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 03:53:22.004937 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001862    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 03:53:22.004937 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001865    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 03:53:22.004937 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001868    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 03:53:22.004937 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001871    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 03:53:22.004937 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001874    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 03:53:22.004937 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001877    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 03:53:22.004937 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001880    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 03:53:22.004937 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001882    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 03:53:22.005450 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001885    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 03:53:22.005450 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001888    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 03:53:22.005450 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001890    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 03:53:22.005450 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001893    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 03:53:22.005450 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001896    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 03:53:22.005450 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001898    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 03:53:22.005450 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001901    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 03:53:22.005450 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001903    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 03:53:22.005450 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001906    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 03:53:22.005450 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001908    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 03:53:22.005450 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001912    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 03:53:22.005450 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001916    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 03:53:22.005450 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001919    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 03:53:22.005450 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001922    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 03:53:22.005450 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001926    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 03:53:22.005450 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001928    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 03:53:22.005450 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001931    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 03:53:22.005450 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001933    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 03:53:22.005450 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001936    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 03:53:22.005450 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001939    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 03:53:22.005957 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001941    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 03:53:22.005957 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001944    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 03:53:22.005957 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001947    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 03:53:22.005957 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001950    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 03:53:22.005957 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001953    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 03:53:22.005957 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001955    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 03:53:22.005957 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001959    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 03:53:22.005957 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001961    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 03:53:22.005957 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001964    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 03:53:22.005957 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001967    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 03:53:22.005957 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001969    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 03:53:22.005957 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001979    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 03:53:22.005957 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001983    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 03:53:22.005957 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001986    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 03:53:22.005957 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.001989    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 03:53:22.006341 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.001994    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 03:53:22.006341 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002137    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 03:53:22.006341 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002142    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 03:53:22.006341 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002145    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 03:53:22.006341 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002148    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 03:53:22.006341 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002151    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 03:53:22.006341 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002154    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 03:53:22.006341 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002156    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 03:53:22.006341 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002159    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 03:53:22.006341 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002162    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 03:53:22.006341 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002165    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 03:53:22.006341 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002168    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 03:53:22.006341 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002171    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 03:53:22.006341 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002173    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 03:53:22.006341 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002176    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 03:53:22.006728 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002178    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 03:53:22.006728 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002181    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 03:53:22.006728 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002184    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 03:53:22.006728 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002187    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 03:53:22.006728 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002189    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 03:53:22.006728 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002192    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 03:53:22.006728 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002194    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 03:53:22.006728 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002197    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 03:53:22.006728 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002200    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 03:53:22.006728 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002210    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 03:53:22.006728 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002213    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 03:53:22.006728 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002216    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 03:53:22.006728 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002219    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 03:53:22.006728 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002222    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 03:53:22.006728 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002224    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 03:53:22.006728 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002227    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 03:53:22.006728 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002230    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 03:53:22.006728 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002232    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 03:53:22.006728 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002236    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 03:53:22.006728 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002240    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 03:53:22.007211 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002242    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 03:53:22.007211 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002245    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 03:53:22.007211 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002248    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 03:53:22.007211 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002251    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 03:53:22.007211 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002253    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 03:53:22.007211 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002257    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 03:53:22.007211 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002261    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 03:53:22.007211 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002264    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 03:53:22.007211 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002267    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 03:53:22.007211 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002270    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 03:53:22.007211 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002272    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 03:53:22.007211 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002275    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 03:53:22.007211 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002278    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 03:53:22.007211 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002281    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 03:53:22.007211 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002283    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 03:53:22.007211 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002286    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 03:53:22.007211 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002288    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 03:53:22.007211 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002291    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 03:53:22.007211 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002293    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 03:53:22.007833 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002296    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 03:53:22.007833 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002298    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 03:53:22.007833 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002301    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 03:53:22.007833 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002309    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 03:53:22.007833 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002312    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 03:53:22.007833 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002315    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 03:53:22.007833 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002318    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 03:53:22.007833 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002320    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 03:53:22.007833 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002323    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 03:53:22.007833 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002326    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 03:53:22.007833 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002329    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 03:53:22.007833 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002331    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 03:53:22.007833 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002334    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 03:53:22.007833 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002337    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 03:53:22.007833 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002339    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 03:53:22.007833 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002342    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 03:53:22.007833 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002344    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 03:53:22.007833 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002347    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 03:53:22.007833 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002349    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 03:53:22.007833 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002352    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 03:53:22.008345 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002355    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 03:53:22.008345 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002357    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 03:53:22.008345 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002360    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 03:53:22.008345 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002362    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 03:53:22.008345 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002365    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 03:53:22.008345 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002368    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 03:53:22.008345 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002370    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 03:53:22.008345 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002373    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 03:53:22.008345 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002375    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 03:53:22.008345 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002377    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 03:53:22.008345 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002380    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 03:53:22.008345 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002383    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 03:53:22.008345 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002385    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 03:53:22.008345 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002388    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 03:53:22.008345 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002390    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 03:53:22.008345 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002393    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 03:53:22.008345 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002404    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 03:53:22.008345 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002407    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 03:53:22.008345 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002410    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 03:53:22.008345 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002412    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 03:53:22.008855 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002415    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 03:53:22.008855 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002417    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 03:53:22.008855 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002420    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 03:53:22.008855 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002422    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 03:53:22.008855 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002425    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 03:53:22.008855 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:22.002428    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 03:53:22.008855 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.002433    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 03:53:22.008855 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.002647    2558 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 03:53:22.008855 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.004799    2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 03:53:22.008855 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.005755    2558 server.go:1019] "Starting client certificate rotation"
Sep 11 03:53:22.008855 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.005866    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 03:53:22.008855 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.006509    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 03:53:22.008855 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.008194    2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 03:53:22.011385 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.011362    2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 03:53:22.023398 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.023372    2558 log.go:25] "Validated CRI v1 runtime API"
Sep 11 03:53:22.041729 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.041687    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 03:53:22.069692 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.069658    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x2p86"
Sep 11 03:53:22.078237 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.078213    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x2p86"
Sep 11 03:53:22.147666 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.147642    2558 log.go:25] "Validated CRI v1 image API"
Sep 11 03:53:22.148713 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.148692    2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 03:53:22.151735 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.151712    2558 fs.go:135] Filesystem UUIDs: map[3dd4573f-73ba-463c-b79d-0d04241a004c:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a2476513-91b7-4adb-a2c8-fd4e2daade18:/dev/nvme0n1p4]
Sep 11 03:53:22.151815 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.151734    2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 03:53:22.157835 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.157710    2558 manager.go:216] Machine: {Timestamp:2026-09-11 03:53:22.155494015 +0000 UTC m=+0.435368841 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100434 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25e52693782a6313e920011e31fc80 SystemUUID:ec25e526-9378-2a63-13e9-20011e31fc80 BootID:2acb8007-0e33-46ae-b9e9-489a10af6fe4 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c0:79:fa:75:5b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c0:79:fa:75:5b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:f4:72:cb:28:6f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 03:53:22.157835 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.157828    2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 03:53:22.157957 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.157919    2558 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 03:53:22.161348 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.161314    2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 03:53:22.161517 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.161351    2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-195.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 03:53:22.162569 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.162557    2558 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 03:53:22.162615 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.162571    2558 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 03:53:22.162615 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.162580    2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 03:53:22.163208 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.163196    2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 03:53:22.164405 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.164393    2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 03:53:22.167758 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.167742    2558 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 03:53:22.167897 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.167887    2558 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 03:53:22.167937 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.167923    2558 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 03:53:22.167966 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.167947    2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 03:53:22.167966 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.167962    2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 03:53:22.168017 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.167978    2558 kubelet.go:398] "Adding apiserver pod source"
Sep 11 03:53:22.168017 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.167993    2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 03:53:22.168509 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.168492    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 03:53:22.168509 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.168515    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 03:53:22.170816 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.170795    2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 03:53:22.172539 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.172520    2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 03:53:22.172651 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.172559    2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 03:53:22.174121 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.174103    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 03:53:22.174121 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.174125    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 03:53:22.174233 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.174132    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 03:53:22.174233 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.174137    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 03:53:22.174233 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.174146    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 03:53:22.174233 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.174151    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 03:53:22.174233 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.174165    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 03:53:22.174233 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.174170    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 03:53:22.174233 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.174177    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 03:53:22.174233 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.174183    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 03:53:22.174233 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.174200    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 03:53:22.174233 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.174205    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 03:53:22.175431 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.175416    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 03:53:22.175431 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.175431    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 03:53:22.180360 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.180339    2558 server.go:1268] "Started kubelet"
Sep 11 03:53:22.180617 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.180541    2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 03:53:22.180617 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.180557    2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 03:53:22.180761 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.180639    2558 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 03:53:22.181375 ip-10-0-130-195 systemd[1]: Started Kubernetes Kubelet.
Sep 11 03:53:22.182565 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.182307    2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 03:53:22.182830 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.182816    2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 03:53:22.182888 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.182878    2558 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 03:53:22.183880 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.183860    2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 03:53:22.184807 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:22.184789    2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 03:53:22.186350 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.186335    2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 03:53:22.186445 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.186355    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 03:53:22.186500 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:22.186430    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-195.ec2.internal\" not found"
Sep 11 03:53:22.186960 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.186941    2558 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 03:53:22.186960 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.186961    2558 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 03:53:22.187148 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.186951    2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 03:53:22.187148 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.187053    2558 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 03:53:22.187148 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.187062    2558 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 03:53:22.187148 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.187128    2558 factory.go:55] Registering systemd factory
Sep 11 03:53:22.187148 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.187143    2558 factory.go:223] Registration of the systemd container factory successfully
Sep 11 03:53:22.187449 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.187434    2558 factory.go:153] Registering CRI-O factory
Sep 11 03:53:22.187449 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.187452    2558 factory.go:223] Registration of the crio container factory successfully
Sep 11 03:53:22.187587 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.187467    2558 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-130-195.ec2.internal" not found
Sep 11 03:53:22.187587 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.187505    2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 03:53:22.187587 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.187525    2558 factory.go:103] Registering Raw factory
Sep 11 03:53:22.187587 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.187551    2558 manager.go:1196] Started watching for new ooms in manager
Sep 11 03:53:22.187951 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.187931    2558 manager.go:349] Starting recovery of all containers
Sep 11 03:53:22.188436 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.188408    2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 03:53:22.191219 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:22.191079    2558 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-195.ec2.internal\" not found" node="ip-10-0-130-195.ec2.internal"
Sep 11 03:53:22.199779 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.199753    2558 manager.go:354] Recovery completed
Sep 11 03:53:22.201190 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:22.201149    2558 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 11 03:53:22.203184 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.203162    2558 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-130-195.ec2.internal" not found
Sep 11 03:53:22.204313 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.204301    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 03:53:22.206129 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.206113    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-195.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 03:53:22.206200 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.206142    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-195.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 03:53:22.206200 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.206159    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-195.ec2.internal" event="NodeHasSufficientPID"
Sep 11 03:53:22.206735 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.206719    2558 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 03:53:22.206735 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.206731    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 03:53:22.206735 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.206734    2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 03:53:22.206896 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.206754    2558 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 03:53:22.207382 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.207368    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-195.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 03:53:22.207435 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.207392    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-195.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 03:53:22.207435 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.207401    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-195.ec2.internal" event="NodeHasSufficientPID"
Sep 11 03:53:22.208059 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.208045    2558 policy_none.go:49] "None policy: Start"
Sep 11 03:53:22.208134 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.208066    2558 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 03:53:22.208134 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.208079    2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 03:53:22.209200 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.209188    2558 policy_none.go:47] "Start"
Sep 11 03:53:22.244339 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.244310    2558 manager.go:337] "Starting Device Plugin manager"
Sep 11 03:53:22.258579 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:22.244363    2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 03:53:22.258579 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.244379    2558 server.go:87] "Starting device plugin registration server"
Sep 11 03:53:22.258579 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.244779    2558 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 03:53:22.258579 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.244792    2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 03:53:22.258579 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.244900    2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 03:53:22.258579 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.244990    2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 03:53:22.258579 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.245001    2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 03:53:22.258579 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:22.245541    2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 03:53:22.258579 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:22.245594    2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-195.ec2.internal\" not found"
Sep 11 03:53:22.261784 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.261761    2558 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-130-195.ec2.internal" not found
Sep 11 03:53:22.320155 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.320116    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 03:53:22.321526 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.321503    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 03:53:22.321660 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.321559    2558 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 03:53:22.321660 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.321592    2558 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 03:53:22.321784 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:22.321704    2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 11 03:53:22.324484 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.324467    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 03:53:22.345630 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.345587    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 03:53:22.347307 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.347283    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-195.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 03:53:22.347414 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.347326    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-195.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 03:53:22.347414 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.347342    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-195.ec2.internal" event="NodeHasSufficientPID"
Sep 11 03:53:22.347414 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.347365    2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-195.ec2.internal"
Sep 11 03:53:22.354514 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.354495    2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-195.ec2.internal"
Sep 11 03:53:22.422768 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.422710    2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-195.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-195.ec2.internal"]
Sep 11 03:53:22.424876 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.424855    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-195.ec2.internal"
Sep 11 03:53:22.425843 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.425825    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-195.ec2.internal"
Sep 11 03:53:22.452513 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.452486    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-195.ec2.internal"
Sep 11 03:53:22.457069 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.457053    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-195.ec2.internal"
Sep 11 03:53:22.471136 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.471107    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 03:53:22.471242 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.471184    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 03:53:22.489472 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.489403    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/52aa30798a90a24b8f87726fd735fa68-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-195.ec2.internal\" (UID: \"52aa30798a90a24b8f87726fd735fa68\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-195.ec2.internal"
Sep 11 03:53:22.489472 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.489439    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5e4ec590b0b700dcbd5a280ea65eb0b6-config\") pod \"kube-apiserver-proxy-ip-10-0-130-195.ec2.internal\" (UID: \"5e4ec590b0b700dcbd5a280ea65eb0b6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-195.ec2.internal"
Sep 11 03:53:22.489472 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.489457    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/52aa30798a90a24b8f87726fd735fa68-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-195.ec2.internal\" (UID: \"52aa30798a90a24b8f87726fd735fa68\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-195.ec2.internal"
Sep 11 03:53:22.589960 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.589925    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/52aa30798a90a24b8f87726fd735fa68-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-195.ec2.internal\" (UID: \"52aa30798a90a24b8f87726fd735fa68\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-195.ec2.internal"
Sep 11 03:53:22.589960 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.589958    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/52aa30798a90a24b8f87726fd735fa68-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-195.ec2.internal\" (UID: \"52aa30798a90a24b8f87726fd735fa68\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-195.ec2.internal"
Sep 11 03:53:22.590202 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.589980    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5e4ec590b0b700dcbd5a280ea65eb0b6-config\") pod \"kube-apiserver-proxy-ip-10-0-130-195.ec2.internal\" (UID: \"5e4ec590b0b700dcbd5a280ea65eb0b6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-195.ec2.internal"
Sep 11 03:53:22.590202 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.590039    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/52aa30798a90a24b8f87726fd735fa68-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-195.ec2.internal\" (UID: \"52aa30798a90a24b8f87726fd735fa68\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-195.ec2.internal"
Sep 11 03:53:22.590202 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.590094    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5e4ec590b0b700dcbd5a280ea65eb0b6-config\") pod \"kube-apiserver-proxy-ip-10-0-130-195.ec2.internal\" (UID: \"5e4ec590b0b700dcbd5a280ea65eb0b6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-195.ec2.internal"
Sep 11 03:53:22.590202 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.590121    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/52aa30798a90a24b8f87726fd735fa68-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-195.ec2.internal\" (UID: \"52aa30798a90a24b8f87726fd735fa68\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-195.ec2.internal"
Sep 11 03:53:22.773687 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.773591    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-195.ec2.internal"
Sep 11 03:53:22.774707 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:22.774688    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-195.ec2.internal"
Sep 11 03:53:23.006031 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.006000    2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 03:53:23.006531 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.006191    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 03:53:23.006531 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.006198    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 03:53:23.006531 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.006216    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 03:53:23.150056 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.149936    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 03:48:23 +0000 UTC" deadline="2028-06-15 00:34:03.843895604 +0000 UTC"
Sep 11 03:53:23.150056 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.149996    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15428h40m40.693902099s"
Sep 11 03:53:23.169159 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.169132    2558 apiserver.go:52] "Watching apiserver"
Sep 11 03:53:23.177519 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.177491    2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 03:53:23.178290 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.178270    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-nfssn","kube-system/global-pull-secret-syncer-gb2cl","kube-system/konnectivity-agent-zt598","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zld26","openshift-cluster-node-tuning-operator/tuned-dmmhz","openshift-image-registry/node-ca-6rfcj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-195.ec2.internal","openshift-multus/multus-rqbz6","openshift-multus/network-metrics-daemon-xdw4t","kube-system/kube-apiserver-proxy-ip-10-0-130-195.ec2.internal","openshift-dns/node-resolver-5k289","openshift-multus/multus-additional-cni-plugins-bbxwp","openshift-network-diagnostics/network-check-target-5bl6k","openshift-network-operator/iptables-alerter-hmm8m"]
Sep 11 03:53:23.179939 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.179918    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.180991 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.180969    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb2cl"
Sep 11 03:53:23.181550 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:23.181399    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gb2cl" podUID="e72b85ea-da06-4626-9ac7-1aa09afbc972"
Sep 11 03:53:23.182750 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.182728    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 03:53:23.183162 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.183145    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zt598"
Sep 11 03:53:23.183246 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.183195    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 03:53:23.184051 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.184030    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 03:53:23.184051 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.184042    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 03:53:23.184468 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.184213    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 03:53:23.184468 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.184290    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 03:53:23.184565 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.184498    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zld26"
Sep 11 03:53:23.185030 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.184741    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xt2qp\""
Sep 11 03:53:23.185511 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.185495    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 03:53:23.185767 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.185747    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 03:53:23.185845 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.185802    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-c74w6\""
Sep 11 03:53:23.186297 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.186283    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.186449 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.186435    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 03:53:23.187154 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.187139    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 03:53:23.187350 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.187329    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-s8qr2\""
Sep 11 03:53:23.187467 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.187393    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 03:53:23.187550 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.187395    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 03:53:23.187644 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.187628    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6rfcj"
Sep 11 03:53:23.188550 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.188535    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 03:53:23.188550 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.188541    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qcwkd\""
Sep 11 03:53:23.188682 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.188625    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 03:53:23.189006 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.188989    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.189666 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.189646    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dkmqp\""
Sep 11 03:53:23.189740 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.189721    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 03:53:23.189811 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.189797    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 03:53:23.190218 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.190192    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xdw4t"
Sep 11 03:53:23.190308 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:23.190268    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xdw4t" podUID="87707938-5179-4e34-8d8a-892ecac835ee"
Sep 11 03:53:23.190308 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.190295    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 03:53:23.190982 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.190969    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 03:53:23.191475 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.191459    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 03:53:23.191562 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.191548    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 03:53:23.191634 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.191590    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hvmx4\""
Sep 11 03:53:23.191691 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.191652    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5k289"
Sep 11 03:53:23.191765 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.191749    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 03:53:23.193181 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.193163    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bbxwp"
Sep 11 03:53:23.193263 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.193229    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-host-cni-bin\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.193322 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.193261    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-host-cni-netd\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.193322 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.193285    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5a897d30-52c7-43b5-a1f4-ea86ddc16732-etc-selinux\") pod \"aws-ebs-csi-driver-node-zld26\" (UID: \"5a897d30-52c7-43b5-a1f4-ea86ddc16732\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zld26"
Sep 11 03:53:23.193430 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.193309    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-etc-sysctl-conf\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.193430 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.193349    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75lkx\" (UniqueName: \"kubernetes.io/projected/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-kube-api-access-75lkx\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.193430 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.193375    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.193430 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.193401    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-ovnkube-config\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.193596 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.193467    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-env-overrides\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.193596 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.193500    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e72b85ea-da06-4626-9ac7-1aa09afbc972-kubelet-config\") pod \"global-pull-secret-syncer-gb2cl\" (UID: \"e72b85ea-da06-4626-9ac7-1aa09afbc972\") " pod="kube-system/global-pull-secret-syncer-gb2cl"
Sep 11 03:53:23.193596 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.193526    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e72b85ea-da06-4626-9ac7-1aa09afbc972-dbus\") pod \"global-pull-secret-syncer-gb2cl\" (UID: \"e72b85ea-da06-4626-9ac7-1aa09afbc972\") " pod="kube-system/global-pull-secret-syncer-gb2cl"
Sep 11 03:53:23.193596 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.193549    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a500433-7480-46a7-9c45-9a58866265c3-host\") pod \"node-ca-6rfcj\" (UID: \"3a500433-7480-46a7-9c45-9a58866265c3\") " pod="openshift-image-registry/node-ca-6rfcj"
Sep 11 03:53:23.193596 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.193571    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5a897d30-52c7-43b5-a1f4-ea86ddc16732-socket-dir\") pod \"aws-ebs-csi-driver-node-zld26\" (UID: \"5a897d30-52c7-43b5-a1f4-ea86ddc16732\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zld26"
Sep 11 03:53:23.193823 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.193592    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-run\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.193823 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.193635    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-sys\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.193823 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.193658    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-host-slash\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.193823 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.193682    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e72b85ea-da06-4626-9ac7-1aa09afbc972-original-pull-secret\") pod \"global-pull-secret-syncer-gb2cl\" (UID: \"e72b85ea-da06-4626-9ac7-1aa09afbc972\") " pod="kube-system/global-pull-secret-syncer-gb2cl"
Sep 11 03:53:23.193823 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.193734    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5a897d30-52c7-43b5-a1f4-ea86ddc16732-device-dir\") pod \"aws-ebs-csi-driver-node-zld26\" (UID: \"5a897d30-52c7-43b5-a1f4-ea86ddc16732\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zld26"
Sep 11 03:53:23.193823 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.193771    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-host\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.193823 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.193789    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 03:53:23.193823 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.193798    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-etc-tuned\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.194186 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.193826    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbvs6\" (UniqueName: \"kubernetes.io/projected/3a500433-7480-46a7-9c45-9a58866265c3-kube-api-access-pbvs6\") pod \"node-ca-6rfcj\" (UID: \"3a500433-7480-46a7-9c45-9a58866265c3\") " pod="openshift-image-registry/node-ca-6rfcj"
Sep 11 03:53:23.194186 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.193854    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-host-kubelet\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.194186 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.193884    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-var-lib-openvswitch\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.194186 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.193907    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-run-ovn\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.194186 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.193935    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-lib-modules\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.194186 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.193945    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 03:53:23.194186 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.193957    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-tmp\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.194186 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.193987    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-systemd-units\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.194186 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.194031    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-host-run-netns\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.194186 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.194055    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-etc-openvswitch\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.194186 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.194088    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-ovn-node-metrics-cert\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.194186 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.194114    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-etc-sysconfig\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.194186 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.194148    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vxlrv\""
Sep 11 03:53:23.194186 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.194161    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-etc-kubernetes\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.194186 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.194187    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-var-lib-kubelet\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.194735 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.194214    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-node-log\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.194735 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.194236    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52jw2\" (UniqueName: \"kubernetes.io/projected/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-kube-api-access-52jw2\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.194735 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.194264    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0247f5db-3e1c-4545-baff-7388ebef867d-agent-certs\") pod \"konnectivity-agent-zt598\" (UID: \"0247f5db-3e1c-4545-baff-7388ebef867d\") " pod="kube-system/konnectivity-agent-zt598"
Sep 11 03:53:23.194735 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.194286    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5a897d30-52c7-43b5-a1f4-ea86ddc16732-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zld26\" (UID: \"5a897d30-52c7-43b5-a1f4-ea86ddc16732\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zld26"
Sep 11 03:53:23.194735 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.194325    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5a897d30-52c7-43b5-a1f4-ea86ddc16732-registration-dir\") pod \"aws-ebs-csi-driver-node-zld26\" (UID: \"5a897d30-52c7-43b5-a1f4-ea86ddc16732\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zld26"
Sep 11 03:53:23.194735 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.194350    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-etc-systemd\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.194735 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.194377    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-log-socket\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.194735 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.194393    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-host-run-ovn-kubernetes\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.194735 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.194407    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0247f5db-3e1c-4545-baff-7388ebef867d-konnectivity-ca\") pod \"konnectivity-agent-zt598\" (UID: \"0247f5db-3e1c-4545-baff-7388ebef867d\") " pod="kube-system/konnectivity-agent-zt598"
Sep 11 03:53:23.194735 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.194421    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-etc-modprobe-d\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.194735 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.194440    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-run-systemd\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.194735 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.194491    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-run-openvswitch\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.194735 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.194522    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-ovnkube-script-lib\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.194735 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.194553    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnp2m\" (UniqueName: \"kubernetes.io/projected/5a897d30-52c7-43b5-a1f4-ea86ddc16732-kube-api-access-cnp2m\") pod \"aws-ebs-csi-driver-node-zld26\" (UID: \"5a897d30-52c7-43b5-a1f4-ea86ddc16732\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zld26"
Sep 11 03:53:23.194735 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.194572    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5a897d30-52c7-43b5-a1f4-ea86ddc16732-sys-fs\") pod \"aws-ebs-csi-driver-node-zld26\" (UID: \"5a897d30-52c7-43b5-a1f4-ea86ddc16732\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zld26"
Sep 11 03:53:23.194735 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.194585    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-etc-sysctl-d\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.195176 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.194623    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a500433-7480-46a7-9c45-9a58866265c3-serviceca\") pod \"node-ca-6rfcj\" (UID: \"3a500433-7480-46a7-9c45-9a58866265c3\") " pod="openshift-image-registry/node-ca-6rfcj"
Sep 11 03:53:23.195176 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.194755    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bl6k"
Sep 11 03:53:23.195176 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:23.194830    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bl6k" podUID="6b502d3b-4680-40e1-9381-0a5822c16d82"
Sep 11 03:53:23.195341 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.195321    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 03:53:23.195874 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.195481    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kmsfr\""
Sep 11 03:53:23.195874 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.195506    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 03:53:23.196492 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.196473    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hmm8m"
Sep 11 03:53:23.200481 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.200465    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 03:53:23.200529 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.200465    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 03:53:23.200567 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.200536    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pp9lb\""
Sep 11 03:53:23.201399 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.201384    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 03:53:23.203395 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.203381    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 03:53:23.219505 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.219483    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jjrqs"
Sep 11 03:53:23.227119 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.227092    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jjrqs"
Sep 11 03:53:23.288036 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.288009    2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 03:53:23.294870 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.294844    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75lkx\" (UniqueName: \"kubernetes.io/projected/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-kube-api-access-75lkx\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.295022 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.294876    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a500433-7480-46a7-9c45-9a58866265c3-host\") pod \"node-ca-6rfcj\" (UID: \"3a500433-7480-46a7-9c45-9a58866265c3\") " pod="openshift-image-registry/node-ca-6rfcj"
Sep 11 03:53:23.295022 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.294901    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5a897d30-52c7-43b5-a1f4-ea86ddc16732-socket-dir\") pod \"aws-ebs-csi-driver-node-zld26\" (UID: \"5a897d30-52c7-43b5-a1f4-ea86ddc16732\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zld26"
Sep 11 03:53:23.295022 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.294986    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a500433-7480-46a7-9c45-9a58866265c3-host\") pod \"node-ca-6rfcj\" (UID: \"3a500433-7480-46a7-9c45-9a58866265c3\") " pod="openshift-image-registry/node-ca-6rfcj"
Sep 11 03:53:23.295022 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295019    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5a897d30-52c7-43b5-a1f4-ea86ddc16732-socket-dir\") pod \"aws-ebs-csi-driver-node-zld26\" (UID: \"5a897d30-52c7-43b5-a1f4-ea86ddc16732\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zld26"
Sep 11 03:53:23.295225 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295040    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-sys\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.295225 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295066    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-host-slash\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.295225 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295087    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-multus-cni-dir\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.295225 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295113    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-sys\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.295225 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295133    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-host-slash\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.295225 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295165    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-cni-binary-copy\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.295225 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295189    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87707938-5179-4e34-8d8a-892ecac835ee-metrics-certs\") pod \"network-metrics-daemon-xdw4t\" (UID: \"87707938-5179-4e34-8d8a-892ecac835ee\") " pod="openshift-multus/network-metrics-daemon-xdw4t"
Sep 11 03:53:23.295225 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295207    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/091ab74f-c966-419b-9a8b-1cbee553790f-cnibin\") pod \"multus-additional-cni-plugins-bbxwp\" (UID: \"091ab74f-c966-419b-9a8b-1cbee553790f\") " pod="openshift-multus/multus-additional-cni-plugins-bbxwp"
Sep 11 03:53:23.295538 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295245    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-host\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.295538 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295267    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-etc-tuned\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.295538 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295291    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-host-kubelet\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.295538 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295310    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-host\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.295538 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295314    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-var-lib-openvswitch\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.295538 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295353    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-var-lib-openvswitch\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.295538 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295354    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-run-ovn\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.295538 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295388    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-run-ovn\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.295538 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295390    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-lib-modules\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.295538 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295388    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-host-kubelet\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.295538 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295430    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-systemd-units\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.295538 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295454    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-var-lib-kubelet\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.295538 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295479    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-lib-modules\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.295538 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295482    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52jw2\" (UniqueName: \"kubernetes.io/projected/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-kube-api-access-52jw2\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.295538 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295494    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-systemd-units\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.295538 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295525    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-var-lib-kubelet\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.296218 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295552    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-host-var-lib-cni-multus\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.296218 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295579    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-host-var-lib-kubelet\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.296218 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295644    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-etc-kubernetes\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.296218 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295674    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2pxj\" (UniqueName: \"kubernetes.io/projected/091ab74f-c966-419b-9a8b-1cbee553790f-kube-api-access-z2pxj\") pod \"multus-additional-cni-plugins-bbxwp\" (UID: \"091ab74f-c966-419b-9a8b-1cbee553790f\") " pod="openshift-multus/multus-additional-cni-plugins-bbxwp"
Sep 11 03:53:23.296218 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295704    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5a897d30-52c7-43b5-a1f4-ea86ddc16732-registration-dir\") pod \"aws-ebs-csi-driver-node-zld26\" (UID: \"5a897d30-52c7-43b5-a1f4-ea86ddc16732\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zld26"
Sep 11 03:53:23.296218 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295734    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-etc-systemd\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.296218 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295770    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-log-socket\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.296218 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295796    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-host-run-ovn-kubernetes\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.296218 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295813    2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 03:53:23.296218 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295824    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-etc-systemd\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.296218 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295828    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-log-socket\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.296218 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295818    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-cnibin\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.296218 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295872    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-host-run-ovn-kubernetes\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.296218 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295880    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5a897d30-52c7-43b5-a1f4-ea86ddc16732-registration-dir\") pod \"aws-ebs-csi-driver-node-zld26\" (UID: \"5a897d30-52c7-43b5-a1f4-ea86ddc16732\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zld26"
Sep 11 03:53:23.296218 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295893    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-host-run-multus-certs\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.296218 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295935    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k8kk\" (UniqueName: \"kubernetes.io/projected/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-kube-api-access-7k8kk\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.296218 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295958    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/091ab74f-c966-419b-9a8b-1cbee553790f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bbxwp\" (UID: \"091ab74f-c966-419b-9a8b-1cbee553790f\") " pod="openshift-multus/multus-additional-cni-plugins-bbxwp"
Sep 11 03:53:23.297070 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.295986    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0247f5db-3e1c-4545-baff-7388ebef867d-konnectivity-ca\") pod \"konnectivity-agent-zt598\" (UID: \"0247f5db-3e1c-4545-baff-7388ebef867d\") " pod="kube-system/konnectivity-agent-zt598"
Sep 11 03:53:23.297070 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296021    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-etc-modprobe-d\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.297070 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296052    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-run-systemd\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.297070 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296075    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-run-openvswitch\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.297070 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296102    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4cadd65-2d50-4f05-ba2e-36fcead51fef-host-slash\") pod \"iptables-alerter-hmm8m\" (UID: \"e4cadd65-2d50-4f05-ba2e-36fcead51fef\") " pod="openshift-network-operator/iptables-alerter-hmm8m"
Sep 11 03:53:23.297070 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296130    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnp2m\" (UniqueName: \"kubernetes.io/projected/5a897d30-52c7-43b5-a1f4-ea86ddc16732-kube-api-access-cnp2m\") pod \"aws-ebs-csi-driver-node-zld26\" (UID: \"5a897d30-52c7-43b5-a1f4-ea86ddc16732\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zld26"
Sep 11 03:53:23.297070 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296133    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-run-systemd\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.297070 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296150    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-run-openvswitch\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.297070 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296166    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a500433-7480-46a7-9c45-9a58866265c3-serviceca\") pod \"node-ca-6rfcj\" (UID: \"3a500433-7480-46a7-9c45-9a58866265c3\") " pod="openshift-image-registry/node-ca-6rfcj"
Sep 11 03:53:23.297070 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296129    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-etc-modprobe-d\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.297070 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296213    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-host-cni-bin\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.297070 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296243    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-host-cni-netd\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.297070 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296272    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.297070 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296300    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-env-overrides\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.297070 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296327    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-multus-socket-dir-parent\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.297070 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296362    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-host-cni-bin\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.297070 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296363    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5a897d30-52c7-43b5-a1f4-ea86ddc16732-etc-selinux\") pod \"aws-ebs-csi-driver-node-zld26\" (UID: \"5a897d30-52c7-43b5-a1f4-ea86ddc16732\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zld26"
Sep 11 03:53:23.297892 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296399    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-ovnkube-config\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.297892 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296404    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.297892 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296423    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e72b85ea-da06-4626-9ac7-1aa09afbc972-dbus\") pod \"global-pull-secret-syncer-gb2cl\" (UID: \"e72b85ea-da06-4626-9ac7-1aa09afbc972\") " pod="kube-system/global-pull-secret-syncer-gb2cl"
Sep 11 03:53:23.297892 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296461    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5a897d30-52c7-43b5-a1f4-ea86ddc16732-etc-selinux\") pod \"aws-ebs-csi-driver-node-zld26\" (UID: \"5a897d30-52c7-43b5-a1f4-ea86ddc16732\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zld26"
Sep 11 03:53:23.297892 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296450    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e72b85ea-da06-4626-9ac7-1aa09afbc972-original-pull-secret\") pod \"global-pull-secret-syncer-gb2cl\" (UID: \"e72b85ea-da06-4626-9ac7-1aa09afbc972\") " pod="kube-system/global-pull-secret-syncer-gb2cl"
Sep 11 03:53:23.297892 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296503    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-host-var-lib-cni-bin\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.297892 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296527    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93264b23-0656-44f5-aa41-8626a42e1348-tmp-dir\") pod \"node-resolver-5k289\" (UID: \"93264b23-0656-44f5-aa41-8626a42e1348\") " pod="openshift-dns/node-resolver-5k289"
Sep 11 03:53:23.297892 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:23.296541    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 03:53:23.297892 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296552    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-678vr\" (UniqueName: \"kubernetes.io/projected/93264b23-0656-44f5-aa41-8626a42e1348-kube-api-access-678vr\") pod \"node-resolver-5k289\" (UID: \"93264b23-0656-44f5-aa41-8626a42e1348\") " pod="openshift-dns/node-resolver-5k289"
Sep 11 03:53:23.297892 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296577    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/091ab74f-c966-419b-9a8b-1cbee553790f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bbxwp\" (UID: \"091ab74f-c966-419b-9a8b-1cbee553790f\") " pod="openshift-multus/multus-additional-cni-plugins-bbxwp"
Sep 11 03:53:23.297892 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296596    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0247f5db-3e1c-4545-baff-7388ebef867d-konnectivity-ca\") pod \"konnectivity-agent-zt598\" (UID: \"0247f5db-3e1c-4545-baff-7388ebef867d\") " pod="kube-system/konnectivity-agent-zt598"
Sep 11 03:53:23.297892 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296627    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-run\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.297892 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296671    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a500433-7480-46a7-9c45-9a58866265c3-serviceca\") pod \"node-ca-6rfcj\" (UID: \"3a500433-7480-46a7-9c45-9a58866265c3\") " pod="openshift-image-registry/node-ca-6rfcj"
Sep 11 03:53:23.297892 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296676    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-host-run-netns\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.297892 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296703    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-multus-conf-dir\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.297892 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296716    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e72b85ea-da06-4626-9ac7-1aa09afbc972-dbus\") pod \"global-pull-secret-syncer-gb2cl\" (UID: \"e72b85ea-da06-4626-9ac7-1aa09afbc972\") " pod="kube-system/global-pull-secret-syncer-gb2cl"
Sep 11 03:53:23.297892 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296330    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-host-cni-netd\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.297892 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296762    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-multus-daemon-config\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.298757 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296787    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlwwv\" (UniqueName: \"kubernetes.io/projected/6b502d3b-4680-40e1-9381-0a5822c16d82-kube-api-access-tlwwv\") pod \"network-check-target-5bl6k\" (UID: \"6b502d3b-4680-40e1-9381-0a5822c16d82\") " pod="openshift-network-diagnostics/network-check-target-5bl6k"
Sep 11 03:53:23.298757 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296814    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e4cadd65-2d50-4f05-ba2e-36fcead51fef-iptables-alerter-script\") pod \"iptables-alerter-hmm8m\" (UID: \"e4cadd65-2d50-4f05-ba2e-36fcead51fef\") " pod="openshift-network-operator/iptables-alerter-hmm8m"
Sep 11 03:53:23.298757 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:23.296842    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e72b85ea-da06-4626-9ac7-1aa09afbc972-original-pull-secret podName:e72b85ea-da06-4626-9ac7-1aa09afbc972 nodeName:}" failed. No retries permitted until 2026-09-11 03:53:23.796817346 +0000 UTC m=+2.076692173 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e72b85ea-da06-4626-9ac7-1aa09afbc972-original-pull-secret") pod "global-pull-secret-syncer-gb2cl" (UID: "e72b85ea-da06-4626-9ac7-1aa09afbc972") : object "kube-system"/"original-pull-secret" not registered
Sep 11 03:53:23.298757 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296849    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-run\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.298757 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296874    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-env-overrides\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.298757 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296883    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gtb5\" (UniqueName: \"kubernetes.io/projected/e4cadd65-2d50-4f05-ba2e-36fcead51fef-kube-api-access-6gtb5\") pod \"iptables-alerter-hmm8m\" (UID: \"e4cadd65-2d50-4f05-ba2e-36fcead51fef\") " pod="openshift-network-operator/iptables-alerter-hmm8m"
Sep 11 03:53:23.298757 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296914    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5a897d30-52c7-43b5-a1f4-ea86ddc16732-device-dir\") pod \"aws-ebs-csi-driver-node-zld26\" (UID: \"5a897d30-52c7-43b5-a1f4-ea86ddc16732\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zld26"
Sep 11 03:53:23.298757 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296939    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbvs6\" (UniqueName: \"kubernetes.io/projected/3a500433-7480-46a7-9c45-9a58866265c3-kube-api-access-pbvs6\") pod \"node-ca-6rfcj\" (UID: \"3a500433-7480-46a7-9c45-9a58866265c3\") " pod="openshift-image-registry/node-ca-6rfcj"
Sep 11 03:53:23.298757 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296963    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-hostroot\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.298757 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.296987    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/091ab74f-c966-419b-9a8b-1cbee553790f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bbxwp\" (UID: \"091ab74f-c966-419b-9a8b-1cbee553790f\") " pod="openshift-multus/multus-additional-cni-plugins-bbxwp"
Sep 11 03:53:23.298757 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.297000    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5a897d30-52c7-43b5-a1f4-ea86ddc16732-device-dir\") pod \"aws-ebs-csi-driver-node-zld26\" (UID: \"5a897d30-52c7-43b5-a1f4-ea86ddc16732\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zld26"
Sep 11 03:53:23.298757 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.297013    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-tmp\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.298757 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.297047    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-host-run-netns\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.298757 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.297073    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-etc-openvswitch\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.298757 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.297098    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-ovn-node-metrics-cert\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.298757 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.297126    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-system-cni-dir\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.299630 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.297149    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-etc-sysconfig\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.299630 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.297181    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-etc-kubernetes\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.299630 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.297205    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-node-log\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.299630 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.297200    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-ovnkube-config\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.299630 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.297231    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/091ab74f-c966-419b-9a8b-1cbee553790f-system-cni-dir\") pod \"multus-additional-cni-plugins-bbxwp\" (UID: \"091ab74f-c966-419b-9a8b-1cbee553790f\") " pod="openshift-multus/multus-additional-cni-plugins-bbxwp"
Sep 11 03:53:23.299630 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.297268    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0247f5db-3e1c-4545-baff-7388ebef867d-agent-certs\") pod \"konnectivity-agent-zt598\" (UID: \"0247f5db-3e1c-4545-baff-7388ebef867d\") " pod="kube-system/konnectivity-agent-zt598"
Sep 11 03:53:23.299630 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.297290    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5a897d30-52c7-43b5-a1f4-ea86ddc16732-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zld26\" (UID: \"5a897d30-52c7-43b5-a1f4-ea86ddc16732\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zld26"
Sep 11 03:53:23.299630 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.297316    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-ovnkube-script-lib\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.299630 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.297338    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-host-run-k8s-cni-cncf-io\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.299630 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.297362    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/091ab74f-c966-419b-9a8b-1cbee553790f-cni-binary-copy\") pod \"multus-additional-cni-plugins-bbxwp\" (UID: \"091ab74f-c966-419b-9a8b-1cbee553790f\") " pod="openshift-multus/multus-additional-cni-plugins-bbxwp"
Sep 11 03:53:23.299630 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.297390    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5a897d30-52c7-43b5-a1f4-ea86ddc16732-sys-fs\") pod \"aws-ebs-csi-driver-node-zld26\" (UID: \"5a897d30-52c7-43b5-a1f4-ea86ddc16732\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zld26"
Sep 11 03:53:23.299630 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.297391    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-etc-kubernetes\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.299630 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.297414    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-etc-sysctl-d\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.299630 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.297440    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e72b85ea-da06-4626-9ac7-1aa09afbc972-kubelet-config\") pod \"global-pull-secret-syncer-gb2cl\" (UID: \"e72b85ea-da06-4626-9ac7-1aa09afbc972\") " pod="kube-system/global-pull-secret-syncer-gb2cl"
Sep 11 03:53:23.299630 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.297458    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-node-log\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.299630 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.297462    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/93264b23-0656-44f5-aa41-8626a42e1348-hosts-file\") pod \"node-resolver-5k289\" (UID: \"93264b23-0656-44f5-aa41-8626a42e1348\") " pod="openshift-dns/node-resolver-5k289"
Sep 11 03:53:23.299630 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.297486    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwzwz\" (UniqueName: \"kubernetes.io/projected/87707938-5179-4e34-8d8a-892ecac835ee-kube-api-access-hwzwz\") pod \"network-metrics-daemon-xdw4t\" (UID: \"87707938-5179-4e34-8d8a-892ecac835ee\") " pod="openshift-multus/network-metrics-daemon-xdw4t"
Sep 11 03:53:23.300466 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.297509    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-etc-sysctl-conf\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.300466 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.297698    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-etc-sysctl-conf\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.300466 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.297780    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5a897d30-52c7-43b5-a1f4-ea86ddc16732-sys-fs\") pod \"aws-ebs-csi-driver-node-zld26\" (UID: \"5a897d30-52c7-43b5-a1f4-ea86ddc16732\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zld26"
Sep 11 03:53:23.300466 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.297875    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-etc-sysctl-d\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.300466 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.297926    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e72b85ea-da06-4626-9ac7-1aa09afbc972-kubelet-config\") pod \"global-pull-secret-syncer-gb2cl\" (UID: \"e72b85ea-da06-4626-9ac7-1aa09afbc972\") " pod="kube-system/global-pull-secret-syncer-gb2cl"
Sep 11 03:53:23.300466 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.297277    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-etc-sysconfig\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.300466 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.298108    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-host-run-netns\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.300466 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.298120    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5a897d30-52c7-43b5-a1f4-ea86ddc16732-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zld26\" (UID: \"5a897d30-52c7-43b5-a1f4-ea86ddc16732\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zld26"
Sep 11 03:53:23.300466 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.298180    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-etc-openvswitch\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.300466 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.299385    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-ovnkube-script-lib\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.300466 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.299940    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-etc-tuned\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.300466 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.299957    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-tmp\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.301033 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.300983    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-ovn-node-metrics-cert\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.301088 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.301070    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0247f5db-3e1c-4545-baff-7388ebef867d-agent-certs\") pod \"konnectivity-agent-zt598\" (UID: \"0247f5db-3e1c-4545-baff-7388ebef867d\") " pod="kube-system/konnectivity-agent-zt598"
Sep 11 03:53:23.303572 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.303539    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52jw2\" (UniqueName: \"kubernetes.io/projected/c9add74a-5c51-4ccf-9edd-3b90a66b9ef9-kube-api-access-52jw2\") pod \"ovnkube-node-nfssn\" (UID: \"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.303706 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.303635    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75lkx\" (UniqueName: \"kubernetes.io/projected/5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1-kube-api-access-75lkx\") pod \"tuned-dmmhz\" (UID: \"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1\") " pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.306133 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.306110    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbvs6\" (UniqueName: \"kubernetes.io/projected/3a500433-7480-46a7-9c45-9a58866265c3-kube-api-access-pbvs6\") pod \"node-ca-6rfcj\" (UID: \"3a500433-7480-46a7-9c45-9a58866265c3\") " pod="openshift-image-registry/node-ca-6rfcj"
Sep 11 03:53:23.306219 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.306160    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnp2m\" (UniqueName: \"kubernetes.io/projected/5a897d30-52c7-43b5-a1f4-ea86ddc16732-kube-api-access-cnp2m\") pod \"aws-ebs-csi-driver-node-zld26\" (UID: \"5a897d30-52c7-43b5-a1f4-ea86ddc16732\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zld26"
Sep 11 03:53:23.381304 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:23.381261    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e4ec590b0b700dcbd5a280ea65eb0b6.slice/crio-2a6143eb76285c8972e34ed5421f7b4642d13b52ca5adcfd26d066229cdcef12 WatchSource:0}: Error finding container 2a6143eb76285c8972e34ed5421f7b4642d13b52ca5adcfd26d066229cdcef12: Status 404 returned error can't find the container with id 2a6143eb76285c8972e34ed5421f7b4642d13b52ca5adcfd26d066229cdcef12
Sep 11 03:53:23.381520 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:23.381502    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52aa30798a90a24b8f87726fd735fa68.slice/crio-02a367da28185ea183bcd4d26cf0c938386f1a819bb4d2d21e681fb344d7f847 WatchSource:0}: Error finding container 02a367da28185ea183bcd4d26cf0c938386f1a819bb4d2d21e681fb344d7f847: Status 404 returned error can't find the container with id 02a367da28185ea183bcd4d26cf0c938386f1a819bb4d2d21e681fb344d7f847
Sep 11 03:53:23.386928 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.386913    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 03:53:23.397825 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.397796    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-host-run-k8s-cni-cncf-io\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.397966 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.397831    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/091ab74f-c966-419b-9a8b-1cbee553790f-cni-binary-copy\") pod \"multus-additional-cni-plugins-bbxwp\" (UID: \"091ab74f-c966-419b-9a8b-1cbee553790f\") " pod="openshift-multus/multus-additional-cni-plugins-bbxwp"
Sep 11 03:53:23.397966 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.397850    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/93264b23-0656-44f5-aa41-8626a42e1348-hosts-file\") pod \"node-resolver-5k289\" (UID: \"93264b23-0656-44f5-aa41-8626a42e1348\") " pod="openshift-dns/node-resolver-5k289"
Sep 11 03:53:23.397966 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.397902    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-host-run-k8s-cni-cncf-io\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.397966 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.397950    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwzwz\" (UniqueName: \"kubernetes.io/projected/87707938-5179-4e34-8d8a-892ecac835ee-kube-api-access-hwzwz\") pod \"network-metrics-daemon-xdw4t\" (UID: \"87707938-5179-4e34-8d8a-892ecac835ee\") " pod="openshift-multus/network-metrics-daemon-xdw4t"
Sep 11 03:53:23.398178 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.397986    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-multus-cni-dir\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.398178 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398006    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-cni-binary-copy\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.398178 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398029    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87707938-5179-4e34-8d8a-892ecac835ee-metrics-certs\") pod \"network-metrics-daemon-xdw4t\" (UID: \"87707938-5179-4e34-8d8a-892ecac835ee\") " pod="openshift-multus/network-metrics-daemon-xdw4t"
Sep 11 03:53:23.398178 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398052    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/091ab74f-c966-419b-9a8b-1cbee553790f-cnibin\") pod \"multus-additional-cni-plugins-bbxwp\" (UID: \"091ab74f-c966-419b-9a8b-1cbee553790f\") " pod="openshift-multus/multus-additional-cni-plugins-bbxwp"
Sep 11 03:53:23.398178 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398059    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/93264b23-0656-44f5-aa41-8626a42e1348-hosts-file\") pod \"node-resolver-5k289\" (UID: \"93264b23-0656-44f5-aa41-8626a42e1348\") " pod="openshift-dns/node-resolver-5k289"
Sep 11 03:53:23.398178 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398098    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-multus-cni-dir\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.398178 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:23.398150    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 03:53:23.398178 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398161    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-host-var-lib-cni-multus\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.398566 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398185    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-host-var-lib-kubelet\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.398566 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398205    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/091ab74f-c966-419b-9a8b-1cbee553790f-cnibin\") pod \"multus-additional-cni-plugins-bbxwp\" (UID: \"091ab74f-c966-419b-9a8b-1cbee553790f\") " pod="openshift-multus/multus-additional-cni-plugins-bbxwp"
Sep 11 03:53:23.398566 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398212    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-etc-kubernetes\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.398566 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:23.398242    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87707938-5179-4e34-8d8a-892ecac835ee-metrics-certs podName:87707938-5179-4e34-8d8a-892ecac835ee nodeName:}" failed. No retries permitted until 2026-09-11 03:53:23.898222243 +0000 UTC m=+2.178097056 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87707938-5179-4e34-8d8a-892ecac835ee-metrics-certs") pod "network-metrics-daemon-xdw4t" (UID: "87707938-5179-4e34-8d8a-892ecac835ee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 03:53:23.398566 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398247    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-host-var-lib-kubelet\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.398566 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398247    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-host-var-lib-cni-multus\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.398566 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398276    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-etc-kubernetes\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.398566 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398276    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2pxj\" (UniqueName: \"kubernetes.io/projected/091ab74f-c966-419b-9a8b-1cbee553790f-kube-api-access-z2pxj\") pod \"multus-additional-cni-plugins-bbxwp\" (UID: \"091ab74f-c966-419b-9a8b-1cbee553790f\") " pod="openshift-multus/multus-additional-cni-plugins-bbxwp"
Sep 11 03:53:23.398566 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398315    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-cnibin\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.398566 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398339    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-host-run-multus-certs\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.398566 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398365    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k8kk\" (UniqueName: \"kubernetes.io/projected/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-kube-api-access-7k8kk\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.398566 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398417    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/091ab74f-c966-419b-9a8b-1cbee553790f-cni-binary-copy\") pod \"multus-additional-cni-plugins-bbxwp\" (UID: \"091ab74f-c966-419b-9a8b-1cbee553790f\") " pod="openshift-multus/multus-additional-cni-plugins-bbxwp"
Sep 11 03:53:23.398566 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398450    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-cnibin\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.398566 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398540    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-cni-binary-copy\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.399287 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398587    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/091ab74f-c966-419b-9a8b-1cbee553790f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bbxwp\" (UID: \"091ab74f-c966-419b-9a8b-1cbee553790f\") " pod="openshift-multus/multus-additional-cni-plugins-bbxwp"
Sep 11 03:53:23.399287 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398634    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4cadd65-2d50-4f05-ba2e-36fcead51fef-host-slash\") pod \"iptables-alerter-hmm8m\" (UID: \"e4cadd65-2d50-4f05-ba2e-36fcead51fef\") " pod="openshift-network-operator/iptables-alerter-hmm8m"
Sep 11 03:53:23.399287 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398655    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-host-run-multus-certs\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.399287 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398678    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-multus-socket-dir-parent\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.399287 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398709    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4cadd65-2d50-4f05-ba2e-36fcead51fef-host-slash\") pod \"iptables-alerter-hmm8m\" (UID: \"e4cadd65-2d50-4f05-ba2e-36fcead51fef\") " pod="openshift-network-operator/iptables-alerter-hmm8m"
Sep 11 03:53:23.399287 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398717    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-host-var-lib-cni-bin\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.399287 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398740    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93264b23-0656-44f5-aa41-8626a42e1348-tmp-dir\") pod \"node-resolver-5k289\" (UID: \"93264b23-0656-44f5-aa41-8626a42e1348\") " pod="openshift-dns/node-resolver-5k289"
Sep 11 03:53:23.399287 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398759    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-multus-socket-dir-parent\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.399287 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398764    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-678vr\" (UniqueName: \"kubernetes.io/projected/93264b23-0656-44f5-aa41-8626a42e1348-kube-api-access-678vr\") pod \"node-resolver-5k289\" (UID: \"93264b23-0656-44f5-aa41-8626a42e1348\") " pod="openshift-dns/node-resolver-5k289"
Sep 11 03:53:23.399287 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398789    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/091ab74f-c966-419b-9a8b-1cbee553790f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bbxwp\" (UID: \"091ab74f-c966-419b-9a8b-1cbee553790f\") " pod="openshift-multus/multus-additional-cni-plugins-bbxwp"
Sep 11 03:53:23.399287 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398816    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-host-var-lib-cni-bin\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.399287 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398815    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-host-run-netns\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.399287 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398858    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-host-run-netns\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.399287 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398830    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/091ab74f-c966-419b-9a8b-1cbee553790f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bbxwp\" (UID: \"091ab74f-c966-419b-9a8b-1cbee553790f\") " pod="openshift-multus/multus-additional-cni-plugins-bbxwp"
Sep 11 03:53:23.399287 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398880    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-multus-conf-dir\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.399287 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398902    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-multus-conf-dir\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.399287 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398904    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-multus-daemon-config\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.399287 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398955    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlwwv\" (UniqueName: \"kubernetes.io/projected/6b502d3b-4680-40e1-9381-0a5822c16d82-kube-api-access-tlwwv\") pod \"network-check-target-5bl6k\" (UID: \"6b502d3b-4680-40e1-9381-0a5822c16d82\") " pod="openshift-network-diagnostics/network-check-target-5bl6k"
Sep 11 03:53:23.399967 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398992    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93264b23-0656-44f5-aa41-8626a42e1348-tmp-dir\") pod \"node-resolver-5k289\" (UID: \"93264b23-0656-44f5-aa41-8626a42e1348\") " pod="openshift-dns/node-resolver-5k289"
Sep 11 03:53:23.399967 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.398996    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e4cadd65-2d50-4f05-ba2e-36fcead51fef-iptables-alerter-script\") pod \"iptables-alerter-hmm8m\" (UID: \"e4cadd65-2d50-4f05-ba2e-36fcead51fef\") " pod="openshift-network-operator/iptables-alerter-hmm8m"
Sep 11 03:53:23.399967 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.399022    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gtb5\" (UniqueName: \"kubernetes.io/projected/e4cadd65-2d50-4f05-ba2e-36fcead51fef-kube-api-access-6gtb5\") pod \"iptables-alerter-hmm8m\" (UID: \"e4cadd65-2d50-4f05-ba2e-36fcead51fef\") " pod="openshift-network-operator/iptables-alerter-hmm8m"
Sep 11 03:53:23.399967 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.399085    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-hostroot\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.399967 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.399115    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/091ab74f-c966-419b-9a8b-1cbee553790f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bbxwp\" (UID: \"091ab74f-c966-419b-9a8b-1cbee553790f\") " pod="openshift-multus/multus-additional-cni-plugins-bbxwp"
Sep 11 03:53:23.399967 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.399166    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-system-cni-dir\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.399967 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.399202    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-hostroot\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.399967 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.399205    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/091ab74f-c966-419b-9a8b-1cbee553790f-system-cni-dir\") pod \"multus-additional-cni-plugins-bbxwp\" (UID: \"091ab74f-c966-419b-9a8b-1cbee553790f\") " pod="openshift-multus/multus-additional-cni-plugins-bbxwp"
Sep 11 03:53:23.399967 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.399238    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/091ab74f-c966-419b-9a8b-1cbee553790f-system-cni-dir\") pod \"multus-additional-cni-plugins-bbxwp\" (UID: \"091ab74f-c966-419b-9a8b-1cbee553790f\") " pod="openshift-multus/multus-additional-cni-plugins-bbxwp"
Sep 11 03:53:23.399967 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.399307    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-system-cni-dir\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.399967 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.399351    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-multus-daemon-config\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.399967 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.399370    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/091ab74f-c966-419b-9a8b-1cbee553790f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bbxwp\" (UID: \"091ab74f-c966-419b-9a8b-1cbee553790f\") " pod="openshift-multus/multus-additional-cni-plugins-bbxwp"
Sep 11 03:53:23.399967 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.399567    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e4cadd65-2d50-4f05-ba2e-36fcead51fef-iptables-alerter-script\") pod \"iptables-alerter-hmm8m\" (UID: \"e4cadd65-2d50-4f05-ba2e-36fcead51fef\") " pod="openshift-network-operator/iptables-alerter-hmm8m"
Sep 11 03:53:23.399967 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.399716    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/091ab74f-c966-419b-9a8b-1cbee553790f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bbxwp\" (UID: \"091ab74f-c966-419b-9a8b-1cbee553790f\") " pod="openshift-multus/multus-additional-cni-plugins-bbxwp"
Sep 11 03:53:23.404779 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:23.404723    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 03:53:23.404779 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:23.404748    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 03:53:23.404779 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:23.404763    2558 projected.go:196] Error preparing data for projected volume kube-api-access-tlwwv for pod openshift-network-diagnostics/network-check-target-5bl6k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 03:53:23.404984 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:23.404897    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b502d3b-4680-40e1-9381-0a5822c16d82-kube-api-access-tlwwv podName:6b502d3b-4680-40e1-9381-0a5822c16d82 nodeName:}" failed. No retries permitted until 2026-09-11 03:53:23.904879761 +0000 UTC m=+2.184754588 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tlwwv" (UniqueName: "kubernetes.io/projected/6b502d3b-4680-40e1-9381-0a5822c16d82-kube-api-access-tlwwv") pod "network-check-target-5bl6k" (UID: "6b502d3b-4680-40e1-9381-0a5822c16d82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 03:53:23.405962 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.405939    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-678vr\" (UniqueName: \"kubernetes.io/projected/93264b23-0656-44f5-aa41-8626a42e1348-kube-api-access-678vr\") pod \"node-resolver-5k289\" (UID: \"93264b23-0656-44f5-aa41-8626a42e1348\") " pod="openshift-dns/node-resolver-5k289"
Sep 11 03:53:23.406064 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.405964    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwzwz\" (UniqueName: \"kubernetes.io/projected/87707938-5179-4e34-8d8a-892ecac835ee-kube-api-access-hwzwz\") pod \"network-metrics-daemon-xdw4t\" (UID: \"87707938-5179-4e34-8d8a-892ecac835ee\") " pod="openshift-multus/network-metrics-daemon-xdw4t"
Sep 11 03:53:23.406192 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.406177    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k8kk\" (UniqueName: \"kubernetes.io/projected/dc58bc36-6aa2-449e-a45e-00c1da5d68e5-kube-api-access-7k8kk\") pod \"multus-rqbz6\" (UID: \"dc58bc36-6aa2-449e-a45e-00c1da5d68e5\") " pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.406643 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.406627    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2pxj\" (UniqueName: \"kubernetes.io/projected/091ab74f-c966-419b-9a8b-1cbee553790f-kube-api-access-z2pxj\") pod \"multus-additional-cni-plugins-bbxwp\" (UID: \"091ab74f-c966-419b-9a8b-1cbee553790f\") " pod="openshift-multus/multus-additional-cni-plugins-bbxwp"
Sep 11 03:53:23.406951 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.406937    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gtb5\" (UniqueName: \"kubernetes.io/projected/e4cadd65-2d50-4f05-ba2e-36fcead51fef-kube-api-access-6gtb5\") pod \"iptables-alerter-hmm8m\" (UID: \"e4cadd65-2d50-4f05-ba2e-36fcead51fef\") " pod="openshift-network-operator/iptables-alerter-hmm8m"
Sep 11 03:53:23.513657 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.513619    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:23.521836 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:23.521811    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9add74a_5c51_4ccf_9edd_3b90a66b9ef9.slice/crio-b635b2c202bef4cf90f01aede4bc4ba1976a8036700edf603404a8fe63af15f4 WatchSource:0}: Error finding container b635b2c202bef4cf90f01aede4bc4ba1976a8036700edf603404a8fe63af15f4: Status 404 returned error can't find the container with id b635b2c202bef4cf90f01aede4bc4ba1976a8036700edf603404a8fe63af15f4
Sep 11 03:53:23.532752 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.532730    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zt598"
Sep 11 03:53:23.540660 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:23.540629    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0247f5db_3e1c_4545_baff_7388ebef867d.slice/crio-bc10f22cfd69cf55901d3c14a7a7e0e58214dde08aafbe9dd01d7e7095849afe WatchSource:0}: Error finding container bc10f22cfd69cf55901d3c14a7a7e0e58214dde08aafbe9dd01d7e7095849afe: Status 404 returned error can't find the container with id bc10f22cfd69cf55901d3c14a7a7e0e58214dde08aafbe9dd01d7e7095849afe
Sep 11 03:53:23.560411 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.560378    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zld26"
Sep 11 03:53:23.568121 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:23.568094    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a897d30_52c7_43b5_a1f4_ea86ddc16732.slice/crio-38ddcbfbc0bc651a12c19364e8eabfa096a05825b6883a6acdc1dcd1e47075e6 WatchSource:0}: Error finding container 38ddcbfbc0bc651a12c19364e8eabfa096a05825b6883a6acdc1dcd1e47075e6: Status 404 returned error can't find the container with id 38ddcbfbc0bc651a12c19364e8eabfa096a05825b6883a6acdc1dcd1e47075e6
Sep 11 03:53:23.574534 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.574508    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dmmhz"
Sep 11 03:53:23.583015 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:23.582992    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5148708b_dd5c_49b6_a1fc_c5c12e2ea6d1.slice/crio-a8e16408da25069caddf64bfc9b5e7948485e8e31aa1c31eb8ee8ea1406620c5 WatchSource:0}: Error finding container a8e16408da25069caddf64bfc9b5e7948485e8e31aa1c31eb8ee8ea1406620c5: Status 404 returned error can't find the container with id a8e16408da25069caddf64bfc9b5e7948485e8e31aa1c31eb8ee8ea1406620c5
Sep 11 03:53:23.594811 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.594787    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6rfcj"
Sep 11 03:53:23.603460 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:23.603436    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a500433_7480_46a7_9c45_9a58866265c3.slice/crio-676023594ba47f125c793ba0fab9a4c62d89525e3f7e9a13151b36b681d6c3a9 WatchSource:0}: Error finding container 676023594ba47f125c793ba0fab9a4c62d89525e3f7e9a13151b36b681d6c3a9: Status 404 returned error can't find the container with id 676023594ba47f125c793ba0fab9a4c62d89525e3f7e9a13151b36b681d6c3a9
Sep 11 03:53:23.616857 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.616829    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rqbz6"
Sep 11 03:53:23.624678 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:23.624494    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc58bc36_6aa2_449e_a45e_00c1da5d68e5.slice/crio-ba391c0ad5b8c9194d64648a83161b28ccc7ed9d95cdbfad43ab09ad68a99f99 WatchSource:0}: Error finding container ba391c0ad5b8c9194d64648a83161b28ccc7ed9d95cdbfad43ab09ad68a99f99: Status 404 returned error can't find the container with id ba391c0ad5b8c9194d64648a83161b28ccc7ed9d95cdbfad43ab09ad68a99f99
Sep 11 03:53:23.629755 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.629734    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5k289"
Sep 11 03:53:23.637223 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:23.637198    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93264b23_0656_44f5_aa41_8626a42e1348.slice/crio-5b98ed0a4904ea38b21bb2d9af8b5c6c065ba7c4d26edcef08b99d99b390fda3 WatchSource:0}: Error finding container 5b98ed0a4904ea38b21bb2d9af8b5c6c065ba7c4d26edcef08b99d99b390fda3: Status 404 returned error can't find the container with id 5b98ed0a4904ea38b21bb2d9af8b5c6c065ba7c4d26edcef08b99d99b390fda3
Sep 11 03:53:23.644561 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.644537    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bbxwp"
Sep 11 03:53:23.650866 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.650727    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hmm8m"
Sep 11 03:53:23.653143 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:23.653120    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod091ab74f_c966_419b_9a8b_1cbee553790f.slice/crio-a205ed8957144a2e7b74331d09a009eeab678bd97798d4dcfde7bf1521bf8fc1 WatchSource:0}: Error finding container a205ed8957144a2e7b74331d09a009eeab678bd97798d4dcfde7bf1521bf8fc1: Status 404 returned error can't find the container with id a205ed8957144a2e7b74331d09a009eeab678bd97798d4dcfde7bf1521bf8fc1
Sep 11 03:53:23.658039 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:23.658014    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4cadd65_2d50_4f05_ba2e_36fcead51fef.slice/crio-f6f30f47edb2ac8b8b2fd8f858a26472f8238d3493e57caa94aaa9c6a2eb68b0 WatchSource:0}: Error finding container f6f30f47edb2ac8b8b2fd8f858a26472f8238d3493e57caa94aaa9c6a2eb68b0: Status 404 returned error can't find the container with id f6f30f47edb2ac8b8b2fd8f858a26472f8238d3493e57caa94aaa9c6a2eb68b0
Sep 11 03:53:23.802522 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.802478    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e72b85ea-da06-4626-9ac7-1aa09afbc972-original-pull-secret\") pod \"global-pull-secret-syncer-gb2cl\" (UID: \"e72b85ea-da06-4626-9ac7-1aa09afbc972\") " pod="kube-system/global-pull-secret-syncer-gb2cl"
Sep 11 03:53:23.802767 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:23.802637    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 03:53:23.802767 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:23.802725    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e72b85ea-da06-4626-9ac7-1aa09afbc972-original-pull-secret podName:e72b85ea-da06-4626-9ac7-1aa09afbc972 nodeName:}" failed. No retries permitted until 2026-09-11 03:53:24.802704767 +0000 UTC m=+3.082579595 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e72b85ea-da06-4626-9ac7-1aa09afbc972-original-pull-secret") pod "global-pull-secret-syncer-gb2cl" (UID: "e72b85ea-da06-4626-9ac7-1aa09afbc972") : object "kube-system"/"original-pull-secret" not registered
Sep 11 03:53:23.903236 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.903191    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87707938-5179-4e34-8d8a-892ecac835ee-metrics-certs\") pod \"network-metrics-daemon-xdw4t\" (UID: \"87707938-5179-4e34-8d8a-892ecac835ee\") " pod="openshift-multus/network-metrics-daemon-xdw4t"
Sep 11 03:53:23.903410 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:23.903388    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 03:53:23.903469 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:23.903456    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87707938-5179-4e34-8d8a-892ecac835ee-metrics-certs podName:87707938-5179-4e34-8d8a-892ecac835ee nodeName:}" failed. No retries permitted until 2026-09-11 03:53:24.903435978 +0000 UTC m=+3.183310836 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87707938-5179-4e34-8d8a-892ecac835ee-metrics-certs") pod "network-metrics-daemon-xdw4t" (UID: "87707938-5179-4e34-8d8a-892ecac835ee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 03:53:23.938268 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:23.938183    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 03:53:24.004007 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:24.003970    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlwwv\" (UniqueName: \"kubernetes.io/projected/6b502d3b-4680-40e1-9381-0a5822c16d82-kube-api-access-tlwwv\") pod \"network-check-target-5bl6k\" (UID: \"6b502d3b-4680-40e1-9381-0a5822c16d82\") " pod="openshift-network-diagnostics/network-check-target-5bl6k"
Sep 11 03:53:24.004203 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:24.004182    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 03:53:24.004263 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:24.004210    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 03:53:24.004263 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:24.004223    2558 projected.go:196] Error preparing data for projected volume kube-api-access-tlwwv for pod openshift-network-diagnostics/network-check-target-5bl6k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 03:53:24.004372 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:24.004288    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b502d3b-4680-40e1-9381-0a5822c16d82-kube-api-access-tlwwv podName:6b502d3b-4680-40e1-9381-0a5822c16d82 nodeName:}" failed. No retries permitted until 2026-09-11 03:53:25.004268761 +0000 UTC m=+3.284143596 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tlwwv" (UniqueName: "kubernetes.io/projected/6b502d3b-4680-40e1-9381-0a5822c16d82-kube-api-access-tlwwv") pod "network-check-target-5bl6k" (UID: "6b502d3b-4680-40e1-9381-0a5822c16d82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 03:53:24.073027 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:24.071960    2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 03:53:24.229952 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:24.229748    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 03:48:24 +0000 UTC" deadline="2028-06-06 21:39:37.594181616 +0000 UTC"
Sep 11 03:53:24.229952 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:24.229839    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15233h46m13.364347433s"
Sep 11 03:53:24.322820 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:24.322767    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bl6k"
Sep 11 03:53:24.326685 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:24.322987    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bl6k" podUID="6b502d3b-4680-40e1-9381-0a5822c16d82"
Sep 11 03:53:24.326685 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:24.323362    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb2cl"
Sep 11 03:53:24.326685 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:24.323460    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gb2cl" podUID="e72b85ea-da06-4626-9ac7-1aa09afbc972"
Sep 11 03:53:24.347925 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:24.347860    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-195.ec2.internal" event={"ID":"52aa30798a90a24b8f87726fd735fa68","Type":"ContainerStarted","Data":"02a367da28185ea183bcd4d26cf0c938386f1a819bb4d2d21e681fb344d7f847"}
Sep 11 03:53:24.363639 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:24.362616    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5k289" event={"ID":"93264b23-0656-44f5-aa41-8626a42e1348","Type":"ContainerStarted","Data":"5b98ed0a4904ea38b21bb2d9af8b5c6c065ba7c4d26edcef08b99d99b390fda3"}
Sep 11 03:53:24.376216 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:24.376173    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rqbz6" event={"ID":"dc58bc36-6aa2-449e-a45e-00c1da5d68e5","Type":"ContainerStarted","Data":"ba391c0ad5b8c9194d64648a83161b28ccc7ed9d95cdbfad43ab09ad68a99f99"}
Sep 11 03:53:24.399020 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:24.398979    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dmmhz" event={"ID":"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1","Type":"ContainerStarted","Data":"a8e16408da25069caddf64bfc9b5e7948485e8e31aa1c31eb8ee8ea1406620c5"}
Sep 11 03:53:24.421694 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:24.421648    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zt598" event={"ID":"0247f5db-3e1c-4545-baff-7388ebef867d","Type":"ContainerStarted","Data":"bc10f22cfd69cf55901d3c14a7a7e0e58214dde08aafbe9dd01d7e7095849afe"}
Sep 11 03:53:24.429394 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:24.429210    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nfssn" event={"ID":"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9","Type":"ContainerStarted","Data":"b635b2c202bef4cf90f01aede4bc4ba1976a8036700edf603404a8fe63af15f4"}
Sep 11 03:53:24.436960 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:24.436917    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-195.ec2.internal" event={"ID":"5e4ec590b0b700dcbd5a280ea65eb0b6","Type":"ContainerStarted","Data":"2a6143eb76285c8972e34ed5421f7b4642d13b52ca5adcfd26d066229cdcef12"}
Sep 11 03:53:24.447784 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:24.447740    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hmm8m" event={"ID":"e4cadd65-2d50-4f05-ba2e-36fcead51fef","Type":"ContainerStarted","Data":"f6f30f47edb2ac8b8b2fd8f858a26472f8238d3493e57caa94aaa9c6a2eb68b0"}
Sep 11 03:53:24.450565 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:24.450533    2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 03:53:24.451222 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:24.451151    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bbxwp" event={"ID":"091ab74f-c966-419b-9a8b-1cbee553790f","Type":"ContainerStarted","Data":"a205ed8957144a2e7b74331d09a009eeab678bd97798d4dcfde7bf1521bf8fc1"}
Sep 11 03:53:24.460142 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:24.460081    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6rfcj" event={"ID":"3a500433-7480-46a7-9c45-9a58866265c3","Type":"ContainerStarted","Data":"676023594ba47f125c793ba0fab9a4c62d89525e3f7e9a13151b36b681d6c3a9"}
Sep 11 03:53:24.465265 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:24.465225    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zld26" event={"ID":"5a897d30-52c7-43b5-a1f4-ea86ddc16732","Type":"ContainerStarted","Data":"38ddcbfbc0bc651a12c19364e8eabfa096a05825b6883a6acdc1dcd1e47075e6"}
Sep 11 03:53:26.294767 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:26.294673    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e72b85ea-da06-4626-9ac7-1aa09afbc972-original-pull-secret\") pod \"global-pull-secret-syncer-gb2cl\" (UID: \"e72b85ea-da06-4626-9ac7-1aa09afbc972\") " pod="kube-system/global-pull-secret-syncer-gb2cl"
Sep 11 03:53:26.294941 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:26.294857    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 03:53:26.294941 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:26.294928    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e72b85ea-da06-4626-9ac7-1aa09afbc972-original-pull-secret podName:e72b85ea-da06-4626-9ac7-1aa09afbc972 nodeName:}" failed. No retries permitted until 2026-09-11 03:53:28.294906794 +0000 UTC m=+5.092996523 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e72b85ea-da06-4626-9ac7-1aa09afbc972-original-pull-secret") pod "global-pull-secret-syncer-gb2cl" (UID: "e72b85ea-da06-4626-9ac7-1aa09afbc972") : object "kube-system"/"original-pull-secret" not registered
Sep 11 03:53:26.395176 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:26.395133    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87707938-5179-4e34-8d8a-892ecac835ee-metrics-certs\") pod \"network-metrics-daemon-xdw4t\" (UID: \"87707938-5179-4e34-8d8a-892ecac835ee\") " pod="openshift-multus/network-metrics-daemon-xdw4t"
Sep 11 03:53:26.395363 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:26.395304    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 03:53:26.395466 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:26.395369    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87707938-5179-4e34-8d8a-892ecac835ee-metrics-certs podName:87707938-5179-4e34-8d8a-892ecac835ee nodeName:}" failed. No retries permitted until 2026-09-11 03:53:28.395351261 +0000 UTC m=+5.193440976 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87707938-5179-4e34-8d8a-892ecac835ee-metrics-certs") pod "network-metrics-daemon-xdw4t" (UID: "87707938-5179-4e34-8d8a-892ecac835ee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 03:53:26.496211 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:26.496170    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlwwv\" (UniqueName: \"kubernetes.io/projected/6b502d3b-4680-40e1-9381-0a5822c16d82-kube-api-access-tlwwv\") pod \"network-check-target-5bl6k\" (UID: \"6b502d3b-4680-40e1-9381-0a5822c16d82\") " pod="openshift-network-diagnostics/network-check-target-5bl6k"
Sep 11 03:53:26.496423 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:26.496372    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 03:53:26.496423 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:26.496410    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 03:53:26.496423 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:26.496423    2558 projected.go:196] Error preparing data for projected volume kube-api-access-tlwwv for pod openshift-network-diagnostics/network-check-target-5bl6k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 03:53:26.496598 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:26.496487    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b502d3b-4680-40e1-9381-0a5822c16d82-kube-api-access-tlwwv podName:6b502d3b-4680-40e1-9381-0a5822c16d82 nodeName:}" failed. No retries permitted until 2026-09-11 03:53:28.496467407 +0000 UTC m=+5.294557114 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tlwwv" (UniqueName: "kubernetes.io/projected/6b502d3b-4680-40e1-9381-0a5822c16d82-kube-api-access-tlwwv") pod "network-check-target-5bl6k" (UID: "6b502d3b-4680-40e1-9381-0a5822c16d82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 03:53:26.712300 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:26.712168    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 03:48:24 +0000 UTC" deadline="2028-02-27 06:45:04.543809291 +0000 UTC"
Sep 11 03:53:26.712300 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:26.712211    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12818h51m37.831602562s"
Sep 11 03:53:26.804451 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:26.803906    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xdw4t"
Sep 11 03:53:26.804451 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:26.804058    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xdw4t" podUID="87707938-5179-4e34-8d8a-892ecac835ee"
Sep 11 03:53:27.820715 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:27.820618    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bl6k"
Sep 11 03:53:27.821167 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:27.820751    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bl6k" podUID="6b502d3b-4680-40e1-9381-0a5822c16d82"
Sep 11 03:53:27.821167 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:27.821157    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb2cl"
Sep 11 03:53:27.821289 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:27.821256    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gb2cl" podUID="e72b85ea-da06-4626-9ac7-1aa09afbc972"
Sep 11 03:53:28.311496 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:28.311440    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e72b85ea-da06-4626-9ac7-1aa09afbc972-original-pull-secret\") pod \"global-pull-secret-syncer-gb2cl\" (UID: \"e72b85ea-da06-4626-9ac7-1aa09afbc972\") " pod="kube-system/global-pull-secret-syncer-gb2cl"
Sep 11 03:53:28.311705 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:28.311620    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 03:53:28.311705 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:28.311686    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e72b85ea-da06-4626-9ac7-1aa09afbc972-original-pull-secret podName:e72b85ea-da06-4626-9ac7-1aa09afbc972 nodeName:}" failed. No retries permitted until 2026-09-11 03:53:32.311669068 +0000 UTC m=+9.109758785 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e72b85ea-da06-4626-9ac7-1aa09afbc972-original-pull-secret") pod "global-pull-secret-syncer-gb2cl" (UID: "e72b85ea-da06-4626-9ac7-1aa09afbc972") : object "kube-system"/"original-pull-secret" not registered
Sep 11 03:53:28.412687 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:28.412033    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87707938-5179-4e34-8d8a-892ecac835ee-metrics-certs\") pod \"network-metrics-daemon-xdw4t\" (UID: \"87707938-5179-4e34-8d8a-892ecac835ee\") " pod="openshift-multus/network-metrics-daemon-xdw4t"
Sep 11 03:53:28.412687 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:28.412251    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 03:53:28.412687 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:28.412322    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87707938-5179-4e34-8d8a-892ecac835ee-metrics-certs podName:87707938-5179-4e34-8d8a-892ecac835ee nodeName:}" failed. No retries permitted until 2026-09-11 03:53:32.412302205 +0000 UTC m=+9.210391916 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87707938-5179-4e34-8d8a-892ecac835ee-metrics-certs") pod "network-metrics-daemon-xdw4t" (UID: "87707938-5179-4e34-8d8a-892ecac835ee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 03:53:28.512877 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:28.512835    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlwwv\" (UniqueName: \"kubernetes.io/projected/6b502d3b-4680-40e1-9381-0a5822c16d82-kube-api-access-tlwwv\") pod \"network-check-target-5bl6k\" (UID: \"6b502d3b-4680-40e1-9381-0a5822c16d82\") " pod="openshift-network-diagnostics/network-check-target-5bl6k"
Sep 11 03:53:28.513066 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:28.513021    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 03:53:28.513066 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:28.513040    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 03:53:28.513066 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:28.513054    2558 projected.go:196] Error preparing data for projected volume kube-api-access-tlwwv for pod openshift-network-diagnostics/network-check-target-5bl6k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 03:53:28.513221 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:28.513117    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b502d3b-4680-40e1-9381-0a5822c16d82-kube-api-access-tlwwv podName:6b502d3b-4680-40e1-9381-0a5822c16d82 nodeName:}" failed. No retries permitted until 2026-09-11 03:53:32.513099211 +0000 UTC m=+9.311188930 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tlwwv" (UniqueName: "kubernetes.io/projected/6b502d3b-4680-40e1-9381-0a5822c16d82-kube-api-access-tlwwv") pod "network-check-target-5bl6k" (UID: "6b502d3b-4680-40e1-9381-0a5822c16d82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 03:53:28.804116 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:28.804078    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xdw4t"
Sep 11 03:53:28.804265 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:28.804240    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xdw4t" podUID="87707938-5179-4e34-8d8a-892ecac835ee"
Sep 11 03:53:29.804610 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:29.804573    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb2cl"
Sep 11 03:53:29.805084 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:29.804713    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gb2cl" podUID="e72b85ea-da06-4626-9ac7-1aa09afbc972"
Sep 11 03:53:29.805084 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:29.804589    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bl6k"
Sep 11 03:53:29.805084 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:29.804886    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bl6k" podUID="6b502d3b-4680-40e1-9381-0a5822c16d82"
Sep 11 03:53:30.804076 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:30.804039    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xdw4t"
Sep 11 03:53:30.804246 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:30.804189    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xdw4t" podUID="87707938-5179-4e34-8d8a-892ecac835ee"
Sep 11 03:53:31.803628 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:31.803586    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb2cl"
Sep 11 03:53:31.804094 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:31.803639    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bl6k"
Sep 11 03:53:31.804094 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:31.803761    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gb2cl" podUID="e72b85ea-da06-4626-9ac7-1aa09afbc972"
Sep 11 03:53:31.804094 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:31.803956    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bl6k" podUID="6b502d3b-4680-40e1-9381-0a5822c16d82"
Sep 11 03:53:32.344056 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:32.344011    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e72b85ea-da06-4626-9ac7-1aa09afbc972-original-pull-secret\") pod \"global-pull-secret-syncer-gb2cl\" (UID: \"e72b85ea-da06-4626-9ac7-1aa09afbc972\") " pod="kube-system/global-pull-secret-syncer-gb2cl"
Sep 11 03:53:32.344236 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:32.344157    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 03:53:32.344236 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:32.344232    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e72b85ea-da06-4626-9ac7-1aa09afbc972-original-pull-secret podName:e72b85ea-da06-4626-9ac7-1aa09afbc972 nodeName:}" failed. No retries permitted until 2026-09-11 03:53:40.344212698 +0000 UTC m=+17.142302420 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e72b85ea-da06-4626-9ac7-1aa09afbc972-original-pull-secret") pod "global-pull-secret-syncer-gb2cl" (UID: "e72b85ea-da06-4626-9ac7-1aa09afbc972") : object "kube-system"/"original-pull-secret" not registered
Sep 11 03:53:32.444933 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:32.444890    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87707938-5179-4e34-8d8a-892ecac835ee-metrics-certs\") pod \"network-metrics-daemon-xdw4t\" (UID: \"87707938-5179-4e34-8d8a-892ecac835ee\") " pod="openshift-multus/network-metrics-daemon-xdw4t"
Sep 11 03:53:32.445159 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:32.445109    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 03:53:32.445228 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:32.445179    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87707938-5179-4e34-8d8a-892ecac835ee-metrics-certs podName:87707938-5179-4e34-8d8a-892ecac835ee nodeName:}" failed. No retries permitted until 2026-09-11 03:53:40.44516059 +0000 UTC m=+17.243250309 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87707938-5179-4e34-8d8a-892ecac835ee-metrics-certs") pod "network-metrics-daemon-xdw4t" (UID: "87707938-5179-4e34-8d8a-892ecac835ee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 03:53:32.545994 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:32.545952    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlwwv\" (UniqueName: \"kubernetes.io/projected/6b502d3b-4680-40e1-9381-0a5822c16d82-kube-api-access-tlwwv\") pod \"network-check-target-5bl6k\" (UID: \"6b502d3b-4680-40e1-9381-0a5822c16d82\") " pod="openshift-network-diagnostics/network-check-target-5bl6k"
Sep 11 03:53:32.546182 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:32.546117    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 03:53:32.546182 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:32.546138    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 03:53:32.546182 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:32.546151    2558 projected.go:196] Error preparing data for projected volume kube-api-access-tlwwv for pod openshift-network-diagnostics/network-check-target-5bl6k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 03:53:32.546345 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:32.546221    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b502d3b-4680-40e1-9381-0a5822c16d82-kube-api-access-tlwwv podName:6b502d3b-4680-40e1-9381-0a5822c16d82 nodeName:}" failed. No retries permitted until 2026-09-11 03:53:40.546201615 +0000 UTC m=+17.344291322 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tlwwv" (UniqueName: "kubernetes.io/projected/6b502d3b-4680-40e1-9381-0a5822c16d82-kube-api-access-tlwwv") pod "network-check-target-5bl6k" (UID: "6b502d3b-4680-40e1-9381-0a5822c16d82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 03:53:32.804515 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:32.803794    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xdw4t"
Sep 11 03:53:32.804515 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:32.803991    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xdw4t" podUID="87707938-5179-4e34-8d8a-892ecac835ee"
Sep 11 03:53:33.804599 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:33.804451    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb2cl"
Sep 11 03:53:33.804599 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:33.804574    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gb2cl" podUID="e72b85ea-da06-4626-9ac7-1aa09afbc972"
Sep 11 03:53:33.805126 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:33.804631    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bl6k"
Sep 11 03:53:33.805126 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:33.804758    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bl6k" podUID="6b502d3b-4680-40e1-9381-0a5822c16d82"
Sep 11 03:53:34.804231 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:34.804194    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xdw4t"
Sep 11 03:53:34.804439 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:34.804337    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xdw4t" podUID="87707938-5179-4e34-8d8a-892ecac835ee"
Sep 11 03:53:35.806928 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:35.806902    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bl6k"
Sep 11 03:53:35.807339 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:35.807006    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bl6k" podUID="6b502d3b-4680-40e1-9381-0a5822c16d82"
Sep 11 03:53:35.807339 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:35.807071    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb2cl"
Sep 11 03:53:35.807339 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:35.807154    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gb2cl" podUID="e72b85ea-da06-4626-9ac7-1aa09afbc972"
Sep 11 03:53:36.803697 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:36.803653    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xdw4t"
Sep 11 03:53:36.803898 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:36.803838    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xdw4t" podUID="87707938-5179-4e34-8d8a-892ecac835ee"
Sep 11 03:53:37.804649 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:37.804609    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb2cl"
Sep 11 03:53:37.805198 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:37.804740    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gb2cl" podUID="e72b85ea-da06-4626-9ac7-1aa09afbc972"
Sep 11 03:53:37.805198 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:37.804799    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bl6k"
Sep 11 03:53:37.805198 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:37.804929    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bl6k" podUID="6b502d3b-4680-40e1-9381-0a5822c16d82"
Sep 11 03:53:38.804126 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:38.804087    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xdw4t"
Sep 11 03:53:38.804325 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:38.804234    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xdw4t" podUID="87707938-5179-4e34-8d8a-892ecac835ee"
Sep 11 03:53:39.806509 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:39.806481    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bl6k"
Sep 11 03:53:39.806918 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:39.806489    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb2cl"
Sep 11 03:53:39.806918 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:39.806582    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bl6k" podUID="6b502d3b-4680-40e1-9381-0a5822c16d82"
Sep 11 03:53:39.806918 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:39.806679    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gb2cl" podUID="e72b85ea-da06-4626-9ac7-1aa09afbc972"
Sep 11 03:53:40.407659 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:40.407625    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e72b85ea-da06-4626-9ac7-1aa09afbc972-original-pull-secret\") pod \"global-pull-secret-syncer-gb2cl\" (UID: \"e72b85ea-da06-4626-9ac7-1aa09afbc972\") " pod="kube-system/global-pull-secret-syncer-gb2cl"
Sep 11 03:53:40.407916 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:40.407799    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 03:53:40.407916 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:40.407877    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e72b85ea-da06-4626-9ac7-1aa09afbc972-original-pull-secret podName:e72b85ea-da06-4626-9ac7-1aa09afbc972 nodeName:}" failed. No retries permitted until 2026-09-11 03:53:56.407844005 +0000 UTC m=+33.205933724 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e72b85ea-da06-4626-9ac7-1aa09afbc972-original-pull-secret") pod "global-pull-secret-syncer-gb2cl" (UID: "e72b85ea-da06-4626-9ac7-1aa09afbc972") : object "kube-system"/"original-pull-secret" not registered
Sep 11 03:53:40.507995 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:40.507954    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87707938-5179-4e34-8d8a-892ecac835ee-metrics-certs\") pod \"network-metrics-daemon-xdw4t\" (UID: \"87707938-5179-4e34-8d8a-892ecac835ee\") " pod="openshift-multus/network-metrics-daemon-xdw4t"
Sep 11 03:53:40.508162 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:40.508100    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 03:53:40.508218 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:40.508176    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87707938-5179-4e34-8d8a-892ecac835ee-metrics-certs podName:87707938-5179-4e34-8d8a-892ecac835ee nodeName:}" failed. No retries permitted until 2026-09-11 03:53:56.50815722 +0000 UTC m=+33.306246946 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87707938-5179-4e34-8d8a-892ecac835ee-metrics-certs") pod "network-metrics-daemon-xdw4t" (UID: "87707938-5179-4e34-8d8a-892ecac835ee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 03:53:40.608885 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:40.608843    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlwwv\" (UniqueName: \"kubernetes.io/projected/6b502d3b-4680-40e1-9381-0a5822c16d82-kube-api-access-tlwwv\") pod \"network-check-target-5bl6k\" (UID: \"6b502d3b-4680-40e1-9381-0a5822c16d82\") " pod="openshift-network-diagnostics/network-check-target-5bl6k"
Sep 11 03:53:40.609074 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:40.609000    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 03:53:40.609074 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:40.609027    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 03:53:40.609074 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:40.609042    2558 projected.go:196] Error preparing data for projected volume kube-api-access-tlwwv for pod openshift-network-diagnostics/network-check-target-5bl6k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 03:53:40.609238 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:40.609118    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b502d3b-4680-40e1-9381-0a5822c16d82-kube-api-access-tlwwv podName:6b502d3b-4680-40e1-9381-0a5822c16d82 nodeName:}" failed. No retries permitted until 2026-09-11 03:53:56.609087857 +0000 UTC m=+33.407177582 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tlwwv" (UniqueName: "kubernetes.io/projected/6b502d3b-4680-40e1-9381-0a5822c16d82-kube-api-access-tlwwv") pod "network-check-target-5bl6k" (UID: "6b502d3b-4680-40e1-9381-0a5822c16d82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 03:53:40.803966 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:40.803874    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xdw4t"
Sep 11 03:53:40.804117 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:40.804045    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xdw4t" podUID="87707938-5179-4e34-8d8a-892ecac835ee"
Sep 11 03:53:41.804127 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:41.804088    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb2cl"
Sep 11 03:53:41.804637 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:41.804228    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gb2cl" podUID="e72b85ea-da06-4626-9ac7-1aa09afbc972"
Sep 11 03:53:41.804637 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:41.804294    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bl6k"
Sep 11 03:53:41.804637 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:41.804435    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bl6k" podUID="6b502d3b-4680-40e1-9381-0a5822c16d82"
Sep 11 03:53:42.804140 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:42.804062    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xdw4t"
Sep 11 03:53:42.804640 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:42.804214    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xdw4t" podUID="87707938-5179-4e34-8d8a-892ecac835ee"
Sep 11 03:53:43.805140 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:43.805103    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bl6k"
Sep 11 03:53:43.805589 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:43.805184    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb2cl"
Sep 11 03:53:43.805589 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:43.805200    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bl6k" podUID="6b502d3b-4680-40e1-9381-0a5822c16d82"
Sep 11 03:53:43.805589 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:43.805315    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gb2cl" podUID="e72b85ea-da06-4626-9ac7-1aa09afbc972"
Sep 11 03:53:44.804079 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:44.803753    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xdw4t"
Sep 11 03:53:44.804237 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:44.804170    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xdw4t" podUID="87707938-5179-4e34-8d8a-892ecac835ee"
Sep 11 03:53:45.002307 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:45.002215    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zt598" event={"ID":"0247f5db-3e1c-4545-baff-7388ebef867d","Type":"ContainerStarted","Data":"12f0ca47c1a403ef83e7252766543779b22a599d207ba66de2d14a3dcaedb582"}
Sep 11 03:53:45.005000 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:45.004979    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nfssn_c9add74a-5c51-4ccf-9edd-3b90a66b9ef9/ovn-acl-logging/0.log"
Sep 11 03:53:45.005322 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:45.005300    2558 generic.go:356] "Generic (PLEG): container finished" podID="c9add74a-5c51-4ccf-9edd-3b90a66b9ef9" containerID="e062426a70b881291518d78fec4c3650af6d9fb488781a2be1ef94b32855eb7f" exitCode=1
Sep 11 03:53:45.005381 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:45.005359    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nfssn" event={"ID":"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9","Type":"ContainerStarted","Data":"cc7fba52a0e1026355569a1c2bedcdf8e92a4066176b6a6e44a2b87ea1577066"}
Sep 11 03:53:45.005470 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:45.005455    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nfssn" event={"ID":"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9","Type":"ContainerStarted","Data":"a772b8233c666398174d2aa1adfeee7ae36e6aca2eb15eebd9d97efa32d22852"}
Sep 11 03:53:45.005556 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:45.005543    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nfssn" event={"ID":"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9","Type":"ContainerStarted","Data":"238ad7d0b79fbdc5efbb9006f9a4d7ff9601092fdc30bf40feea55c8fac1e356"}
Sep 11 03:53:45.005608 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:45.005595    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nfssn" event={"ID":"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9","Type":"ContainerStarted","Data":"0f87939125b43378f1b553d3db573fc1ff0bef6827720ab298eae98b3dfb2f4e"}
Sep 11 03:53:45.005660 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:45.005648    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nfssn" event={"ID":"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9","Type":"ContainerDied","Data":"e062426a70b881291518d78fec4c3650af6d9fb488781a2be1ef94b32855eb7f"}
Sep 11 03:53:45.005708 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:45.005698    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nfssn" event={"ID":"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9","Type":"ContainerStarted","Data":"1a5ea259aea64e1f29cf90d1526475f3ba8816ab9485f92b1adf856dfe0c52a6"}
Sep 11 03:53:45.006880 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:45.006861    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-195.ec2.internal" event={"ID":"5e4ec590b0b700dcbd5a280ea65eb0b6","Type":"ContainerStarted","Data":"ad1e301af1e0f6d86967b45bed5be7316da80060a6053ffff86d33eb5d913b00"}
Sep 11 03:53:45.008340 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:45.008318    2558 generic.go:356] "Generic (PLEG): container finished" podID="091ab74f-c966-419b-9a8b-1cbee553790f" containerID="06209ba61c724a698fe14b09e41a681d5ed7aeacd28892373919f2417dbfab06" exitCode=0
Sep 11 03:53:45.008456 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:45.008347    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bbxwp" event={"ID":"091ab74f-c966-419b-9a8b-1cbee553790f","Type":"ContainerDied","Data":"06209ba61c724a698fe14b09e41a681d5ed7aeacd28892373919f2417dbfab06"}
Sep 11 03:53:45.009899 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:45.009880    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6rfcj" event={"ID":"3a500433-7480-46a7-9c45-9a58866265c3","Type":"ContainerStarted","Data":"aeb3027a9562386013f6d3dd6300d9d19cf8e880052a3ea0fcc67e3d22dd68a4"}
Sep 11 03:53:45.011496 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:45.011469    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zld26" event={"ID":"5a897d30-52c7-43b5-a1f4-ea86ddc16732","Type":"ContainerStarted","Data":"fe4ede65a4a9a8f5d6b3ab6b89fb40f48af557e308c834fe4a406834b550a612"}
Sep 11 03:53:45.013000 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:45.012982    2558 generic.go:356] "Generic (PLEG): container finished" podID="52aa30798a90a24b8f87726fd735fa68" containerID="3ff0d5e72dbb727d056a4f59eb8e40198560b3d505d1e6352e902699459eb8e3" exitCode=0
Sep 11 03:53:45.013086 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:45.013037    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-195.ec2.internal" event={"ID":"52aa30798a90a24b8f87726fd735fa68","Type":"ContainerDied","Data":"3ff0d5e72dbb727d056a4f59eb8e40198560b3d505d1e6352e902699459eb8e3"}
Sep 11 03:53:45.014732 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:45.014705    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5k289" event={"ID":"93264b23-0656-44f5-aa41-8626a42e1348","Type":"ContainerStarted","Data":"f9cc69b6240219697def6bbf63aef3d5e68cd62d9ebca74c15494dcc604e612d"}
Sep 11 03:53:45.016230 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:45.016210    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rqbz6" event={"ID":"dc58bc36-6aa2-449e-a45e-00c1da5d68e5","Type":"ContainerStarted","Data":"04ace56a11a79e356841630a36ed82ce3d5a95e693dd38a9a99c8e00fdee72d7"}
Sep 11 03:53:45.017664 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:45.017644    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dmmhz" event={"ID":"5148708b-dd5c-49b6-a1fc-c5c12e2ea6d1","Type":"ContainerStarted","Data":"3232aab671ea0aa1c8a3d4ad4f050dc107f3146240e6f6ab62b5064e475985d0"}
Sep 11 03:53:45.020680 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:45.020638    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zt598" podStartSLOduration=3.043885745 podStartE2EDuration="22.020626564s" totalImagesPullingTime="18.976740819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:53:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:53:45.020316603 +0000 UTC m=+21.818406331" watchObservedRunningTime="2026-09-11 03:53:45.020626564 +0000 UTC m=+21.818716291"
Sep 11 03:53:45.034780 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:45.034736    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-195.ec2.internal" podStartSLOduration=22.034720915 podStartE2EDuration="22.034720915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:53:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:53:45.03453957 +0000 UTC m=+21.832629287" watchObservedRunningTime="2026-09-11 03:53:45.034720915 +0000 UTC m=+21.832810642"
Sep 11 03:53:45.050570 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:45.050521    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dmmhz" podStartSLOduration=3.116486614 podStartE2EDuration="22.050498213s" totalImagesPullingTime="18.934011599s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:53:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:53:45.050453419 +0000 UTC m=+21.848543145" watchObservedRunningTime="2026-09-11 03:53:45.050498213 +0000 UTC m=+21.848587941"
Sep 11 03:53:45.064910 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:45.064859    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6rfcj" podStartSLOduration=3.153397632 podStartE2EDuration="22.064840858s" totalImagesPullingTime="18.911443226s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:53:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:53:45.064575046 +0000 UTC m=+21.862664774" watchObservedRunningTime="2026-09-11 03:53:45.064840858 +0000 UTC m=+21.862930586"
Sep 11 03:53:45.087095 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:45.087028    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rqbz6" podStartSLOduration=2.930834442 podStartE2EDuration="22.087005575s" totalImagesPullingTime="19.156171133s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:53:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:53:45.086464028 +0000 UTC m=+21.884553754" watchObservedRunningTime="2026-09-11 03:53:45.087005575 +0000 UTC m=+21.885095302"
Sep 11 03:53:45.104661 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:45.104612    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5k289" podStartSLOduration=3.227049082 podStartE2EDuration="22.104596987s" totalImagesPullingTime="18.877547905s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:53:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:53:45.104508464 +0000 UTC m=+21.902598191" watchObservedRunningTime="2026-09-11 03:53:45.104596987 +0000 UTC m=+21.902686711"
Sep 11 03:53:45.206061 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:45.206027    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zt598"
Sep 11 03:53:45.206630 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:45.206617    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zt598"
Sep 11 03:53:45.806350 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:45.806271    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb2cl"
Sep 11 03:53:45.806350 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:45.806286    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bl6k"
Sep 11 03:53:45.806576 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:45.806366    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gb2cl" podUID="e72b85ea-da06-4626-9ac7-1aa09afbc972"
Sep 11 03:53:45.806576 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:45.806483    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bl6k" podUID="6b502d3b-4680-40e1-9381-0a5822c16d82"
Sep 11 03:53:46.022199 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:46.022160    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hmm8m" event={"ID":"e4cadd65-2d50-4f05-ba2e-36fcead51fef","Type":"ContainerStarted","Data":"3460e27c81374aec74735a29b6e0520e73ead58c0cd968f8356330d86a8e6e8b"}
Sep 11 03:53:46.024312 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:46.024280    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-195.ec2.internal" event={"ID":"52aa30798a90a24b8f87726fd735fa68","Type":"ContainerStarted","Data":"7fc50c1449066361fcba5a3ffd79959b7ae64a812bd497b9d4dbf498438285ed"}
Sep 11 03:53:46.038723 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:46.038669    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hmm8m" podStartSLOduration=4.193170591 podStartE2EDuration="23.038648974s" totalImagesPullingTime="18.845478383s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:53:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:53:46.038650694 +0000 UTC m=+22.836740431" watchObservedRunningTime="2026-09-11 03:53:46.038648974 +0000 UTC m=+22.836738702"
Sep 11 03:53:46.055188 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:46.055141    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-195.ec2.internal" podStartSLOduration=23.055121166 podStartE2EDuration="23.055121166s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:53:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:53:46.054817935 +0000 UTC m=+22.852907662" watchObservedRunningTime="2026-09-11 03:53:46.055121166 +0000 UTC m=+22.853210894"
Sep 11 03:53:46.165663 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:46.165411    2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 03:53:46.737213 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:46.737098    2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T03:53:46.165658482Z","UUID":"dda9e317-5ee1-4b50-80cf-898a675d989c","Handler":null,"Name":"","Endpoint":""}
Sep 11 03:53:46.739302 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:46.739273    2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 03:53:46.739488 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:46.739313    2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 03:53:46.803606 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:46.803572    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xdw4t"
Sep 11 03:53:46.803755 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:46.803729    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xdw4t" podUID="87707938-5179-4e34-8d8a-892ecac835ee"
Sep 11 03:53:47.029022 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:47.028925    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zld26" event={"ID":"5a897d30-52c7-43b5-a1f4-ea86ddc16732","Type":"ContainerStarted","Data":"2c3bda43a7dd9e200945f60ca90cd4cec840a14b71e23828e0380a5a8362055e"}
Sep 11 03:53:47.034059 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:47.034026    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nfssn_c9add74a-5c51-4ccf-9edd-3b90a66b9ef9/ovn-acl-logging/0.log"
Sep 11 03:53:47.034869 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:47.034835    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nfssn" event={"ID":"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9","Type":"ContainerStarted","Data":"ede43a654773d5dad6e63de587b44b9960a5d6c312e776559f6d4aab35366874"}
Sep 11 03:53:47.035167 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:47.035147    2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 11 03:53:47.804204 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:47.804126    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb2cl"
Sep 11 03:53:47.804361 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:47.804126    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bl6k"
Sep 11 03:53:47.804361 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:47.804239    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gb2cl" podUID="e72b85ea-da06-4626-9ac7-1aa09afbc972"
Sep 11 03:53:47.804361 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:47.804321    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bl6k" podUID="6b502d3b-4680-40e1-9381-0a5822c16d82"
Sep 11 03:53:48.039879 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:48.039839    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zld26" event={"ID":"5a897d30-52c7-43b5-a1f4-ea86ddc16732","Type":"ContainerStarted","Data":"81be7d05531b6d45e1b922a00ce1ead3f7a3b736e60140af6ae719c30136e290"}
Sep 11 03:53:48.061187 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:48.061050    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zld26" podStartSLOduration=3.555695095 podStartE2EDuration="25.061029678s" totalImagesPullingTime="21.505334583s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:53:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:53:48.060668195 +0000 UTC m=+24.858757923" watchObservedRunningTime="2026-09-11 03:53:48.061029678 +0000 UTC m=+24.859119409"
Sep 11 03:53:48.804550 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:48.804516    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xdw4t"
Sep 11 03:53:48.804714 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:48.804657    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xdw4t" podUID="87707938-5179-4e34-8d8a-892ecac835ee"
Sep 11 03:53:49.807639 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:49.807597    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb2cl"
Sep 11 03:53:49.808096 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:49.807739    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gb2cl" podUID="e72b85ea-da06-4626-9ac7-1aa09afbc972"
Sep 11 03:53:49.808096 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:49.807798    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bl6k"
Sep 11 03:53:49.808096 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:49.807915    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bl6k" podUID="6b502d3b-4680-40e1-9381-0a5822c16d82"
Sep 11 03:53:50.804134 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:50.803948    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xdw4t"
Sep 11 03:53:50.804295 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:50.804223    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xdw4t" podUID="87707938-5179-4e34-8d8a-892ecac835ee"
Sep 11 03:53:51.053299 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:51.053271    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nfssn_c9add74a-5c51-4ccf-9edd-3b90a66b9ef9/ovn-acl-logging/0.log"
Sep 11 03:53:51.053731 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:51.053689    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nfssn" event={"ID":"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9","Type":"ContainerStarted","Data":"f066977f8f8eabe7dfc31b2a80fef067b909acb53771cdbd1555550b06a56213"}
Sep 11 03:53:51.053985 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:51.053953    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:51.054111 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:51.054021    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:51.054197 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:51.054110    2558 scope.go:117] "RemoveContainer" containerID="e062426a70b881291518d78fec4c3650af6d9fb488781a2be1ef94b32855eb7f"
Sep 11 03:53:51.055698 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:51.055677    2558 generic.go:356] "Generic (PLEG): container finished" podID="091ab74f-c966-419b-9a8b-1cbee553790f" containerID="75e0f5f4e5fa2888d6b825a8c92365f79d58759da222bc393b747b71d5db58f2" exitCode=0
Sep 11 03:53:51.055815 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:51.055727    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bbxwp" event={"ID":"091ab74f-c966-419b-9a8b-1cbee553790f","Type":"ContainerDied","Data":"75e0f5f4e5fa2888d6b825a8c92365f79d58759da222bc393b747b71d5db58f2"}
Sep 11 03:53:51.073015 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:51.072993    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:51.804043 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:51.804015    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb2cl"
Sep 11 03:53:51.804232 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:51.804122    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gb2cl" podUID="e72b85ea-da06-4626-9ac7-1aa09afbc972"
Sep 11 03:53:51.804232 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:51.804169    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bl6k"
Sep 11 03:53:51.804326 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:51.804254    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bl6k" podUID="6b502d3b-4680-40e1-9381-0a5822c16d82"
Sep 11 03:53:51.995077 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:51.995023    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5bl6k"]
Sep 11 03:53:51.995709 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:51.995687    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gb2cl"]
Sep 11 03:53:52.007055 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:52.006974    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xdw4t"]
Sep 11 03:53:52.007206 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:52.007084    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xdw4t"
Sep 11 03:53:52.007206 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:52.007180    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xdw4t" podUID="87707938-5179-4e34-8d8a-892ecac835ee"
Sep 11 03:53:52.059870 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:52.059835    2558 generic.go:356] "Generic (PLEG): container finished" podID="091ab74f-c966-419b-9a8b-1cbee553790f" containerID="3d7a820d5ba39215b84769a503257bed0542f99e3ad24c1db9cd7bbcee5d3f6e" exitCode=0
Sep 11 03:53:52.060652 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:52.059882    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bbxwp" event={"ID":"091ab74f-c966-419b-9a8b-1cbee553790f","Type":"ContainerDied","Data":"3d7a820d5ba39215b84769a503257bed0542f99e3ad24c1db9cd7bbcee5d3f6e"}
Sep 11 03:53:52.064226 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:52.064070    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nfssn_c9add74a-5c51-4ccf-9edd-3b90a66b9ef9/ovn-acl-logging/0.log"
Sep 11 03:53:52.064593 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:52.064571    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nfssn" event={"ID":"c9add74a-5c51-4ccf-9edd-3b90a66b9ef9","Type":"ContainerStarted","Data":"53fd4a32f147caec43581cfafd34cb7453b49d3dffff689e8dca5ca939953f83"}
Sep 11 03:53:52.064657 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:52.064597    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb2cl"
Sep 11 03:53:52.064657 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:52.064624    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bl6k"
Sep 11 03:53:52.064780 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:52.064758    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gb2cl" podUID="e72b85ea-da06-4626-9ac7-1aa09afbc972"
Sep 11 03:53:52.064855 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:52.064829    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bl6k" podUID="6b502d3b-4680-40e1-9381-0a5822c16d82"
Sep 11 03:53:52.064914 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:52.064869    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:52.083600 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:52.081402    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:53:52.108186 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:52.108139    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nfssn" podStartSLOduration=10.08385775 podStartE2EDuration="29.10812485s" totalImagesPullingTime="19.0242671s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:53:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:53:52.107850049 +0000 UTC m=+28.905939775" watchObservedRunningTime="2026-09-11 03:53:52.10812485 +0000 UTC m=+28.906214576"
Sep 11 03:53:53.070124 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:53.070091    2558 generic.go:356] "Generic (PLEG): container finished" podID="091ab74f-c966-419b-9a8b-1cbee553790f" containerID="62ef559d582946a66f4354cb939d87ee446539ed7f0d6aee2118bdf5cf9f213e" exitCode=0
Sep 11 03:53:53.070492 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:53.070170    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bbxwp" event={"ID":"091ab74f-c966-419b-9a8b-1cbee553790f","Type":"ContainerDied","Data":"62ef559d582946a66f4354cb939d87ee446539ed7f0d6aee2118bdf5cf9f213e"}
Sep 11 03:53:53.327832 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:53.327798    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zt598"
Sep 11 03:53:53.328005 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:53.327920    2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 11 03:53:53.328318 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:53.328298    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zt598"
Sep 11 03:53:53.804614 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:53.804567    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xdw4t"
Sep 11 03:53:53.804834 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:53.804679    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bl6k"
Sep 11 03:53:53.804834 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:53.804690    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xdw4t" podUID="87707938-5179-4e34-8d8a-892ecac835ee"
Sep 11 03:53:53.804834 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:53.804786    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb2cl"
Sep 11 03:53:53.804995 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:53.804849    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bl6k" podUID="6b502d3b-4680-40e1-9381-0a5822c16d82"
Sep 11 03:53:53.804995 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:53.804854    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gb2cl" podUID="e72b85ea-da06-4626-9ac7-1aa09afbc972"
Sep 11 03:53:55.804576 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:55.804532    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb2cl"
Sep 11 03:53:55.805013 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:55.804533    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xdw4t"
Sep 11 03:53:55.805013 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:55.804643    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gb2cl" podUID="e72b85ea-da06-4626-9ac7-1aa09afbc972"
Sep 11 03:53:55.805013 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:55.804750    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xdw4t" podUID="87707938-5179-4e34-8d8a-892ecac835ee"
Sep 11 03:53:55.805013 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:55.804537    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bl6k"
Sep 11 03:53:55.805013 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:55.804878    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bl6k" podUID="6b502d3b-4680-40e1-9381-0a5822c16d82"
Sep 11 03:53:56.425156 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:56.425106    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e72b85ea-da06-4626-9ac7-1aa09afbc972-original-pull-secret\") pod \"global-pull-secret-syncer-gb2cl\" (UID: \"e72b85ea-da06-4626-9ac7-1aa09afbc972\") " pod="kube-system/global-pull-secret-syncer-gb2cl"
Sep 11 03:53:56.425342 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:56.425282    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 03:53:56.425422 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:56.425373    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e72b85ea-da06-4626-9ac7-1aa09afbc972-original-pull-secret podName:e72b85ea-da06-4626-9ac7-1aa09afbc972 nodeName:}" failed. No retries permitted until 2026-09-11 03:54:28.425348702 +0000 UTC m=+65.223438413 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e72b85ea-da06-4626-9ac7-1aa09afbc972-original-pull-secret") pod "global-pull-secret-syncer-gb2cl" (UID: "e72b85ea-da06-4626-9ac7-1aa09afbc972") : object "kube-system"/"original-pull-secret" not registered
Sep 11 03:53:56.526527 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:56.526482    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87707938-5179-4e34-8d8a-892ecac835ee-metrics-certs\") pod \"network-metrics-daemon-xdw4t\" (UID: \"87707938-5179-4e34-8d8a-892ecac835ee\") " pod="openshift-multus/network-metrics-daemon-xdw4t"
Sep 11 03:53:56.526692 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:56.526610    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 03:53:56.526692 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:56.526675    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87707938-5179-4e34-8d8a-892ecac835ee-metrics-certs podName:87707938-5179-4e34-8d8a-892ecac835ee nodeName:}" failed. No retries permitted until 2026-09-11 03:54:28.526658376 +0000 UTC m=+65.324748083 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87707938-5179-4e34-8d8a-892ecac835ee-metrics-certs") pod "network-metrics-daemon-xdw4t" (UID: "87707938-5179-4e34-8d8a-892ecac835ee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 03:53:56.627621 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:56.627579    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlwwv\" (UniqueName: \"kubernetes.io/projected/6b502d3b-4680-40e1-9381-0a5822c16d82-kube-api-access-tlwwv\") pod \"network-check-target-5bl6k\" (UID: \"6b502d3b-4680-40e1-9381-0a5822c16d82\") " pod="openshift-network-diagnostics/network-check-target-5bl6k"
Sep 11 03:53:56.627831 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:56.627806    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 03:53:56.627902 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:56.627834    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 03:53:56.627902 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:56.627846    2558 projected.go:196] Error preparing data for projected volume kube-api-access-tlwwv for pod openshift-network-diagnostics/network-check-target-5bl6k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 03:53:56.627983 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:56.627910    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b502d3b-4680-40e1-9381-0a5822c16d82-kube-api-access-tlwwv podName:6b502d3b-4680-40e1-9381-0a5822c16d82 nodeName:}" failed. No retries permitted until 2026-09-11 03:54:28.62789219 +0000 UTC m=+65.425981897 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tlwwv" (UniqueName: "kubernetes.io/projected/6b502d3b-4680-40e1-9381-0a5822c16d82-kube-api-access-tlwwv") pod "network-check-target-5bl6k" (UID: "6b502d3b-4680-40e1-9381-0a5822c16d82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 03:53:56.991462 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:56.991427    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-195.ec2.internal" event="NodeReady"
Sep 11 03:53:56.991926 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:56.991584    2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 03:53:57.034225 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.034146    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jcsgz"]
Sep 11 03:53:57.067595 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.067554    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tfr46"]
Sep 11 03:53:57.067781 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.067648    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jcsgz"
Sep 11 03:53:57.070330 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.070294    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 03:53:57.070473 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.070296    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 03:53:57.070473 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.070355    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h5zgd\""
Sep 11 03:53:57.081401 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.081365    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jcsgz"]
Sep 11 03:53:57.081542 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.081484    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tfr46"
Sep 11 03:53:57.081542 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.081519    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tfr46"]
Sep 11 03:53:57.084063 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.084038    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 03:53:57.084204 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.084154    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n2mzh\""
Sep 11 03:53:57.084287 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.084271    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 03:53:57.084380 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.084367    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 03:53:57.132099 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.132057    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7afc68c1-54e3-4f06-8dcd-184a06388ccf-config-volume\") pod \"dns-default-jcsgz\" (UID: \"7afc68c1-54e3-4f06-8dcd-184a06388ccf\") " pod="openshift-dns/dns-default-jcsgz"
Sep 11 03:53:57.132299 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.132108    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7afc68c1-54e3-4f06-8dcd-184a06388ccf-tmp-dir\") pod \"dns-default-jcsgz\" (UID: \"7afc68c1-54e3-4f06-8dcd-184a06388ccf\") " pod="openshift-dns/dns-default-jcsgz"
Sep 11 03:53:57.132299 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.132153    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6wjf\" (UniqueName: \"kubernetes.io/projected/7afc68c1-54e3-4f06-8dcd-184a06388ccf-kube-api-access-d6wjf\") pod \"dns-default-jcsgz\" (UID: \"7afc68c1-54e3-4f06-8dcd-184a06388ccf\") " pod="openshift-dns/dns-default-jcsgz"
Sep 11 03:53:57.132299 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.132179    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7afc68c1-54e3-4f06-8dcd-184a06388ccf-metrics-tls\") pod \"dns-default-jcsgz\" (UID: \"7afc68c1-54e3-4f06-8dcd-184a06388ccf\") " pod="openshift-dns/dns-default-jcsgz"
Sep 11 03:53:57.233555 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.233507    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7afc68c1-54e3-4f06-8dcd-184a06388ccf-config-volume\") pod \"dns-default-jcsgz\" (UID: \"7afc68c1-54e3-4f06-8dcd-184a06388ccf\") " pod="openshift-dns/dns-default-jcsgz"
Sep 11 03:53:57.233747 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.233650    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7afc68c1-54e3-4f06-8dcd-184a06388ccf-tmp-dir\") pod \"dns-default-jcsgz\" (UID: \"7afc68c1-54e3-4f06-8dcd-184a06388ccf\") " pod="openshift-dns/dns-default-jcsgz"
Sep 11 03:53:57.233747 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.233712    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57ce4512-0f2a-462f-bf95-6cd72f7f727b-cert\") pod \"ingress-canary-tfr46\" (UID: \"57ce4512-0f2a-462f-bf95-6cd72f7f727b\") " pod="openshift-ingress-canary/ingress-canary-tfr46"
Sep 11 03:53:57.233867 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.233746    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kg4l\" (UniqueName: \"kubernetes.io/projected/57ce4512-0f2a-462f-bf95-6cd72f7f727b-kube-api-access-7kg4l\") pod \"ingress-canary-tfr46\" (UID: \"57ce4512-0f2a-462f-bf95-6cd72f7f727b\") " pod="openshift-ingress-canary/ingress-canary-tfr46"
Sep 11 03:53:57.233867 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.233787    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6wjf\" (UniqueName: \"kubernetes.io/projected/7afc68c1-54e3-4f06-8dcd-184a06388ccf-kube-api-access-d6wjf\") pod \"dns-default-jcsgz\" (UID: \"7afc68c1-54e3-4f06-8dcd-184a06388ccf\") " pod="openshift-dns/dns-default-jcsgz"
Sep 11 03:53:57.233867 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.233815    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7afc68c1-54e3-4f06-8dcd-184a06388ccf-metrics-tls\") pod \"dns-default-jcsgz\" (UID: \"7afc68c1-54e3-4f06-8dcd-184a06388ccf\") " pod="openshift-dns/dns-default-jcsgz"
Sep 11 03:53:57.234016 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.233904    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7afc68c1-54e3-4f06-8dcd-184a06388ccf-tmp-dir\") pod \"dns-default-jcsgz\" (UID: \"7afc68c1-54e3-4f06-8dcd-184a06388ccf\") " pod="openshift-dns/dns-default-jcsgz"
Sep 11 03:53:57.234016 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:57.233938    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 03:53:57.234016 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:57.233998    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7afc68c1-54e3-4f06-8dcd-184a06388ccf-metrics-tls podName:7afc68c1-54e3-4f06-8dcd-184a06388ccf nodeName:}" failed. No retries permitted until 2026-09-11 03:53:57.733981043 +0000 UTC m=+34.532070748 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7afc68c1-54e3-4f06-8dcd-184a06388ccf-metrics-tls") pod "dns-default-jcsgz" (UID: "7afc68c1-54e3-4f06-8dcd-184a06388ccf") : secret "dns-default-metrics-tls" not found
Sep 11 03:53:57.234168 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.234093    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7afc68c1-54e3-4f06-8dcd-184a06388ccf-config-volume\") pod \"dns-default-jcsgz\" (UID: \"7afc68c1-54e3-4f06-8dcd-184a06388ccf\") " pod="openshift-dns/dns-default-jcsgz"
Sep 11 03:53:57.244779 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.244741    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6wjf\" (UniqueName: \"kubernetes.io/projected/7afc68c1-54e3-4f06-8dcd-184a06388ccf-kube-api-access-d6wjf\") pod \"dns-default-jcsgz\" (UID: \"7afc68c1-54e3-4f06-8dcd-184a06388ccf\") " pod="openshift-dns/dns-default-jcsgz"
Sep 11 03:53:57.334802 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.334763    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57ce4512-0f2a-462f-bf95-6cd72f7f727b-cert\") pod \"ingress-canary-tfr46\" (UID: \"57ce4512-0f2a-462f-bf95-6cd72f7f727b\") " pod="openshift-ingress-canary/ingress-canary-tfr46"
Sep 11 03:53:57.334802 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.334803    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kg4l\" (UniqueName: \"kubernetes.io/projected/57ce4512-0f2a-462f-bf95-6cd72f7f727b-kube-api-access-7kg4l\") pod \"ingress-canary-tfr46\" (UID: \"57ce4512-0f2a-462f-bf95-6cd72f7f727b\") " pod="openshift-ingress-canary/ingress-canary-tfr46"
Sep 11 03:53:57.337401 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.337366    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57ce4512-0f2a-462f-bf95-6cd72f7f727b-cert\") pod \"ingress-canary-tfr46\" (UID: \"57ce4512-0f2a-462f-bf95-6cd72f7f727b\") " pod="openshift-ingress-canary/ingress-canary-tfr46"
Sep 11 03:53:57.343098 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.343075    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kg4l\" (UniqueName: \"kubernetes.io/projected/57ce4512-0f2a-462f-bf95-6cd72f7f727b-kube-api-access-7kg4l\") pod \"ingress-canary-tfr46\" (UID: \"57ce4512-0f2a-462f-bf95-6cd72f7f727b\") " pod="openshift-ingress-canary/ingress-canary-tfr46"
Sep 11 03:53:57.391159 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.391120    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tfr46"
Sep 11 03:53:57.685717 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.685673    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tfr46"]
Sep 11 03:53:57.689556 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:53:57.689531    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57ce4512_0f2a_462f_bf95_6cd72f7f727b.slice/crio-c8acfa57312288887a8dc6b39452db99d1046760f876b941fce15b60cc7d26e9 WatchSource:0}: Error finding container c8acfa57312288887a8dc6b39452db99d1046760f876b941fce15b60cc7d26e9: Status 404 returned error can't find the container with id c8acfa57312288887a8dc6b39452db99d1046760f876b941fce15b60cc7d26e9
Sep 11 03:53:57.738244 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.738205    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7afc68c1-54e3-4f06-8dcd-184a06388ccf-metrics-tls\") pod \"dns-default-jcsgz\" (UID: \"7afc68c1-54e3-4f06-8dcd-184a06388ccf\") " pod="openshift-dns/dns-default-jcsgz"
Sep 11 03:53:57.738421 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:57.738363    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 03:53:57.738466 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:57.738445    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7afc68c1-54e3-4f06-8dcd-184a06388ccf-metrics-tls podName:7afc68c1-54e3-4f06-8dcd-184a06388ccf nodeName:}" failed. No retries permitted until 2026-09-11 03:53:58.738428093 +0000 UTC m=+35.536517798 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7afc68c1-54e3-4f06-8dcd-184a06388ccf-metrics-tls") pod "dns-default-jcsgz" (UID: "7afc68c1-54e3-4f06-8dcd-184a06388ccf") : secret "dns-default-metrics-tls" not found
Sep 11 03:53:57.803725 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.803691    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bl6k"
Sep 11 03:53:57.803890 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.803697    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xdw4t"
Sep 11 03:53:57.804299 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.803697    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb2cl"
Sep 11 03:53:57.807765 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.807579    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 03:53:57.807765 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.807581    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 03:53:57.807765 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.807617    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j6dl8\""
Sep 11 03:53:57.807765 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.807584    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 03:53:57.807765 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.807624    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rtj7z\""
Sep 11 03:53:57.807765 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:57.807627    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 03:53:58.083278 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:58.083241    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tfr46" event={"ID":"57ce4512-0f2a-462f-bf95-6cd72f7f727b","Type":"ContainerStarted","Data":"c8acfa57312288887a8dc6b39452db99d1046760f876b941fce15b60cc7d26e9"}
Sep 11 03:53:58.086136 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:58.086108    2558 generic.go:356] "Generic (PLEG): container finished" podID="091ab74f-c966-419b-9a8b-1cbee553790f" containerID="0de0fbc83a3a69bca97b3e19d0a3b2202323c087a68d7f35112dba5a81ad8fed" exitCode=0
Sep 11 03:53:58.086256 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:58.086156    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bbxwp" event={"ID":"091ab74f-c966-419b-9a8b-1cbee553790f","Type":"ContainerDied","Data":"0de0fbc83a3a69bca97b3e19d0a3b2202323c087a68d7f35112dba5a81ad8fed"}
Sep 11 03:53:58.745593 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:58.745542    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7afc68c1-54e3-4f06-8dcd-184a06388ccf-metrics-tls\") pod \"dns-default-jcsgz\" (UID: \"7afc68c1-54e3-4f06-8dcd-184a06388ccf\") " pod="openshift-dns/dns-default-jcsgz"
Sep 11 03:53:58.745779 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:58.745733    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 03:53:58.745846 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:53:58.745803    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7afc68c1-54e3-4f06-8dcd-184a06388ccf-metrics-tls podName:7afc68c1-54e3-4f06-8dcd-184a06388ccf nodeName:}" failed. No retries permitted until 2026-09-11 03:54:00.745784238 +0000 UTC m=+37.543873966 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7afc68c1-54e3-4f06-8dcd-184a06388ccf-metrics-tls") pod "dns-default-jcsgz" (UID: "7afc68c1-54e3-4f06-8dcd-184a06388ccf") : secret "dns-default-metrics-tls" not found
Sep 11 03:53:59.092417 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:59.092364    2558 generic.go:356] "Generic (PLEG): container finished" podID="091ab74f-c966-419b-9a8b-1cbee553790f" containerID="3d5a624233bbc2c7f7fd9aabc840a9a75633233e3be6ca7fbe12948e175b853e" exitCode=0
Sep 11 03:53:59.092856 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:53:59.092433    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bbxwp" event={"ID":"091ab74f-c966-419b-9a8b-1cbee553790f","Type":"ContainerDied","Data":"3d5a624233bbc2c7f7fd9aabc840a9a75633233e3be6ca7fbe12948e175b853e"}
Sep 11 03:54:00.099810 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:00.099771    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bbxwp" event={"ID":"091ab74f-c966-419b-9a8b-1cbee553790f","Type":"ContainerStarted","Data":"dd6de76d33274811fd24e354acb91d343daa65b1986cfee11bfe762a63a40c8d"}
Sep 11 03:54:00.123111 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:00.123053    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bbxwp" podStartSLOduration=7.248888935 podStartE2EDuration="37.123034572s" totalImagesPullingTime="29.874145637s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:53:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:54:00.122664024 +0000 UTC m=+36.920753751" watchObservedRunningTime="2026-09-11 03:54:00.123034572 +0000 UTC m=+36.921124299"
Sep 11 03:54:00.761267 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:00.761014    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7afc68c1-54e3-4f06-8dcd-184a06388ccf-metrics-tls\") pod \"dns-default-jcsgz\" (UID: \"7afc68c1-54e3-4f06-8dcd-184a06388ccf\") " pod="openshift-dns/dns-default-jcsgz"
Sep 11 03:54:00.761267 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:00.761167    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 03:54:00.761486 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:00.761326    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7afc68c1-54e3-4f06-8dcd-184a06388ccf-metrics-tls podName:7afc68c1-54e3-4f06-8dcd-184a06388ccf nodeName:}" failed. No retries permitted until 2026-09-11 03:54:04.761310684 +0000 UTC m=+41.559400389 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7afc68c1-54e3-4f06-8dcd-184a06388ccf-metrics-tls") pod "dns-default-jcsgz" (UID: "7afc68c1-54e3-4f06-8dcd-184a06388ccf") : secret "dns-default-metrics-tls" not found
Sep 11 03:54:01.104434 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:01.104378    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tfr46" event={"ID":"57ce4512-0f2a-462f-bf95-6cd72f7f727b","Type":"ContainerStarted","Data":"ea26760872c4ea6ff62601b599f9fac667ea6d3100bb3a03a0dcd97fef212e53"}
Sep 11 03:54:01.119703 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:01.119655    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tfr46" podStartSLOduration=1.505170706 podStartE2EDuration="4.119637519s" totalImagesPullingTime="2.614466813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:53:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:54:01.119105171 +0000 UTC m=+37.917194911" watchObservedRunningTime="2026-09-11 03:54:01.119637519 +0000 UTC m=+37.917727247"
Sep 11 03:54:04.580073 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.580035    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5cfcb599d4-jzm8b"]
Sep 11 03:54:04.614336 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.614310    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cfcb599d4-jzm8b"]
Sep 11 03:54:04.614336 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.614349    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-lm5hf"]
Sep 11 03:54:04.614603 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.614463    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cfcb599d4-jzm8b"
Sep 11 03:54:04.618830 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.618795    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 11 03:54:04.618981 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.618934    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 11 03:54:04.619051 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.618991    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 11 03:54:04.619441 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.619417    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vm2xm\""
Sep 11 03:54:04.628651 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.628620    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 11 03:54:04.634338 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.634314    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-lm5hf"]
Sep 11 03:54:04.634446 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.634415    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lm5hf"
Sep 11 03:54:04.641125 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.641103    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 03:54:04.641262 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.641190    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5z74n\""
Sep 11 03:54:04.641262 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.641187    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 11 03:54:04.642598 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.642581    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 03:54:04.642666 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.642580    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 11 03:54:04.673948 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.673913    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-5lhhq"]
Sep 11 03:54:04.687219 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.687185    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1c58ba3e-9104-492b-88d9-9f4abdee2c03-image-registry-private-configuration\") pod \"image-registry-5cfcb599d4-jzm8b\" (UID: \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\") " pod="openshift-image-registry/image-registry-5cfcb599d4-jzm8b"
Sep 11 03:54:04.687365 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.687237    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1c58ba3e-9104-492b-88d9-9f4abdee2c03-trusted-ca\") pod \"image-registry-5cfcb599d4-jzm8b\" (UID: \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\") " pod="openshift-image-registry/image-registry-5cfcb599d4-jzm8b"
Sep 11 03:54:04.687365 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.687295    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1c58ba3e-9104-492b-88d9-9f4abdee2c03-ca-trust-extracted\") pod \"image-registry-5cfcb599d4-jzm8b\" (UID: \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\") " pod="openshift-image-registry/image-registry-5cfcb599d4-jzm8b"
Sep 11 03:54:04.687365 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.687320    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1c58ba3e-9104-492b-88d9-9f4abdee2c03-installation-pull-secrets\") pod \"image-registry-5cfcb599d4-jzm8b\" (UID: \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\") " pod="openshift-image-registry/image-registry-5cfcb599d4-jzm8b"
Sep 11 03:54:04.687365 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.687344    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1c58ba3e-9104-492b-88d9-9f4abdee2c03-bound-sa-token\") pod \"image-registry-5cfcb599d4-jzm8b\" (UID: \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\") " pod="openshift-image-registry/image-registry-5cfcb599d4-jzm8b"
Sep 11 03:54:04.687553 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.687381    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c58ba3e-9104-492b-88d9-9f4abdee2c03-registry-tls\") pod \"image-registry-5cfcb599d4-jzm8b\" (UID: \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\") " pod="openshift-image-registry/image-registry-5cfcb599d4-jzm8b"
Sep 11 03:54:04.687553 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.687442    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1c58ba3e-9104-492b-88d9-9f4abdee2c03-registry-certificates\") pod \"image-registry-5cfcb599d4-jzm8b\" (UID: \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\") " pod="openshift-image-registry/image-registry-5cfcb599d4-jzm8b"
Sep 11 03:54:04.687553 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.687474    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x84p\" (UniqueName: \"kubernetes.io/projected/1c58ba3e-9104-492b-88d9-9f4abdee2c03-kube-api-access-2x84p\") pod \"image-registry-5cfcb599d4-jzm8b\" (UID: \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\") " pod="openshift-image-registry/image-registry-5cfcb599d4-jzm8b"
Sep 11 03:54:04.694440 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.694419    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-78556b97cb-rt5r7"]
Sep 11 03:54:04.694579 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.694562    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-5lhhq"
Sep 11 03:54:04.697979 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.697954    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-cc6kg\""
Sep 11 03:54:04.720360 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.720335    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-5lhhq"]
Sep 11 03:54:04.720496 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.720368    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-78556b97cb-rt5r7"]
Sep 11 03:54:04.720496 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.720454    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-78556b97cb-rt5r7"
Sep 11 03:54:04.726732 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.726709    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 11 03:54:04.726927 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.726898    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xfh26\""
Sep 11 03:54:04.727027 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.726999    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 11 03:54:04.727582 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.727564    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 03:54:04.727685 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.727567    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 03:54:04.727685 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.727621    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 11 03:54:04.729800 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.729780    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 11 03:54:04.781976 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.781948    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-4z8c9"]
Sep 11 03:54:04.788359 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.788331    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1c58ba3e-9104-492b-88d9-9f4abdee2c03-installation-pull-secrets\") pod \"image-registry-5cfcb599d4-jzm8b\" (UID: \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\") " pod="openshift-image-registry/image-registry-5cfcb599d4-jzm8b"
Sep 11 03:54:04.788513 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.788363    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1c58ba3e-9104-492b-88d9-9f4abdee2c03-bound-sa-token\") pod \"image-registry-5cfcb599d4-jzm8b\" (UID: \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\") " pod="openshift-image-registry/image-registry-5cfcb599d4-jzm8b"
Sep 11 03:54:04.788513 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.788420    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c58ba3e-9104-492b-88d9-9f4abdee2c03-registry-tls\") pod \"image-registry-5cfcb599d4-jzm8b\" (UID: \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\") " pod="openshift-image-registry/image-registry-5cfcb599d4-jzm8b"
Sep 11 03:54:04.788513 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.788443    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1c58ba3e-9104-492b-88d9-9f4abdee2c03-registry-certificates\") pod \"image-registry-5cfcb599d4-jzm8b\" (UID: \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\") " pod="openshift-image-registry/image-registry-5cfcb599d4-jzm8b"
Sep 11 03:54:04.788513 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.788469    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x84p\" (UniqueName: \"kubernetes.io/projected/1c58ba3e-9104-492b-88d9-9f4abdee2c03-kube-api-access-2x84p\") pod \"image-registry-5cfcb599d4-jzm8b\" (UID: \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\") " pod="openshift-image-registry/image-registry-5cfcb599d4-jzm8b"
Sep 11 03:54:04.788703 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.788539    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42222ece-7ddd-483e-8ca8-934910a8fa25-metrics-certs\") pod \"router-default-78556b97cb-rt5r7\" (UID: \"42222ece-7ddd-483e-8ca8-934910a8fa25\") " pod="openshift-ingress/router-default-78556b97cb-rt5r7"
Sep 11 03:54:04.788703 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.788563    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz6rn\" (UniqueName: \"kubernetes.io/projected/42222ece-7ddd-483e-8ca8-934910a8fa25-kube-api-access-qz6rn\") pod \"router-default-78556b97cb-rt5r7\" (UID: \"42222ece-7ddd-483e-8ca8-934910a8fa25\") " pod="openshift-ingress/router-default-78556b97cb-rt5r7"
Sep 11 03:54:04.788703 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:04.788570    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 03:54:04.788703 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:04.788591    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cfcb599d4-jzm8b: secret "image-registry-tls" not found
Sep 11 03:54:04.788703 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.788588    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/53d1b221-40dd-4507-b81a-4af75f45efaf-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-lm5hf\" (UID: \"53d1b221-40dd-4507-b81a-4af75f45efaf\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lm5hf"
Sep 11 03:54:04.788703 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.788625    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42222ece-7ddd-483e-8ca8-934910a8fa25-service-ca-bundle\") pod \"router-default-78556b97cb-rt5r7\" (UID: \"42222ece-7ddd-483e-8ca8-934910a8fa25\") " pod="openshift-ingress/router-default-78556b97cb-rt5r7"
Sep 11 03:54:04.788703 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.788649    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53d1b221-40dd-4507-b81a-4af75f45efaf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-lm5hf\" (UID: \"53d1b221-40dd-4507-b81a-4af75f45efaf\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lm5hf"
Sep 11 03:54:04.788703 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:04.788674    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c58ba3e-9104-492b-88d9-9f4abdee2c03-registry-tls podName:1c58ba3e-9104-492b-88d9-9f4abdee2c03 nodeName:}" failed. No retries permitted until 2026-09-11 03:54:05.288654511 +0000 UTC m=+42.086744238 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1c58ba3e-9104-492b-88d9-9f4abdee2c03-registry-tls") pod "image-registry-5cfcb599d4-jzm8b" (UID: "1c58ba3e-9104-492b-88d9-9f4abdee2c03") : secret "image-registry-tls" not found
Sep 11 03:54:04.788998 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.788723    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcksd\" (UniqueName: \"kubernetes.io/projected/53d1b221-40dd-4507-b81a-4af75f45efaf-kube-api-access-wcksd\") pod \"cluster-monitoring-operator-6cd954b897-lm5hf\" (UID: \"53d1b221-40dd-4507-b81a-4af75f45efaf\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lm5hf"
Sep 11 03:54:04.788998 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.788808    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1c58ba3e-9104-492b-88d9-9f4abdee2c03-image-registry-private-configuration\") pod \"image-registry-5cfcb599d4-jzm8b\" (UID: \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\") " pod="openshift-image-registry/image-registry-5cfcb599d4-jzm8b"
Sep 11 03:54:04.788998 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.788838    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-989r8\" (UniqueName: \"kubernetes.io/projected/d6b8e781-daf6-4a98-b498-876b6abf3f45-kube-api-access-989r8\") pod \"network-check-source-6f8b768455-5lhhq\" (UID: \"d6b8e781-daf6-4a98-b498-876b6abf3f45\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-5lhhq"
Sep 11 03:54:04.788998 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.788866    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/42222ece-7ddd-483e-8ca8-934910a8fa25-default-certificate\") pod \"router-default-78556b97cb-rt5r7\" (UID: \"42222ece-7ddd-483e-8ca8-934910a8fa25\") " pod="openshift-ingress/router-default-78556b97cb-rt5r7"
Sep 11 03:54:04.788998 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.788905    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/42222ece-7ddd-483e-8ca8-934910a8fa25-stats-auth\") pod \"router-default-78556b97cb-rt5r7\" (UID: \"42222ece-7ddd-483e-8ca8-934910a8fa25\") " pod="openshift-ingress/router-default-78556b97cb-rt5r7"
Sep 11 03:54:04.789220 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.789012    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7afc68c1-54e3-4f06-8dcd-184a06388ccf-metrics-tls\") pod \"dns-default-jcsgz\" (UID: \"7afc68c1-54e3-4f06-8dcd-184a06388ccf\") " pod="openshift-dns/dns-default-jcsgz"
Sep 11 03:54:04.789220 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.789075    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1c58ba3e-9104-492b-88d9-9f4abdee2c03-trusted-ca\") pod \"image-registry-5cfcb599d4-jzm8b\" (UID: \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\") " pod="openshift-image-registry/image-registry-5cfcb599d4-jzm8b"
Sep 11 03:54:04.789220 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:04.789095    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 03:54:04.789220 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.789127    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1c58ba3e-9104-492b-88d9-9f4abdee2c03-ca-trust-extracted\") pod \"image-registry-5cfcb599d4-jzm8b\" (UID: \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\") " pod="openshift-image-registry/image-registry-5cfcb599d4-jzm8b"
Sep 11 03:54:04.789220 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:04.789154    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7afc68c1-54e3-4f06-8dcd-184a06388ccf-metrics-tls podName:7afc68c1-54e3-4f06-8dcd-184a06388ccf nodeName:}" failed. No retries permitted until 2026-09-11 03:54:12.78913653 +0000 UTC m=+49.587226252 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7afc68c1-54e3-4f06-8dcd-184a06388ccf-metrics-tls") pod "dns-default-jcsgz" (UID: "7afc68c1-54e3-4f06-8dcd-184a06388ccf") : secret "dns-default-metrics-tls" not found
Sep 11 03:54:04.789220 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.789181    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1c58ba3e-9104-492b-88d9-9f4abdee2c03-registry-certificates\") pod \"image-registry-5cfcb599d4-jzm8b\" (UID: \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\") " pod="openshift-image-registry/image-registry-5cfcb599d4-jzm8b"
Sep 11 03:54:04.789519 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.789500    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1c58ba3e-9104-492b-88d9-9f4abdee2c03-ca-trust-extracted\") pod \"image-registry-5cfcb599d4-jzm8b\" (UID: \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\") " pod="openshift-image-registry/image-registry-5cfcb599d4-jzm8b"
Sep 11 03:54:04.789931 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.789909    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1c58ba3e-9104-492b-88d9-9f4abdee2c03-trusted-ca\") pod \"image-registry-5cfcb599d4-jzm8b\" (UID: \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\") " pod="openshift-image-registry/image-registry-5cfcb599d4-jzm8b"
Sep 11 03:54:04.791996 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.791970    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1c58ba3e-9104-492b-88d9-9f4abdee2c03-installation-pull-secrets\") pod \"image-registry-5cfcb599d4-jzm8b\" (UID: \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\") " pod="openshift-image-registry/image-registry-5cfcb599d4-jzm8b"
Sep 11 03:54:04.792120 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.792098    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1c58ba3e-9104-492b-88d9-9f4abdee2c03-image-registry-private-configuration\") pod \"image-registry-5cfcb599d4-jzm8b\" (UID: \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\") " pod="openshift-image-registry/image-registry-5cfcb599d4-jzm8b"
Sep 11 03:54:04.800616 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.800595    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-h76wv"]
Sep 11 03:54:04.800715 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.800697    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4z8c9"
Sep 11 03:54:04.803865 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.803495    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 11 03:54:04.803865 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.803718    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-bnr7k\""
Sep 11 03:54:04.803865 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.803741    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 11 03:54:04.804091 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.803884    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 11 03:54:04.804091 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.803890    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 11 03:54:04.805588 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.805567    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1c58ba3e-9104-492b-88d9-9f4abdee2c03-bound-sa-token\") pod \"image-registry-5cfcb599d4-jzm8b\" (UID: \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\") " pod="openshift-image-registry/image-registry-5cfcb599d4-jzm8b"
Sep 11 03:54:04.805685 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.805598    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x84p\" (UniqueName: \"kubernetes.io/projected/1c58ba3e-9104-492b-88d9-9f4abdee2c03-kube-api-access-2x84p\") pod \"image-registry-5cfcb599d4-jzm8b\" (UID: \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\") " pod="openshift-image-registry/image-registry-5cfcb599d4-jzm8b"
Sep 11 03:54:04.834966 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.834901    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-4z8c9"]
Sep 11 03:54:04.834966 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.834942    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-h76wv"]
Sep 11 03:54:04.835099 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.835008    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-h76wv"
Sep 11 03:54:04.837560 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.837542    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 11 03:54:04.837718 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.837704    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 11 03:54:04.837850 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.837834    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-djzsb\""
Sep 11 03:54:04.890148 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.890112    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tk29\" (UniqueName: \"kubernetes.io/projected/3edf877a-83ca-403f-a8f2-68e71b208eb4-kube-api-access-4tk29\") pod \"service-ca-operator-cf7c776b7-4z8c9\" (UID: \"3edf877a-83ca-403f-a8f2-68e71b208eb4\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4z8c9"
Sep 11 03:54:04.890148 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.890152    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/42222ece-7ddd-483e-8ca8-934910a8fa25-default-certificate\") pod \"router-default-78556b97cb-rt5r7\" (UID: \"42222ece-7ddd-483e-8ca8-934910a8fa25\") " pod="openshift-ingress/router-default-78556b97cb-rt5r7"
Sep 11 03:54:04.890374 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.890172    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/42222ece-7ddd-483e-8ca8-934910a8fa25-stats-auth\") pod \"router-default-78556b97cb-rt5r7\" (UID: \"42222ece-7ddd-483e-8ca8-934910a8fa25\") " pod="openshift-ingress/router-default-78556b97cb-rt5r7"
Sep 11 03:54:04.890374 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.890301    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3edf877a-83ca-403f-a8f2-68e71b208eb4-config\") pod \"service-ca-operator-cf7c776b7-4z8c9\" (UID: \"3edf877a-83ca-403f-a8f2-68e71b208eb4\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4z8c9"
Sep 11 03:54:04.890480 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.890374    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3edf877a-83ca-403f-a8f2-68e71b208eb4-serving-cert\") pod \"service-ca-operator-cf7c776b7-4z8c9\" (UID: \"3edf877a-83ca-403f-a8f2-68e71b208eb4\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4z8c9"
Sep 11 03:54:04.890536 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.890514    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42222ece-7ddd-483e-8ca8-934910a8fa25-metrics-certs\") pod \"router-default-78556b97cb-rt5r7\" (UID: \"42222ece-7ddd-483e-8ca8-934910a8fa25\") " pod="openshift-ingress/router-default-78556b97cb-rt5r7"
Sep 11 03:54:04.890584 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.890556    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz6rn\" (UniqueName: \"kubernetes.io/projected/42222ece-7ddd-483e-8ca8-934910a8fa25-kube-api-access-qz6rn\") pod \"router-default-78556b97cb-rt5r7\" (UID: \"42222ece-7ddd-483e-8ca8-934910a8fa25\") " pod="openshift-ingress/router-default-78556b97cb-rt5r7"
Sep 11 03:54:04.890622 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.890583    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/53d1b221-40dd-4507-b81a-4af75f45efaf-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-lm5hf\" (UID: \"53d1b221-40dd-4507-b81a-4af75f45efaf\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lm5hf"
Sep 11 03:54:04.890622 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.890614    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42222ece-7ddd-483e-8ca8-934910a8fa25-service-ca-bundle\") pod \"router-default-78556b97cb-rt5r7\" (UID: \"42222ece-7ddd-483e-8ca8-934910a8fa25\") " pod="openshift-ingress/router-default-78556b97cb-rt5r7"
Sep 11 03:54:04.890715 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.890638    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53d1b221-40dd-4507-b81a-4af75f45efaf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-lm5hf\" (UID: \"53d1b221-40dd-4507-b81a-4af75f45efaf\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lm5hf"
Sep 11 03:54:04.890715 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.890654    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcksd\" (UniqueName: \"kubernetes.io/projected/53d1b221-40dd-4507-b81a-4af75f45efaf-kube-api-access-wcksd\") pod \"cluster-monitoring-operator-6cd954b897-lm5hf\" (UID: \"53d1b221-40dd-4507-b81a-4af75f45efaf\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lm5hf"
Sep 11 03:54:04.890715 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:04.890659    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 03:54:04.890715 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.890679    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-989r8\" (UniqueName: \"kubernetes.io/projected/d6b8e781-daf6-4a98-b498-876b6abf3f45-kube-api-access-989r8\") pod \"network-check-source-6f8b768455-5lhhq\" (UID: \"d6b8e781-daf6-4a98-b498-876b6abf3f45\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-5lhhq"
Sep 11 03:54:04.890715 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:04.890717    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42222ece-7ddd-483e-8ca8-934910a8fa25-metrics-certs podName:42222ece-7ddd-483e-8ca8-934910a8fa25 nodeName:}" failed. No retries permitted until 2026-09-11 03:54:05.390698743 +0000 UTC m=+42.188788448 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42222ece-7ddd-483e-8ca8-934910a8fa25-metrics-certs") pod "router-default-78556b97cb-rt5r7" (UID: "42222ece-7ddd-483e-8ca8-934910a8fa25") : secret "router-metrics-certs-default" not found
Sep 11 03:54:04.890964 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:04.890936    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/42222ece-7ddd-483e-8ca8-934910a8fa25-service-ca-bundle podName:42222ece-7ddd-483e-8ca8-934910a8fa25 nodeName:}" failed. No retries permitted until 2026-09-11 03:54:05.390917671 +0000 UTC m=+42.189007398 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/42222ece-7ddd-483e-8ca8-934910a8fa25-service-ca-bundle") pod "router-default-78556b97cb-rt5r7" (UID: "42222ece-7ddd-483e-8ca8-934910a8fa25") : configmap references non-existent config key: service-ca.crt
Sep 11 03:54:04.890964 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:04.890943    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 03:54:04.891069 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:04.891004    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53d1b221-40dd-4507-b81a-4af75f45efaf-cluster-monitoring-operator-tls podName:53d1b221-40dd-4507-b81a-4af75f45efaf nodeName:}" failed. No retries permitted until 2026-09-11 03:54:05.390986607 +0000 UTC m=+42.189076313 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/53d1b221-40dd-4507-b81a-4af75f45efaf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-lm5hf" (UID: "53d1b221-40dd-4507-b81a-4af75f45efaf") : secret "cluster-monitoring-operator-tls" not found
Sep 11 03:54:04.891782 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.891761    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/53d1b221-40dd-4507-b81a-4af75f45efaf-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-lm5hf\" (UID: \"53d1b221-40dd-4507-b81a-4af75f45efaf\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lm5hf"
Sep 11 03:54:04.892753 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.892728    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/42222ece-7ddd-483e-8ca8-934910a8fa25-default-certificate\") pod \"router-default-78556b97cb-rt5r7\" (UID: \"42222ece-7ddd-483e-8ca8-934910a8fa25\") " pod="openshift-ingress/router-default-78556b97cb-rt5r7"
Sep 11 03:54:04.892887 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.892788    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/42222ece-7ddd-483e-8ca8-934910a8fa25-stats-auth\") pod \"router-default-78556b97cb-rt5r7\" (UID: \"42222ece-7ddd-483e-8ca8-934910a8fa25\") " pod="openshift-ingress/router-default-78556b97cb-rt5r7"
Sep 11 03:54:04.906628 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.906598    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz6rn\" (UniqueName: \"kubernetes.io/projected/42222ece-7ddd-483e-8ca8-934910a8fa25-kube-api-access-qz6rn\") pod \"router-default-78556b97cb-rt5r7\" (UID: \"42222ece-7ddd-483e-8ca8-934910a8fa25\") " pod="openshift-ingress/router-default-78556b97cb-rt5r7"
Sep 11 03:54:04.908061 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.908043    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcksd\" (UniqueName: \"kubernetes.io/projected/53d1b221-40dd-4507-b81a-4af75f45efaf-kube-api-access-wcksd\") pod \"cluster-monitoring-operator-6cd954b897-lm5hf\" (UID: \"53d1b221-40dd-4507-b81a-4af75f45efaf\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lm5hf"
Sep 11 03:54:04.908465 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.908449    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-989r8\" (UniqueName: \"kubernetes.io/projected/d6b8e781-daf6-4a98-b498-876b6abf3f45-kube-api-access-989r8\") pod \"network-check-source-6f8b768455-5lhhq\" (UID: \"d6b8e781-daf6-4a98-b498-876b6abf3f45\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-5lhhq"
Sep 11 03:54:04.991894 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.991857    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tk29\" (UniqueName: \"kubernetes.io/projected/3edf877a-83ca-403f-a8f2-68e71b208eb4-kube-api-access-4tk29\") pod \"service-ca-operator-cf7c776b7-4z8c9\" (UID: \"3edf877a-83ca-403f-a8f2-68e71b208eb4\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4z8c9"
Sep 11 03:54:04.991894 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.991898    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/73868425-41c2-4554-aef0-2528200edc9d-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-h76wv\" (UID: \"73868425-41c2-4554-aef0-2528200edc9d\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-h76wv"
Sep 11 03:54:04.992103 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.991915    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/73868425-41c2-4554-aef0-2528200edc9d-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-h76wv\" (UID: \"73868425-41c2-4554-aef0-2528200edc9d\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-h76wv"
Sep 11 03:54:04.992103 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.991960    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3edf877a-83ca-403f-a8f2-68e71b208eb4-config\") pod \"service-ca-operator-cf7c776b7-4z8c9\" (UID: \"3edf877a-83ca-403f-a8f2-68e71b208eb4\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4z8c9"
Sep 11 03:54:04.992103 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.991992    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3edf877a-83ca-403f-a8f2-68e71b208eb4-serving-cert\") pod \"service-ca-operator-cf7c776b7-4z8c9\" (UID: \"3edf877a-83ca-403f-a8f2-68e71b208eb4\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4z8c9"
Sep 11 03:54:04.992462 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.992434    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3edf877a-83ca-403f-a8f2-68e71b208eb4-config\") pod \"service-ca-operator-cf7c776b7-4z8c9\" (UID: \"3edf877a-83ca-403f-a8f2-68e71b208eb4\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4z8c9"
Sep 11 03:54:04.994126 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:04.994108    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3edf877a-83ca-403f-a8f2-68e71b208eb4-serving-cert\") pod \"service-ca-operator-cf7c776b7-4z8c9\" (UID: \"3edf877a-83ca-403f-a8f2-68e71b208eb4\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4z8c9"
Sep 11 03:54:05.002113 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:05.002095    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tk29\" (UniqueName: \"kubernetes.io/projected/3edf877a-83ca-403f-a8f2-68e71b208eb4-kube-api-access-4tk29\") pod \"service-ca-operator-cf7c776b7-4z8c9\" (UID: \"3edf877a-83ca-403f-a8f2-68e71b208eb4\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4z8c9"
Sep 11 03:54:05.003980 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:05.003967    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-5lhhq"
Sep 11 03:54:05.093970 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:05.093787    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/73868425-41c2-4554-aef0-2528200edc9d-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-h76wv\" (UID: \"73868425-41c2-4554-aef0-2528200edc9d\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-h76wv"
Sep 11 03:54:05.093970 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:05.093832    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/73868425-41c2-4554-aef0-2528200edc9d-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-h76wv\" (UID: \"73868425-41c2-4554-aef0-2528200edc9d\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-h76wv"
Sep 11 03:54:05.094154 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:05.093997    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 03:54:05.094154 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:05.094072    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73868425-41c2-4554-aef0-2528200edc9d-networking-console-plugin-cert podName:73868425-41c2-4554-aef0-2528200edc9d nodeName:}" failed. No retries permitted until 2026-09-11 03:54:05.594052367 +0000 UTC m=+42.392142075 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/73868425-41c2-4554-aef0-2528200edc9d-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-h76wv" (UID: "73868425-41c2-4554-aef0-2528200edc9d") : secret "networking-console-plugin-cert" not found
Sep 11 03:54:05.094971 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:05.094952    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/73868425-41c2-4554-aef0-2528200edc9d-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-h76wv\" (UID: \"73868425-41c2-4554-aef0-2528200edc9d\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-h76wv"
Sep 11 03:54:05.116420 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:05.116362    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4z8c9"
Sep 11 03:54:05.296136 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:05.296100    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c58ba3e-9104-492b-88d9-9f4abdee2c03-registry-tls\") pod \"image-registry-5cfcb599d4-jzm8b\" (UID: \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\") " pod="openshift-image-registry/image-registry-5cfcb599d4-jzm8b"
Sep 11 03:54:05.296297 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:05.296271    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 03:54:05.296297 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:05.296291    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cfcb599d4-jzm8b: secret "image-registry-tls" not found
Sep 11 03:54:05.296469 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:05.296347    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c58ba3e-9104-492b-88d9-9f4abdee2c03-registry-tls podName:1c58ba3e-9104-492b-88d9-9f4abdee2c03 nodeName:}" failed. No retries permitted until 2026-09-11 03:54:06.29633279 +0000 UTC m=+43.094422499 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1c58ba3e-9104-492b-88d9-9f4abdee2c03-registry-tls") pod "image-registry-5cfcb599d4-jzm8b" (UID: "1c58ba3e-9104-492b-88d9-9f4abdee2c03") : secret "image-registry-tls" not found
Sep 11 03:54:05.298137 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:05.298105    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-5lhhq"]
Sep 11 03:54:05.300669 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:54:05.300650    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6b8e781_daf6_4a98_b498_876b6abf3f45.slice/crio-6441a1668ac6c56caacc216f54c626a497225be252632fe766258b4baa119a2b WatchSource:0}: Error finding container 6441a1668ac6c56caacc216f54c626a497225be252632fe766258b4baa119a2b: Status 404 returned error can't find the container with id 6441a1668ac6c56caacc216f54c626a497225be252632fe766258b4baa119a2b
Sep 11 03:54:05.397178 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:05.397102    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42222ece-7ddd-483e-8ca8-934910a8fa25-service-ca-bundle\") pod \"router-default-78556b97cb-rt5r7\" (UID: \"42222ece-7ddd-483e-8ca8-934910a8fa25\") " pod="openshift-ingress/router-default-78556b97cb-rt5r7"
Sep 11 03:54:05.397178 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:05.397142    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53d1b221-40dd-4507-b81a-4af75f45efaf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-lm5hf\" (UID: \"53d1b221-40dd-4507-b81a-4af75f45efaf\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lm5hf"
Sep 11 03:54:05.397332 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:05.397250    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42222ece-7ddd-483e-8ca8-934910a8fa25-metrics-certs\") pod \"router-default-78556b97cb-rt5r7\" (UID: \"42222ece-7ddd-483e-8ca8-934910a8fa25\") " pod="openshift-ingress/router-default-78556b97cb-rt5r7"
Sep 11 03:54:05.397332 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:05.397282    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/42222ece-7ddd-483e-8ca8-934910a8fa25-service-ca-bundle podName:42222ece-7ddd-483e-8ca8-934910a8fa25 nodeName:}" failed. No retries permitted until 2026-09-11 03:54:06.397263384 +0000 UTC m=+43.195353106 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/42222ece-7ddd-483e-8ca8-934910a8fa25-service-ca-bundle") pod "router-default-78556b97cb-rt5r7" (UID: "42222ece-7ddd-483e-8ca8-934910a8fa25") : configmap references non-existent config key: service-ca.crt
Sep 11 03:54:05.397332 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:05.397308    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 03:54:05.397332 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:05.397331    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 03:54:05.397494 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:05.397363    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53d1b221-40dd-4507-b81a-4af75f45efaf-cluster-monitoring-operator-tls podName:53d1b221-40dd-4507-b81a-4af75f45efaf nodeName:}" failed. No retries permitted until 2026-09-11 03:54:06.397350195 +0000 UTC m=+43.195439924 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/53d1b221-40dd-4507-b81a-4af75f45efaf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-lm5hf" (UID: "53d1b221-40dd-4507-b81a-4af75f45efaf") : secret "cluster-monitoring-operator-tls" not found
Sep 11 03:54:05.397494 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:05.397378    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42222ece-7ddd-483e-8ca8-934910a8fa25-metrics-certs podName:42222ece-7ddd-483e-8ca8-934910a8fa25 nodeName:}" failed. No retries permitted until 2026-09-11 03:54:06.397370791 +0000 UTC m=+43.195460496 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42222ece-7ddd-483e-8ca8-934910a8fa25-metrics-certs") pod "router-default-78556b97cb-rt5r7" (UID: "42222ece-7ddd-483e-8ca8-934910a8fa25") : secret "router-metrics-certs-default" not found
Sep 11 03:54:05.411164 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:05.411139    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-4z8c9"]
Sep 11 03:54:05.413845 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:54:05.413827    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3edf877a_83ca_403f_a8f2_68e71b208eb4.slice/crio-b6818d4ed4fe26f08309e6e125ad11316ec496ffc6bbd823f2990c8aafea5ef8 WatchSource:0}: Error finding container b6818d4ed4fe26f08309e6e125ad11316ec496ffc6bbd823f2990c8aafea5ef8: Status 404 returned error can't find the container with id b6818d4ed4fe26f08309e6e125ad11316ec496ffc6bbd823f2990c8aafea5ef8
Sep 11 03:54:05.598873 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:05.598835    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/73868425-41c2-4554-aef0-2528200edc9d-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-h76wv\" (UID: \"73868425-41c2-4554-aef0-2528200edc9d\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-h76wv"
Sep 11 03:54:05.599247 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:05.598990    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 03:54:05.599247 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:05.599058    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73868425-41c2-4554-aef0-2528200edc9d-networking-console-plugin-cert podName:73868425-41c2-4554-aef0-2528200edc9d nodeName:}" failed. No retries permitted until 2026-09-11 03:54:06.599040794 +0000 UTC m=+43.397130511 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/73868425-41c2-4554-aef0-2528200edc9d-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-h76wv" (UID: "73868425-41c2-4554-aef0-2528200edc9d") : secret "networking-console-plugin-cert" not found
Sep 11 03:54:06.122271 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:06.122228    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4z8c9" event={"ID":"3edf877a-83ca-403f-a8f2-68e71b208eb4","Type":"ContainerStarted","Data":"b6818d4ed4fe26f08309e6e125ad11316ec496ffc6bbd823f2990c8aafea5ef8"}
Sep 11 03:54:06.123785 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:06.123742    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-5lhhq" event={"ID":"d6b8e781-daf6-4a98-b498-876b6abf3f45","Type":"ContainerStarted","Data":"6441a1668ac6c56caacc216f54c626a497225be252632fe766258b4baa119a2b"}
Sep 11 03:54:06.304320 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:06.304283    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c58ba3e-9104-492b-88d9-9f4abdee2c03-registry-tls\") pod \"image-registry-5cfcb599d4-jzm8b\" (UID: \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\") " pod="openshift-image-registry/image-registry-5cfcb599d4-jzm8b"
Sep 11 03:54:06.304543 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:06.304519    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 03:54:06.304615 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:06.304546    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cfcb599d4-jzm8b: secret "image-registry-tls" not found
Sep 11 03:54:06.304615 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:06.304612    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c58ba3e-9104-492b-88d9-9f4abdee2c03-registry-tls podName:1c58ba3e-9104-492b-88d9-9f4abdee2c03 nodeName:}" failed. No retries permitted until 2026-09-11 03:54:08.304592661 +0000 UTC m=+45.102682383 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1c58ba3e-9104-492b-88d9-9f4abdee2c03-registry-tls") pod "image-registry-5cfcb599d4-jzm8b" (UID: "1c58ba3e-9104-492b-88d9-9f4abdee2c03") : secret "image-registry-tls" not found
Sep 11 03:54:06.404896 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:06.404817    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42222ece-7ddd-483e-8ca8-934910a8fa25-metrics-certs\") pod \"router-default-78556b97cb-rt5r7\" (UID: \"42222ece-7ddd-483e-8ca8-934910a8fa25\") " pod="openshift-ingress/router-default-78556b97cb-rt5r7"
Sep 11 03:54:06.404896 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:06.404853    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42222ece-7ddd-483e-8ca8-934910a8fa25-service-ca-bundle\") pod \"router-default-78556b97cb-rt5r7\" (UID: \"42222ece-7ddd-483e-8ca8-934910a8fa25\") " pod="openshift-ingress/router-default-78556b97cb-rt5r7"
Sep 11 03:54:06.404896 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:06.404879    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53d1b221-40dd-4507-b81a-4af75f45efaf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-lm5hf\" (UID: \"53d1b221-40dd-4507-b81a-4af75f45efaf\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lm5hf"
Sep 11 03:54:06.405143 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:06.404999    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 03:54:06.405143 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:06.405010    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/42222ece-7ddd-483e-8ca8-934910a8fa25-service-ca-bundle podName:42222ece-7ddd-483e-8ca8-934910a8fa25 nodeName:}" failed. No retries permitted until 2026-09-11 03:54:08.404991136 +0000 UTC m=+45.203080860 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/42222ece-7ddd-483e-8ca8-934910a8fa25-service-ca-bundle") pod "router-default-78556b97cb-rt5r7" (UID: "42222ece-7ddd-483e-8ca8-934910a8fa25") : configmap references non-existent config key: service-ca.crt
Sep 11 03:54:06.405143 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:06.405054    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 03:54:06.405143 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:06.405062    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53d1b221-40dd-4507-b81a-4af75f45efaf-cluster-monitoring-operator-tls podName:53d1b221-40dd-4507-b81a-4af75f45efaf nodeName:}" failed. No retries permitted until 2026-09-11 03:54:08.405049681 +0000 UTC m=+45.203139395 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/53d1b221-40dd-4507-b81a-4af75f45efaf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-lm5hf" (UID: "53d1b221-40dd-4507-b81a-4af75f45efaf") : secret "cluster-monitoring-operator-tls" not found
Sep 11 03:54:06.405143 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:06.405118    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42222ece-7ddd-483e-8ca8-934910a8fa25-metrics-certs podName:42222ece-7ddd-483e-8ca8-934910a8fa25 nodeName:}" failed. No retries permitted until 2026-09-11 03:54:08.405105641 +0000 UTC m=+45.203195363 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42222ece-7ddd-483e-8ca8-934910a8fa25-metrics-certs") pod "router-default-78556b97cb-rt5r7" (UID: "42222ece-7ddd-483e-8ca8-934910a8fa25") : secret "router-metrics-certs-default" not found
Sep 11 03:54:06.606116 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:06.606085    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/73868425-41c2-4554-aef0-2528200edc9d-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-h76wv\" (UID: \"73868425-41c2-4554-aef0-2528200edc9d\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-h76wv"
Sep 11 03:54:06.606544 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:06.606234    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 03:54:06.606544 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:06.606304    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73868425-41c2-4554-aef0-2528200edc9d-networking-console-plugin-cert podName:73868425-41c2-4554-aef0-2528200edc9d nodeName:}" failed. No retries permitted until 2026-09-11 03:54:08.606284622 +0000 UTC m=+45.404374340 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/73868425-41c2-4554-aef0-2528200edc9d-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-h76wv" (UID: "73868425-41c2-4554-aef0-2528200edc9d") : secret "networking-console-plugin-cert" not found
Sep 11 03:54:08.319506 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:08.319476    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c58ba3e-9104-492b-88d9-9f4abdee2c03-registry-tls\") pod \"image-registry-5cfcb599d4-jzm8b\" (UID: \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\") " pod="openshift-image-registry/image-registry-5cfcb599d4-jzm8b"
Sep 11 03:54:08.319954 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:08.319597    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 03:54:08.319954 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:08.319609    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cfcb599d4-jzm8b: secret "image-registry-tls" not found
Sep 11 03:54:08.319954 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:08.319657    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c58ba3e-9104-492b-88d9-9f4abdee2c03-registry-tls podName:1c58ba3e-9104-492b-88d9-9f4abdee2c03 nodeName:}" failed. No retries permitted until 2026-09-11 03:54:12.319643639 +0000 UTC m=+49.117733358 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1c58ba3e-9104-492b-88d9-9f4abdee2c03-registry-tls") pod "image-registry-5cfcb599d4-jzm8b" (UID: "1c58ba3e-9104-492b-88d9-9f4abdee2c03") : secret "image-registry-tls" not found
Sep 11 03:54:08.420231 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:08.420194    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42222ece-7ddd-483e-8ca8-934910a8fa25-metrics-certs\") pod \"router-default-78556b97cb-rt5r7\" (UID: \"42222ece-7ddd-483e-8ca8-934910a8fa25\") " pod="openshift-ingress/router-default-78556b97cb-rt5r7"
Sep 11 03:54:08.420427 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:08.420245    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42222ece-7ddd-483e-8ca8-934910a8fa25-service-ca-bundle\") pod \"router-default-78556b97cb-rt5r7\" (UID: \"42222ece-7ddd-483e-8ca8-934910a8fa25\") " pod="openshift-ingress/router-default-78556b97cb-rt5r7"
Sep 11 03:54:08.420427 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:08.420358    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 03:54:08.420427 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:08.420379    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53d1b221-40dd-4507-b81a-4af75f45efaf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-lm5hf\" (UID: \"53d1b221-40dd-4507-b81a-4af75f45efaf\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lm5hf"
Sep 11 03:54:08.420590 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:08.420441    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42222ece-7ddd-483e-8ca8-934910a8fa25-metrics-certs podName:42222ece-7ddd-483e-8ca8-934910a8fa25 nodeName:}" failed. No retries permitted until 2026-09-11 03:54:12.420420851 +0000 UTC m=+49.218510559 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42222ece-7ddd-483e-8ca8-934910a8fa25-metrics-certs") pod "router-default-78556b97cb-rt5r7" (UID: "42222ece-7ddd-483e-8ca8-934910a8fa25") : secret "router-metrics-certs-default" not found
Sep 11 03:54:08.420590 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:08.420449    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 03:54:08.420590 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:08.420469    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/42222ece-7ddd-483e-8ca8-934910a8fa25-service-ca-bundle podName:42222ece-7ddd-483e-8ca8-934910a8fa25 nodeName:}" failed. No retries permitted until 2026-09-11 03:54:12.420459528 +0000 UTC m=+49.218549233 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/42222ece-7ddd-483e-8ca8-934910a8fa25-service-ca-bundle") pod "router-default-78556b97cb-rt5r7" (UID: "42222ece-7ddd-483e-8ca8-934910a8fa25") : configmap references non-existent config key: service-ca.crt
Sep 11 03:54:08.420590 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:08.420493    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53d1b221-40dd-4507-b81a-4af75f45efaf-cluster-monitoring-operator-tls podName:53d1b221-40dd-4507-b81a-4af75f45efaf nodeName:}" failed. No retries permitted until 2026-09-11 03:54:12.420477621 +0000 UTC m=+49.218567340 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/53d1b221-40dd-4507-b81a-4af75f45efaf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-lm5hf" (UID: "53d1b221-40dd-4507-b81a-4af75f45efaf") : secret "cluster-monitoring-operator-tls" not found
Sep 11 03:54:08.622264 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:08.622176    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/73868425-41c2-4554-aef0-2528200edc9d-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-h76wv\" (UID: \"73868425-41c2-4554-aef0-2528200edc9d\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-h76wv"
Sep 11 03:54:08.622459 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:08.622343    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 03:54:08.622459 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:08.622438    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73868425-41c2-4554-aef0-2528200edc9d-networking-console-plugin-cert podName:73868425-41c2-4554-aef0-2528200edc9d nodeName:}" failed. No retries permitted until 2026-09-11 03:54:12.622419204 +0000 UTC m=+49.420508924 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/73868425-41c2-4554-aef0-2528200edc9d-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-h76wv" (UID: "73868425-41c2-4554-aef0-2528200edc9d") : secret "networking-console-plugin-cert" not found
Sep 11 03:54:09.133610 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:09.133576    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4z8c9" event={"ID":"3edf877a-83ca-403f-a8f2-68e71b208eb4","Type":"ContainerStarted","Data":"7eb79193f31638bd0c0a675eb728e1c1f8375962899be023e4b24a079843616a"}
Sep 11 03:54:09.135761 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:09.135642    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-5lhhq" event={"ID":"d6b8e781-daf6-4a98-b498-876b6abf3f45","Type":"ContainerStarted","Data":"4eb997817d5033c72abef60bad1f256078aaae22c1f1b07ac7a91b85822693f3"}
Sep 11 03:54:09.150311 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:09.150254    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4z8c9" podStartSLOduration=1.5562095120000001 podStartE2EDuration="5.150234583s" totalImagesPullingTime="3.594025071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:54:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:54:09.148092788 +0000 UTC m=+45.946182517" watchObservedRunningTime="2026-09-11 03:54:09.150234583 +0000 UTC m=+45.948324315"
Sep 11 03:54:09.162031 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:09.161982    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-5lhhq" podStartSLOduration=1.445195024 podStartE2EDuration="5.161968985s" totalImagesPullingTime="3.716773961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:54:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:54:09.161734837 +0000 UTC m=+45.959824564" watchObservedRunningTime="2026-09-11 03:54:09.161968985 +0000 UTC m=+45.960058714"
Sep 11 03:54:09.252605 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:09.252551    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rzpgp"]
Sep 11 03:54:09.266995 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:09.266945    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rzpgp"]
Sep 11 03:54:09.267161 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:09.267142    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rzpgp"
Sep 11 03:54:09.269733 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:09.269706    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 03:54:09.269733 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:09.269728    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xkdhm\""
Sep 11 03:54:09.269895 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:09.269712    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 03:54:09.270046 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:09.270030    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 03:54:09.270137 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:09.270061    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 03:54:09.429189 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:09.429163    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/98be0e97-3076-42f5-be44-71b25c72f0ba-data-volume\") pod \"insights-runtime-extractor-rzpgp\" (UID: \"98be0e97-3076-42f5-be44-71b25c72f0ba\") " pod="openshift-insights/insights-runtime-extractor-rzpgp"
Sep 11 03:54:09.429549 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:09.429193    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98be0e97-3076-42f5-be44-71b25c72f0ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rzpgp\" (UID: \"98be0e97-3076-42f5-be44-71b25c72f0ba\") " pod="openshift-insights/insights-runtime-extractor-rzpgp"
Sep 11 03:54:09.429549 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:09.429215    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/98be0e97-3076-42f5-be44-71b25c72f0ba-crio-socket\") pod \"insights-runtime-extractor-rzpgp\" (UID: \"98be0e97-3076-42f5-be44-71b25c72f0ba\") " pod="openshift-insights/insights-runtime-extractor-rzpgp"
Sep 11 03:54:09.429549 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:09.429304    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98be0e97-3076-42f5-be44-71b25c72f0ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rzpgp\" (UID: \"98be0e97-3076-42f5-be44-71b25c72f0ba\") " pod="openshift-insights/insights-runtime-extractor-rzpgp"
Sep 11 03:54:09.429549 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:09.429411    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvdsc\" (UniqueName: \"kubernetes.io/projected/98be0e97-3076-42f5-be44-71b25c72f0ba-kube-api-access-wvdsc\") pod \"insights-runtime-extractor-rzpgp\" (UID: \"98be0e97-3076-42f5-be44-71b25c72f0ba\") " pod="openshift-insights/insights-runtime-extractor-rzpgp"
Sep 11 03:54:09.530545 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:09.530495    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvdsc\" (UniqueName: \"kubernetes.io/projected/98be0e97-3076-42f5-be44-71b25c72f0ba-kube-api-access-wvdsc\") pod \"insights-runtime-extractor-rzpgp\" (UID: \"98be0e97-3076-42f5-be44-71b25c72f0ba\") " pod="openshift-insights/insights-runtime-extractor-rzpgp"
Sep 11 03:54:09.530545 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:09.530538    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/98be0e97-3076-42f5-be44-71b25c72f0ba-data-volume\") pod \"insights-runtime-extractor-rzpgp\" (UID: \"98be0e97-3076-42f5-be44-71b25c72f0ba\") " pod="openshift-insights/insights-runtime-extractor-rzpgp"
Sep 11 03:54:09.530697 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:09.530563    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98be0e97-3076-42f5-be44-71b25c72f0ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rzpgp\" (UID: \"98be0e97-3076-42f5-be44-71b25c72f0ba\") " pod="openshift-insights/insights-runtime-extractor-rzpgp"
Sep 11 03:54:09.530697 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:09.530639    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 03:54:09.530697 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:09.530685    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/98be0e97-3076-42f5-be44-71b25c72f0ba-crio-socket\") pod \"insights-runtime-extractor-rzpgp\" (UID: \"98be0e97-3076-42f5-be44-71b25c72f0ba\") " pod="openshift-insights/insights-runtime-extractor-rzpgp"
Sep 11 03:54:09.530697 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:09.530699    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/98be0e97-3076-42f5-be44-71b25c72f0ba-kube-rbac-proxy-cm podName:98be0e97-3076-42f5-be44-71b25c72f0ba nodeName:}" failed. No retries permitted until 2026-09-11 03:54:10.030681484 +0000 UTC m=+46.828771196 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/98be0e97-3076-42f5-be44-71b25c72f0ba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rzpgp" (UID: "98be0e97-3076-42f5-be44-71b25c72f0ba") : configmap "kube-rbac-proxy" not found
Sep 11 03:54:09.530910 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:09.530752    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98be0e97-3076-42f5-be44-71b25c72f0ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rzpgp\" (UID: \"98be0e97-3076-42f5-be44-71b25c72f0ba\") " pod="openshift-insights/insights-runtime-extractor-rzpgp"
Sep 11 03:54:09.530910 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:09.530845    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/98be0e97-3076-42f5-be44-71b25c72f0ba-crio-socket\") pod \"insights-runtime-extractor-rzpgp\" (UID: \"98be0e97-3076-42f5-be44-71b25c72f0ba\") " pod="openshift-insights/insights-runtime-extractor-rzpgp"
Sep 11 03:54:09.530910 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:09.530861    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/98be0e97-3076-42f5-be44-71b25c72f0ba-data-volume\") pod \"insights-runtime-extractor-rzpgp\" (UID: \"98be0e97-3076-42f5-be44-71b25c72f0ba\") " pod="openshift-insights/insights-runtime-extractor-rzpgp"
Sep 11 03:54:09.530910 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:09.530893    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 03:54:09.531035 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:09.530971    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98be0e97-3076-42f5-be44-71b25c72f0ba-insights-runtime-extractor-tls podName:98be0e97-3076-42f5-be44-71b25c72f0ba nodeName:}" failed. No retries permitted until 2026-09-11 03:54:10.030956558 +0000 UTC m=+46.829046270 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/98be0e97-3076-42f5-be44-71b25c72f0ba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rzpgp" (UID: "98be0e97-3076-42f5-be44-71b25c72f0ba") : secret "insights-runtime-extractor-tls" not found
Sep 11 03:54:09.538726 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:09.538701    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvdsc\" (UniqueName: \"kubernetes.io/projected/98be0e97-3076-42f5-be44-71b25c72f0ba-kube-api-access-wvdsc\") pod \"insights-runtime-extractor-rzpgp\" (UID: \"98be0e97-3076-42f5-be44-71b25c72f0ba\") " pod="openshift-insights/insights-runtime-extractor-rzpgp"
Sep 11 03:54:10.035381 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:10.035355    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98be0e97-3076-42f5-be44-71b25c72f0ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rzpgp\" (UID: \"98be0e97-3076-42f5-be44-71b25c72f0ba\") " pod="openshift-insights/insights-runtime-extractor-rzpgp"
Sep 11 03:54:10.035541 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:10.035477    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 03:54:10.035582 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:10.035544    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98be0e97-3076-42f5-be44-71b25c72f0ba-insights-runtime-extractor-tls podName:98be0e97-3076-42f5-be44-71b25c72f0ba nodeName:}" failed. No retries permitted until 2026-09-11 03:54:11.035528653 +0000 UTC m=+47.833618362 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/98be0e97-3076-42f5-be44-71b25c72f0ba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rzpgp" (UID: "98be0e97-3076-42f5-be44-71b25c72f0ba") : secret "insights-runtime-extractor-tls" not found
Sep 11 03:54:10.035582 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:10.035560    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98be0e97-3076-42f5-be44-71b25c72f0ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rzpgp\" (UID: \"98be0e97-3076-42f5-be44-71b25c72f0ba\") " pod="openshift-insights/insights-runtime-extractor-rzpgp"
Sep 11 03:54:10.035656 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:10.035625    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 03:54:10.035656 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:10.035648    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/98be0e97-3076-42f5-be44-71b25c72f0ba-kube-rbac-proxy-cm podName:98be0e97-3076-42f5-be44-71b25c72f0ba nodeName:}" failed. No retries permitted until 2026-09-11 03:54:11.035640654 +0000 UTC m=+47.833730359 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/98be0e97-3076-42f5-be44-71b25c72f0ba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rzpgp" (UID: "98be0e97-3076-42f5-be44-71b25c72f0ba") : configmap "kube-rbac-proxy" not found
Sep 11 03:54:10.602078 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:10.602047    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5k289_93264b23-0656-44f5-aa41-8626a42e1348/dns-node-resolver/0.log"
Sep 11 03:54:11.042831 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:11.042744    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98be0e97-3076-42f5-be44-71b25c72f0ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rzpgp\" (UID: \"98be0e97-3076-42f5-be44-71b25c72f0ba\") " pod="openshift-insights/insights-runtime-extractor-rzpgp"
Sep 11 03:54:11.042985 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:11.042860    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98be0e97-3076-42f5-be44-71b25c72f0ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rzpgp\" (UID: \"98be0e97-3076-42f5-be44-71b25c72f0ba\") " pod="openshift-insights/insights-runtime-extractor-rzpgp"
Sep 11 03:54:11.042985 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:11.042904    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 03:54:11.042985 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:11.042932    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 03:54:11.042985 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:11.042974    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98be0e97-3076-42f5-be44-71b25c72f0ba-insights-runtime-extractor-tls podName:98be0e97-3076-42f5-be44-71b25c72f0ba nodeName:}" failed. No retries permitted until 2026-09-11 03:54:13.042958877 +0000 UTC m=+49.841048595 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/98be0e97-3076-42f5-be44-71b25c72f0ba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rzpgp" (UID: "98be0e97-3076-42f5-be44-71b25c72f0ba") : secret "insights-runtime-extractor-tls" not found
Sep 11 03:54:11.043118 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:11.042990    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/98be0e97-3076-42f5-be44-71b25c72f0ba-kube-rbac-proxy-cm podName:98be0e97-3076-42f5-be44-71b25c72f0ba nodeName:}" failed. No retries permitted until 2026-09-11 03:54:13.042984516 +0000 UTC m=+49.841074222 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/98be0e97-3076-42f5-be44-71b25c72f0ba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rzpgp" (UID: "98be0e97-3076-42f5-be44-71b25c72f0ba") : configmap "kube-rbac-proxy" not found
Sep 11 03:54:11.601444 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:11.601414    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6rfcj_3a500433-7480-46a7-9c45-9a58866265c3/node-ca/0.log"
Sep 11 03:54:12.353058 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:12.353023    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c58ba3e-9104-492b-88d9-9f4abdee2c03-registry-tls\") pod \"image-registry-5cfcb599d4-jzm8b\" (UID: \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\") " pod="openshift-image-registry/image-registry-5cfcb599d4-jzm8b"
Sep 11 03:54:12.353554 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:12.353203    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 03:54:12.353554 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:12.353226    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cfcb599d4-jzm8b: secret "image-registry-tls" not found
Sep 11 03:54:12.353554 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:12.353312    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c58ba3e-9104-492b-88d9-9f4abdee2c03-registry-tls podName:1c58ba3e-9104-492b-88d9-9f4abdee2c03 nodeName:}" failed. No retries permitted until 2026-09-11 03:54:20.35329076 +0000 UTC m=+57.151380509 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1c58ba3e-9104-492b-88d9-9f4abdee2c03-registry-tls") pod "image-registry-5cfcb599d4-jzm8b" (UID: "1c58ba3e-9104-492b-88d9-9f4abdee2c03") : secret "image-registry-tls" not found
Sep 11 03:54:12.453645 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:12.453619    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42222ece-7ddd-483e-8ca8-934910a8fa25-service-ca-bundle\") pod \"router-default-78556b97cb-rt5r7\" (UID: \"42222ece-7ddd-483e-8ca8-934910a8fa25\") " pod="openshift-ingress/router-default-78556b97cb-rt5r7"
Sep 11 03:54:12.453796 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:12.453658    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53d1b221-40dd-4507-b81a-4af75f45efaf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-lm5hf\" (UID: \"53d1b221-40dd-4507-b81a-4af75f45efaf\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lm5hf"
Sep 11 03:54:12.453796 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:12.453764    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 03:54:12.453919 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:12.453767    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/42222ece-7ddd-483e-8ca8-934910a8fa25-service-ca-bundle podName:42222ece-7ddd-483e-8ca8-934910a8fa25 nodeName:}" failed. No retries permitted until 2026-09-11 03:54:20.453751846 +0000 UTC m=+57.251841550 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/42222ece-7ddd-483e-8ca8-934910a8fa25-service-ca-bundle") pod "router-default-78556b97cb-rt5r7" (UID: "42222ece-7ddd-483e-8ca8-934910a8fa25") : configmap references non-existent config key: service-ca.crt
Sep 11 03:54:12.453919 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:12.453848    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42222ece-7ddd-483e-8ca8-934910a8fa25-metrics-certs\") pod \"router-default-78556b97cb-rt5r7\" (UID: \"42222ece-7ddd-483e-8ca8-934910a8fa25\") " pod="openshift-ingress/router-default-78556b97cb-rt5r7"
Sep 11 03:54:12.454037 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:12.453924    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53d1b221-40dd-4507-b81a-4af75f45efaf-cluster-monitoring-operator-tls podName:53d1b221-40dd-4507-b81a-4af75f45efaf nodeName:}" failed. No retries permitted until 2026-09-11 03:54:20.453898244 +0000 UTC m=+57.251987976 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/53d1b221-40dd-4507-b81a-4af75f45efaf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-lm5hf" (UID: "53d1b221-40dd-4507-b81a-4af75f45efaf") : secret "cluster-monitoring-operator-tls" not found
Sep 11 03:54:12.454037 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:12.453955    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 03:54:12.454037 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:12.454007    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42222ece-7ddd-483e-8ca8-934910a8fa25-metrics-certs podName:42222ece-7ddd-483e-8ca8-934910a8fa25 nodeName:}" failed. No retries permitted until 2026-09-11 03:54:20.453992204 +0000 UTC m=+57.252081946 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42222ece-7ddd-483e-8ca8-934910a8fa25-metrics-certs") pod "router-default-78556b97cb-rt5r7" (UID: "42222ece-7ddd-483e-8ca8-934910a8fa25") : secret "router-metrics-certs-default" not found
Sep 11 03:54:12.601698 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:12.601667    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tfr46_57ce4512-0f2a-462f-bf95-6cd72f7f727b/serve-healthcheck-canary/0.log"
Sep 11 03:54:12.656703 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:12.656644    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/73868425-41c2-4554-aef0-2528200edc9d-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-h76wv\" (UID: \"73868425-41c2-4554-aef0-2528200edc9d\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-h76wv"
Sep 11 03:54:12.656806 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:12.656791    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 03:54:12.656861 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:12.656850    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73868425-41c2-4554-aef0-2528200edc9d-networking-console-plugin-cert podName:73868425-41c2-4554-aef0-2528200edc9d nodeName:}" failed. No retries permitted until 2026-09-11 03:54:20.656837527 +0000 UTC m=+57.454927236 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/73868425-41c2-4554-aef0-2528200edc9d-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-h76wv" (UID: "73868425-41c2-4554-aef0-2528200edc9d") : secret "networking-console-plugin-cert" not found
Sep 11 03:54:12.857834 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:12.857804    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7afc68c1-54e3-4f06-8dcd-184a06388ccf-metrics-tls\") pod \"dns-default-jcsgz\" (UID: \"7afc68c1-54e3-4f06-8dcd-184a06388ccf\") " pod="openshift-dns/dns-default-jcsgz"
Sep 11 03:54:12.857957 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:12.857942    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 03:54:12.858011 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:12.857998    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7afc68c1-54e3-4f06-8dcd-184a06388ccf-metrics-tls podName:7afc68c1-54e3-4f06-8dcd-184a06388ccf nodeName:}" failed. No retries permitted until 2026-09-11 03:54:28.857984937 +0000 UTC m=+65.656074686 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7afc68c1-54e3-4f06-8dcd-184a06388ccf-metrics-tls") pod "dns-default-jcsgz" (UID: "7afc68c1-54e3-4f06-8dcd-184a06388ccf") : secret "dns-default-metrics-tls" not found
Sep 11 03:54:13.059304 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:13.059244    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98be0e97-3076-42f5-be44-71b25c72f0ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rzpgp\" (UID: \"98be0e97-3076-42f5-be44-71b25c72f0ba\") " pod="openshift-insights/insights-runtime-extractor-rzpgp"
Sep 11 03:54:13.059304 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:13.059299    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98be0e97-3076-42f5-be44-71b25c72f0ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rzpgp\" (UID: \"98be0e97-3076-42f5-be44-71b25c72f0ba\") " pod="openshift-insights/insights-runtime-extractor-rzpgp"
Sep 11 03:54:13.059467 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:13.059362    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 03:54:13.059467 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:13.059374    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 03:54:13.059467 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:13.059440    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/98be0e97-3076-42f5-be44-71b25c72f0ba-kube-rbac-proxy-cm podName:98be0e97-3076-42f5-be44-71b25c72f0ba nodeName:}" failed. No retries permitted until 2026-09-11 03:54:17.059427003 +0000 UTC m=+53.857516708 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/98be0e97-3076-42f5-be44-71b25c72f0ba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rzpgp" (UID: "98be0e97-3076-42f5-be44-71b25c72f0ba") : configmap "kube-rbac-proxy" not found
Sep 11 03:54:13.059467 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:13.059458    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98be0e97-3076-42f5-be44-71b25c72f0ba-insights-runtime-extractor-tls podName:98be0e97-3076-42f5-be44-71b25c72f0ba nodeName:}" failed. No retries permitted until 2026-09-11 03:54:17.059451355 +0000 UTC m=+53.857541060 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/98be0e97-3076-42f5-be44-71b25c72f0ba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rzpgp" (UID: "98be0e97-3076-42f5-be44-71b25c72f0ba") : secret "insights-runtime-extractor-tls" not found
Sep 11 03:54:17.090739 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:17.090698    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98be0e97-3076-42f5-be44-71b25c72f0ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rzpgp\" (UID: \"98be0e97-3076-42f5-be44-71b25c72f0ba\") " pod="openshift-insights/insights-runtime-extractor-rzpgp"
Sep 11 03:54:17.091238 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:17.090829    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98be0e97-3076-42f5-be44-71b25c72f0ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rzpgp\" (UID: \"98be0e97-3076-42f5-be44-71b25c72f0ba\") " pod="openshift-insights/insights-runtime-extractor-rzpgp"
Sep 11 03:54:17.091238 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:17.090855    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 03:54:17.091238 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:17.090909    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 03:54:17.091238 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:17.090928    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98be0e97-3076-42f5-be44-71b25c72f0ba-insights-runtime-extractor-tls podName:98be0e97-3076-42f5-be44-71b25c72f0ba nodeName:}" failed. No retries permitted until 2026-09-11 03:54:25.090910857 +0000 UTC m=+61.889000617 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/98be0e97-3076-42f5-be44-71b25c72f0ba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rzpgp" (UID: "98be0e97-3076-42f5-be44-71b25c72f0ba") : secret "insights-runtime-extractor-tls" not found
Sep 11 03:54:17.091238 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:17.090974    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/98be0e97-3076-42f5-be44-71b25c72f0ba-kube-rbac-proxy-cm podName:98be0e97-3076-42f5-be44-71b25c72f0ba nodeName:}" failed. No retries permitted until 2026-09-11 03:54:25.090952243 +0000 UTC m=+61.889041948 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/98be0e97-3076-42f5-be44-71b25c72f0ba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rzpgp" (UID: "98be0e97-3076-42f5-be44-71b25c72f0ba") : configmap "kube-rbac-proxy" not found
Sep 11 03:54:20.420836 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:20.420789    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c58ba3e-9104-492b-88d9-9f4abdee2c03-registry-tls\") pod \"image-registry-5cfcb599d4-jzm8b\" (UID: \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\") " pod="openshift-image-registry/image-registry-5cfcb599d4-jzm8b"
Sep 11 03:54:20.421507 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:20.420963    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 03:54:20.421507 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:20.420993    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cfcb599d4-jzm8b: secret "image-registry-tls" not found
Sep 11 03:54:20.421507 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:20.421096    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c58ba3e-9104-492b-88d9-9f4abdee2c03-registry-tls podName:1c58ba3e-9104-492b-88d9-9f4abdee2c03 nodeName:}" failed. No retries permitted until 2026-09-11 03:54:36.421072597 +0000 UTC m=+73.219162323 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1c58ba3e-9104-492b-88d9-9f4abdee2c03-registry-tls") pod "image-registry-5cfcb599d4-jzm8b" (UID: "1c58ba3e-9104-492b-88d9-9f4abdee2c03") : secret "image-registry-tls" not found
Sep 11 03:54:20.522072 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:20.522037    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42222ece-7ddd-483e-8ca8-934910a8fa25-service-ca-bundle\") pod \"router-default-78556b97cb-rt5r7\" (UID: \"42222ece-7ddd-483e-8ca8-934910a8fa25\") " pod="openshift-ingress/router-default-78556b97cb-rt5r7"
Sep 11 03:54:20.522072 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:20.522072    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53d1b221-40dd-4507-b81a-4af75f45efaf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-lm5hf\" (UID: \"53d1b221-40dd-4507-b81a-4af75f45efaf\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lm5hf"
Sep 11 03:54:20.522267 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:20.522105    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42222ece-7ddd-483e-8ca8-934910a8fa25-metrics-certs\") pod \"router-default-78556b97cb-rt5r7\" (UID: \"42222ece-7ddd-483e-8ca8-934910a8fa25\") " pod="openshift-ingress/router-default-78556b97cb-rt5r7"
Sep 11 03:54:20.522267 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:20.522212    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 03:54:20.522347 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:20.522265    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/42222ece-7ddd-483e-8ca8-934910a8fa25-service-ca-bundle podName:42222ece-7ddd-483e-8ca8-934910a8fa25 nodeName:}" failed. No retries permitted until 2026-09-11 03:54:36.522248409 +0000 UTC m=+73.320338132 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/42222ece-7ddd-483e-8ca8-934910a8fa25-service-ca-bundle") pod "router-default-78556b97cb-rt5r7" (UID: "42222ece-7ddd-483e-8ca8-934910a8fa25") : configmap references non-existent config key: service-ca.crt
Sep 11 03:54:20.522347 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:20.522290    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53d1b221-40dd-4507-b81a-4af75f45efaf-cluster-monitoring-operator-tls podName:53d1b221-40dd-4507-b81a-4af75f45efaf nodeName:}" failed. No retries permitted until 2026-09-11 03:54:36.522283475 +0000 UTC m=+73.320373180 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/53d1b221-40dd-4507-b81a-4af75f45efaf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-lm5hf" (UID: "53d1b221-40dd-4507-b81a-4af75f45efaf") : secret "cluster-monitoring-operator-tls" not found
Sep 11 03:54:20.522347 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:20.522219    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 03:54:20.522347 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:20.522331    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42222ece-7ddd-483e-8ca8-934910a8fa25-metrics-certs podName:42222ece-7ddd-483e-8ca8-934910a8fa25 nodeName:}" failed. No retries permitted until 2026-09-11 03:54:36.52232365 +0000 UTC m=+73.320413419 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42222ece-7ddd-483e-8ca8-934910a8fa25-metrics-certs") pod "router-default-78556b97cb-rt5r7" (UID: "42222ece-7ddd-483e-8ca8-934910a8fa25") : secret "router-metrics-certs-default" not found
Sep 11 03:54:20.723035 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:20.722971    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/73868425-41c2-4554-aef0-2528200edc9d-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-h76wv\" (UID: \"73868425-41c2-4554-aef0-2528200edc9d\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-h76wv"
Sep 11 03:54:20.723157 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:20.723117    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 03:54:20.723196 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:20.723187    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73868425-41c2-4554-aef0-2528200edc9d-networking-console-plugin-cert podName:73868425-41c2-4554-aef0-2528200edc9d nodeName:}" failed. No retries permitted until 2026-09-11 03:54:36.723171454 +0000 UTC m=+73.521261174 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/73868425-41c2-4554-aef0-2528200edc9d-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-h76wv" (UID: "73868425-41c2-4554-aef0-2528200edc9d") : secret "networking-console-plugin-cert" not found
Sep 11 03:54:24.083618 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:24.083587    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nfssn"
Sep 11 03:54:25.155672 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:25.155626    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98be0e97-3076-42f5-be44-71b25c72f0ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rzpgp\" (UID: \"98be0e97-3076-42f5-be44-71b25c72f0ba\") " pod="openshift-insights/insights-runtime-extractor-rzpgp"
Sep 11 03:54:25.156080 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:25.155746    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98be0e97-3076-42f5-be44-71b25c72f0ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rzpgp\" (UID: \"98be0e97-3076-42f5-be44-71b25c72f0ba\") " pod="openshift-insights/insights-runtime-extractor-rzpgp"
Sep 11 03:54:25.156080 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:25.155796    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 03:54:25.156080 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:25.155886    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98be0e97-3076-42f5-be44-71b25c72f0ba-insights-runtime-extractor-tls podName:98be0e97-3076-42f5-be44-71b25c72f0ba nodeName:}" failed. No retries permitted until 2026-09-11 03:54:41.155859951 +0000 UTC m=+77.953949710 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/98be0e97-3076-42f5-be44-71b25c72f0ba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rzpgp" (UID: "98be0e97-3076-42f5-be44-71b25c72f0ba") : secret "insights-runtime-extractor-tls" not found
Sep 11 03:54:25.156221 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:25.156203    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98be0e97-3076-42f5-be44-71b25c72f0ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rzpgp\" (UID: \"98be0e97-3076-42f5-be44-71b25c72f0ba\") " pod="openshift-insights/insights-runtime-extractor-rzpgp"
Sep 11 03:54:28.482167 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:28.482128    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e72b85ea-da06-4626-9ac7-1aa09afbc972-original-pull-secret\") pod \"global-pull-secret-syncer-gb2cl\" (UID: \"e72b85ea-da06-4626-9ac7-1aa09afbc972\") " pod="kube-system/global-pull-secret-syncer-gb2cl"
Sep 11 03:54:28.484993 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:28.484973    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 03:54:28.495608 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:28.495572    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e72b85ea-da06-4626-9ac7-1aa09afbc972-original-pull-secret\") pod \"global-pull-secret-syncer-gb2cl\" (UID: \"e72b85ea-da06-4626-9ac7-1aa09afbc972\") " pod="kube-system/global-pull-secret-syncer-gb2cl"
Sep 11 03:54:28.583478 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:28.583449    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87707938-5179-4e34-8d8a-892ecac835ee-metrics-certs\") pod \"network-metrics-daemon-xdw4t\" (UID: \"87707938-5179-4e34-8d8a-892ecac835ee\") " pod="openshift-multus/network-metrics-daemon-xdw4t"
Sep 11 03:54:28.586094 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:28.586075    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 03:54:28.596216 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:28.596197    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87707938-5179-4e34-8d8a-892ecac835ee-metrics-certs\") pod \"network-metrics-daemon-xdw4t\" (UID: \"87707938-5179-4e34-8d8a-892ecac835ee\") " pod="openshift-multus/network-metrics-daemon-xdw4t"
Sep 11 03:54:28.684122 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:28.684096    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlwwv\" (UniqueName: \"kubernetes.io/projected/6b502d3b-4680-40e1-9381-0a5822c16d82-kube-api-access-tlwwv\") pod \"network-check-target-5bl6k\" (UID: \"6b502d3b-4680-40e1-9381-0a5822c16d82\") " pod="openshift-network-diagnostics/network-check-target-5bl6k"
Sep 11 03:54:28.686280 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:28.686254    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlwwv\" (UniqueName: \"kubernetes.io/projected/6b502d3b-4680-40e1-9381-0a5822c16d82-kube-api-access-tlwwv\") pod \"network-check-target-5bl6k\" (UID: \"6b502d3b-4680-40e1-9381-0a5822c16d82\") " pod="openshift-network-diagnostics/network-check-target-5bl6k"
Sep 11 03:54:28.762212 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:28.762156    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j6dl8\""
Sep 11 03:54:28.767496 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:28.767478    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rtj7z\""
Sep 11 03:54:28.770331 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:28.770316    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bl6k"
Sep 11 03:54:28.770481 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:28.770463    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gb2cl"
Sep 11 03:54:28.775586 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:28.775570    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xdw4t"
Sep 11 03:54:28.885962 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:28.885447    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7afc68c1-54e3-4f06-8dcd-184a06388ccf-metrics-tls\") pod \"dns-default-jcsgz\" (UID: \"7afc68c1-54e3-4f06-8dcd-184a06388ccf\") " pod="openshift-dns/dns-default-jcsgz"
Sep 11 03:54:28.888459 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:28.888426    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7afc68c1-54e3-4f06-8dcd-184a06388ccf-metrics-tls\") pod \"dns-default-jcsgz\" (UID: \"7afc68c1-54e3-4f06-8dcd-184a06388ccf\") " pod="openshift-dns/dns-default-jcsgz"
Sep 11 03:54:29.076096 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:29.076063    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5bl6k"]
Sep 11 03:54:29.079648 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:54:29.079623    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b502d3b_4680_40e1_9381_0a5822c16d82.slice/crio-92ffee2c89a9aad5a1166583655f13f2d5bd8a060386a9e5b6c9e6d44f3a1207 WatchSource:0}: Error finding container 92ffee2c89a9aad5a1166583655f13f2d5bd8a060386a9e5b6c9e6d44f3a1207: Status 404 returned error can't find the container with id 92ffee2c89a9aad5a1166583655f13f2d5bd8a060386a9e5b6c9e6d44f3a1207
Sep 11 03:54:29.099401 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:29.099362    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gb2cl"]
Sep 11 03:54:29.108414 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:54:29.108374    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode72b85ea_da06_4626_9ac7_1aa09afbc972.slice/crio-4165fb315c303a83fb367feb0ad1658ef01ac6c7863bf86837e08e57c785382c WatchSource:0}: Error finding container 4165fb315c303a83fb367feb0ad1658ef01ac6c7863bf86837e08e57c785382c: Status 404 returned error can't find the container with id 4165fb315c303a83fb367feb0ad1658ef01ac6c7863bf86837e08e57c785382c
Sep 11 03:54:29.123227 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:29.123201    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xdw4t"]
Sep 11 03:54:29.130259 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:54:29.130231    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87707938_5179_4e34_8d8a_892ecac835ee.slice/crio-38571e48ca480e6ee7ffdcdd3a5125c0ff430064c80dd0a03b162fc9eac0af48 WatchSource:0}: Error finding container 38571e48ca480e6ee7ffdcdd3a5125c0ff430064c80dd0a03b162fc9eac0af48: Status 404 returned error can't find the container with id 38571e48ca480e6ee7ffdcdd3a5125c0ff430064c80dd0a03b162fc9eac0af48
Sep 11 03:54:29.181015 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:29.180984    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h5zgd\""
Sep 11 03:54:29.183916 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:29.183886    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gb2cl" event={"ID":"e72b85ea-da06-4626-9ac7-1aa09afbc972","Type":"ContainerStarted","Data":"4165fb315c303a83fb367feb0ad1658ef01ac6c7863bf86837e08e57c785382c"}
Sep 11 03:54:29.185424 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:29.185402    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5bl6k" event={"ID":"6b502d3b-4680-40e1-9381-0a5822c16d82","Type":"ContainerStarted","Data":"20d3ccf608f8ba9062bf241d4ac79a7881a29b756c8466d272b872fc9f57760c"}
Sep 11 03:54:29.185535 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:29.185439    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5bl6k" event={"ID":"6b502d3b-4680-40e1-9381-0a5822c16d82","Type":"ContainerStarted","Data":"92ffee2c89a9aad5a1166583655f13f2d5bd8a060386a9e5b6c9e6d44f3a1207"}
Sep 11 03:54:29.185535 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:29.185504    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5bl6k"
Sep 11 03:54:29.186635 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:29.186616    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xdw4t" event={"ID":"87707938-5179-4e34-8d8a-892ecac835ee","Type":"ContainerStarted","Data":"38571e48ca480e6ee7ffdcdd3a5125c0ff430064c80dd0a03b162fc9eac0af48"}
Sep 11 03:54:29.188743 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:29.188727    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jcsgz"
Sep 11 03:54:29.199910 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:29.199866    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5bl6k" podStartSLOduration=66.199852323 podStartE2EDuration="1m6.199852323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:53:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:54:29.199286857 +0000 UTC m=+65.997376583" watchObservedRunningTime="2026-09-11 03:54:29.199852323 +0000 UTC m=+65.997942049"
Sep 11 03:54:29.454903 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:29.454831    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jcsgz"]
Sep 11 03:54:29.457724 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:54:29.457697    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7afc68c1_54e3_4f06_8dcd_184a06388ccf.slice/crio-2a67b364b33863e909a7b2e3a6ce7367af4c606fbc10b281ec48f687d6d19eaa WatchSource:0}: Error finding container 2a67b364b33863e909a7b2e3a6ce7367af4c606fbc10b281ec48f687d6d19eaa: Status 404 returned error can't find the container with id 2a67b364b33863e909a7b2e3a6ce7367af4c606fbc10b281ec48f687d6d19eaa
Sep 11 03:54:30.191944 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:30.191908    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jcsgz" event={"ID":"7afc68c1-54e3-4f06-8dcd-184a06388ccf","Type":"ContainerStarted","Data":"2a67b364b33863e909a7b2e3a6ce7367af4c606fbc10b281ec48f687d6d19eaa"}
Sep 11 03:54:31.198782 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:31.198733    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xdw4t" event={"ID":"87707938-5179-4e34-8d8a-892ecac835ee","Type":"ContainerStarted","Data":"a06e8b9386b62cc22e40212206efd92a8114377e8d68ed0baaa4d53011e96a7c"}
Sep 11 03:54:31.199370 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:31.198847    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xdw4t" event={"ID":"87707938-5179-4e34-8d8a-892ecac835ee","Type":"ContainerStarted","Data":"fd3d684f4352d41955c119989ed64f049ae04d6a243ccb619ea711711c5fd085"}
Sep 11 03:54:31.217627 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:31.217564    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xdw4t" podStartSLOduration=67.22646915 podStartE2EDuration="1m8.217542468s" totalImagesPullingTime="991.073318ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:53:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:54:31.217046463 +0000 UTC m=+68.015136191" watchObservedRunningTime="2026-09-11 03:54:31.217542468 +0000 UTC m=+68.015632196"
Sep 11 03:54:32.204208 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:32.204171    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jcsgz" event={"ID":"7afc68c1-54e3-4f06-8dcd-184a06388ccf","Type":"ContainerStarted","Data":"f4c663ec5ade39011f47371ea44fa9c96fd11c5395ac54dfef4e561cd5213c6f"}
Sep 11 03:54:33.210806 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:33.210764    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jcsgz" event={"ID":"7afc68c1-54e3-4f06-8dcd-184a06388ccf","Type":"ContainerStarted","Data":"1e40580fc36e9e92c52caa80860b9aade19004e717f946a6801ecf250c23b949"}
Sep 11 03:54:33.211215 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:33.210915    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jcsgz"
Sep 11 03:54:33.232493 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:33.232441    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jcsgz" podStartSLOduration=34.062304032 podStartE2EDuration="36.232421843s" totalImagesPullingTime="2.170117811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:53:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:54:33.231192267 +0000 UTC m=+70.029281996" watchObservedRunningTime="2026-09-11 03:54:33.232421843 +0000 UTC m=+70.030511569"
Sep 11 03:54:34.216712 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.216669    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gb2cl" event={"ID":"e72b85ea-da06-4626-9ac7-1aa09afbc972","Type":"ContainerStarted","Data":"e160d222d46433fb78666c157a6a8889a018a90c15e6f9d55af4002192b46297"}
Sep 11 03:54:34.233612 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.233556    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gb2cl" podStartSLOduration=67.206998459 podStartE2EDuration="1m11.233540243s" totalImagesPullingTime="4.026541784s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:53:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:54:34.23340024 +0000 UTC m=+71.031489957" watchObservedRunningTime="2026-09-11 03:54:34.233540243 +0000 UTC m=+71.031629970"
Sep 11 03:54:34.426679 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.426643    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd869b74d-hwbxk"]
Sep 11 03:54:34.430594 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.430572    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6cbcc5b4-7qjcp"]
Sep 11 03:54:34.430738 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.430712    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd869b74d-hwbxk"
Sep 11 03:54:34.433978 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.433943    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 11 03:54:34.434128 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.434107    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 11 03:54:34.434277 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.434255    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6cbcc5b4-7qjcp"
Sep 11 03:54:34.434434 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.434416    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 11 03:54:34.434662 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.434642    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 11 03:54:34.438656 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.438637    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-c2w58\""
Sep 11 03:54:34.438844 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.438823    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 11 03:54:34.450937 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.450904    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6cbcc5b4-7qjcp"]
Sep 11 03:54:34.451794 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.451758    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd869b74d-hwbxk"]
Sep 11 03:54:34.465895 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.465858    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5cfcb599d4-jzm8b"]
Sep 11 03:54:34.466143 ip-10-0-130-195 kubenswrapper[2558]: E0911 03:54:34.466119    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-5cfcb599d4-jzm8b" podUID="1c58ba3e-9104-492b-88d9-9f4abdee2c03"
Sep 11 03:54:34.520031 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.519955    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-b9zbm"]
Sep 11 03:54:34.524132 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.524102    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-b9zbm"
Sep 11 03:54:34.524294 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.524277    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6b78dcfd7c-gll52"]
Sep 11 03:54:34.527701 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.527660    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 11 03:54:34.527861 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.527718    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-7mh26\""
Sep 11 03:54:34.527955 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.527934    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 11 03:54:34.528151 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.528135    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b78dcfd7c-gll52"
Sep 11 03:54:34.536817 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.536794    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhkcm\" (UniqueName: \"kubernetes.io/projected/02ec3e55-86c0-40c7-a97e-6f758acee98e-kube-api-access-bhkcm\") pod \"klusterlet-addon-workmgr-6cd869b74d-hwbxk\" (UID: \"02ec3e55-86c0-40c7-a97e-6f758acee98e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd869b74d-hwbxk"
Sep 11 03:54:34.536937 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.536830    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/02ec3e55-86c0-40c7-a97e-6f758acee98e-klusterlet-config\") pod \"klusterlet-addon-workmgr-6cd869b74d-hwbxk\" (UID: \"02ec3e55-86c0-40c7-a97e-6f758acee98e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd869b74d-hwbxk"
Sep 11 03:54:34.536937 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.536866    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3f50223e-090d-49d8-a2e2-f0e16f99b816-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7d6cbcc5b4-7qjcp\" (UID: \"3f50223e-090d-49d8-a2e2-f0e16f99b816\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6cbcc5b4-7qjcp"
Sep 11 03:54:34.537023 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.536997    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vqrc\" (UniqueName: \"kubernetes.io/projected/3f50223e-090d-49d8-a2e2-f0e16f99b816-kube-api-access-7vqrc\") pod \"managed-serviceaccount-addon-agent-7d6cbcc5b4-7qjcp\" (UID: \"3f50223e-090d-49d8-a2e2-f0e16f99b816\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6cbcc5b4-7qjcp"
Sep 11 03:54:34.537183 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.537087    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02ec3e55-86c0-40c7-a97e-6f758acee98e-tmp\") pod \"klusterlet-addon-workmgr-6cd869b74d-hwbxk\" (UID: \"02ec3e55-86c0-40c7-a97e-6f758acee98e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd869b74d-hwbxk"
Sep 11 03:54:34.542231 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.542206    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-b9zbm"]
Sep 11 03:54:34.545207 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.545186    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b78dcfd7c-gll52"]
Sep 11 03:54:34.637871 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.637836    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vqrc\" (UniqueName: \"kubernetes.io/projected/3f50223e-090d-49d8-a2e2-f0e16f99b816-kube-api-access-7vqrc\") pod \"managed-serviceaccount-addon-agent-7d6cbcc5b4-7qjcp\" (UID: \"3f50223e-090d-49d8-a2e2-f0e16f99b816\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6cbcc5b4-7qjcp"
Sep 11 03:54:34.638068 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.637898    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02ec3e55-86c0-40c7-a97e-6f758acee98e-tmp\") pod \"klusterlet-addon-workmgr-6cd869b74d-hwbxk\" (UID: \"02ec3e55-86c0-40c7-a97e-6f758acee98e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd869b74d-hwbxk"
Sep 11 03:54:34.638068 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.637921    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/46c3aeb9-b4ad-4654-a471-da65b785386b-installation-pull-secrets\") pod \"image-registry-6b78dcfd7c-gll52\" (UID: \"46c3aeb9-b4ad-4654-a471-da65b785386b\") " pod="openshift-image-registry/image-registry-6b78dcfd7c-gll52"
Sep 11 03:54:34.638068 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.637945    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/46c3aeb9-b4ad-4654-a471-da65b785386b-image-registry-private-configuration\") pod \"image-registry-6b78dcfd7c-gll52\" (UID: \"46c3aeb9-b4ad-4654-a471-da65b785386b\") " pod="openshift-image-registry/image-registry-6b78dcfd7c-gll52"
Sep 11 03:54:34.638068 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.637969    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5sz9\" (UniqueName: \"kubernetes.io/projected/e80fdc87-5412-4a97-a1cc-d68c5511edf2-kube-api-access-z5sz9\") pod \"downloads-76f99584f4-b9zbm\" (UID: \"e80fdc87-5412-4a97-a1cc-d68c5511edf2\") " pod="openshift-console/downloads-76f99584f4-b9zbm"
Sep 11 03:54:34.638068 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.637992    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/46c3aeb9-b4ad-4654-a471-da65b785386b-ca-trust-extracted\") pod \"image-registry-6b78dcfd7c-gll52\" (UID: \"46c3aeb9-b4ad-4654-a471-da65b785386b\") " pod="openshift-image-registry/image-registry-6b78dcfd7c-gll52"
Sep 11 03:54:34.638068 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.638037    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/46c3aeb9-b4ad-4654-a471-da65b785386b-trusted-ca\") pod \"image-registry-6b78dcfd7c-gll52\" (UID: \"46c3aeb9-b4ad-4654-a471-da65b785386b\") " pod="openshift-image-registry/image-registry-6b78dcfd7c-gll52"
Sep 11 03:54:34.638367 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.638071    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhkcm\" (UniqueName: \"kubernetes.io/projected/02ec3e55-86c0-40c7-a97e-6f758acee98e-kube-api-access-bhkcm\") pod \"klusterlet-addon-workmgr-6cd869b74d-hwbxk\" (UID: \"02ec3e55-86c0-40c7-a97e-6f758acee98e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd869b74d-hwbxk"
Sep 11 03:54:34.638367 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.638095    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/46c3aeb9-b4ad-4654-a471-da65b785386b-registry-certificates\") pod \"image-registry-6b78dcfd7c-gll52\" (UID: \"46c3aeb9-b4ad-4654-a471-da65b785386b\") " pod="openshift-image-registry/image-registry-6b78dcfd7c-gll52"
Sep 11 03:54:34.638367 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.638117    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/46c3aeb9-b4ad-4654-a471-da65b785386b-registry-tls\") pod \"image-registry-6b78dcfd7c-gll52\" (UID: \"46c3aeb9-b4ad-4654-a471-da65b785386b\") " pod="openshift-image-registry/image-registry-6b78dcfd7c-gll52"
Sep 11 03:54:34.638367 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.638137    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6q5c\" (UniqueName: \"kubernetes.io/projected/46c3aeb9-b4ad-4654-a471-da65b785386b-kube-api-access-l6q5c\") pod \"image-registry-6b78dcfd7c-gll52\" (UID: \"46c3aeb9-b4ad-4654-a471-da65b785386b\") " pod="openshift-image-registry/image-registry-6b78dcfd7c-gll52"
Sep 11 03:54:34.638367 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.638159    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/46c3aeb9-b4ad-4654-a471-da65b785386b-bound-sa-token\") pod \"image-registry-6b78dcfd7c-gll52\" (UID: \"46c3aeb9-b4ad-4654-a471-da65b785386b\") " pod="openshift-image-registry/image-registry-6b78dcfd7c-gll52"
Sep 11 03:54:34.638367 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.638224    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/02ec3e55-86c0-40c7-a97e-6f758acee98e-klusterlet-config\") pod \"klusterlet-addon-workmgr-6cd869b74d-hwbxk\" (UID: \"02ec3e55-86c0-40c7-a97e-6f758acee98e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd869b74d-hwbxk"
Sep 11 03:54:34.638367 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.638270    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3f50223e-090d-49d8-a2e2-f0e16f99b816-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7d6cbcc5b4-7qjcp\" (UID: \"3f50223e-090d-49d8-a2e2-f0e16f99b816\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6cbcc5b4-7qjcp"
Sep 11 03:54:34.638367 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.638333    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02ec3e55-86c0-40c7-a97e-6f758acee98e-tmp\") pod \"klusterlet-addon-workmgr-6cd869b74d-hwbxk\" (UID: \"02ec3e55-86c0-40c7-a97e-6f758acee98e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd869b74d-hwbxk"
Sep 11 03:54:34.640777 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.640755    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3f50223e-090d-49d8-a2e2-f0e16f99b816-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7d6cbcc5b4-7qjcp\" (UID: \"3f50223e-090d-49d8-a2e2-f0e16f99b816\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6cbcc5b4-7qjcp"
Sep 11 03:54:34.640880 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.640761    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/02ec3e55-86c0-40c7-a97e-6f758acee98e-klusterlet-config\") pod \"klusterlet-addon-workmgr-6cd869b74d-hwbxk\" (UID: \"02ec3e55-86c0-40c7-a97e-6f758acee98e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd869b74d-hwbxk"
Sep 11 03:54:34.646950 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.646924    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vqrc\" (UniqueName: \"kubernetes.io/projected/3f50223e-090d-49d8-a2e2-f0e16f99b816-kube-api-access-7vqrc\") pod \"managed-serviceaccount-addon-agent-7d6cbcc5b4-7qjcp\" (UID: \"3f50223e-090d-49d8-a2e2-f0e16f99b816\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6cbcc5b4-7qjcp"
Sep 11 03:54:34.649726 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.649686    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhkcm\" (UniqueName: \"kubernetes.io/projected/02ec3e55-86c0-40c7-a97e-6f758acee98e-kube-api-access-bhkcm\") pod \"klusterlet-addon-workmgr-6cd869b74d-hwbxk\" (UID: \"02ec3e55-86c0-40c7-a97e-6f758acee98e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd869b74d-hwbxk"
Sep 11 03:54:34.739468 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.739430    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/46c3aeb9-b4ad-4654-a471-da65b785386b-installation-pull-secrets\") pod \"image-registry-6b78dcfd7c-gll52\" (UID: \"46c3aeb9-b4ad-4654-a471-da65b785386b\") " pod="openshift-image-registry/image-registry-6b78dcfd7c-gll52"
Sep 11 03:54:34.739656 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.739477    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/46c3aeb9-b4ad-4654-a471-da65b785386b-image-registry-private-configuration\") pod \"image-registry-6b78dcfd7c-gll52\" (UID: \"46c3aeb9-b4ad-4654-a471-da65b785386b\") " pod="openshift-image-registry/image-registry-6b78dcfd7c-gll52"
Sep 11 03:54:34.739656 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.739567    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5sz9\" (UniqueName: \"kubernetes.io/projected/e80fdc87-5412-4a97-a1cc-d68c5511edf2-kube-api-access-z5sz9\") pod \"downloads-76f99584f4-b9zbm\" (UID: \"e80fdc87-5412-4a97-a1cc-d68c5511edf2\") " pod="openshift-console/downloads-76f99584f4-b9zbm"
Sep 11 03:54:34.739656 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.739601    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/46c3aeb9-b4ad-4654-a471-da65b785386b-ca-trust-extracted\") pod \"image-registry-6b78dcfd7c-gll52\" (UID: \"46c3aeb9-b4ad-4654-a471-da65b785386b\") " pod="openshift-image-registry/image-registry-6b78dcfd7c-gll52"
Sep 11 03:54:34.739656 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.739626    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/46c3aeb9-b4ad-4654-a471-da65b785386b-trusted-ca\") pod \"image-registry-6b78dcfd7c-gll52\" (UID: \"46c3aeb9-b4ad-4654-a471-da65b785386b\") " pod="openshift-image-registry/image-registry-6b78dcfd7c-gll52"
Sep 11 03:54:34.739895 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.739664    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/46c3aeb9-b4ad-4654-a471-da65b785386b-registry-certificates\") pod \"image-registry-6b78dcfd7c-gll52\" (UID: \"46c3aeb9-b4ad-4654-a471-da65b785386b\") " pod="openshift-image-registry/image-registry-6b78dcfd7c-gll52"
Sep 11 03:54:34.739895 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.739687    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/46c3aeb9-b4ad-4654-a471-da65b785386b-registry-tls\") pod \"image-registry-6b78dcfd7c-gll52\" (UID: \"46c3aeb9-b4ad-4654-a471-da65b785386b\") " pod="openshift-image-registry/image-registry-6b78dcfd7c-gll52"
Sep 11 03:54:34.739895 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.739713    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6q5c\" (UniqueName: \"kubernetes.io/projected/46c3aeb9-b4ad-4654-a471-da65b785386b-kube-api-access-l6q5c\") pod \"image-registry-6b78dcfd7c-gll52\" (UID: \"46c3aeb9-b4ad-4654-a471-da65b785386b\") " pod="openshift-image-registry/image-registry-6b78dcfd7c-gll52"
Sep 11 03:54:34.740044 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.739934    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/46c3aeb9-b4ad-4654-a471-da65b785386b-bound-sa-token\") pod \"image-registry-6b78dcfd7c-gll52\" (UID: \"46c3aeb9-b4ad-4654-a471-da65b785386b\") " pod="openshift-image-registry/image-registry-6b78dcfd7c-gll52"
Sep 11 03:54:34.740101 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.740066    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/46c3aeb9-b4ad-4654-a471-da65b785386b-ca-trust-extracted\") pod \"image-registry-6b78dcfd7c-gll52\" (UID: \"46c3aeb9-b4ad-4654-a471-da65b785386b\") " pod="openshift-image-registry/image-registry-6b78dcfd7c-gll52"
Sep 11 03:54:34.740819 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.740613    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd869b74d-hwbxk"
Sep 11 03:54:34.740927 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.740858    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/46c3aeb9-b4ad-4654-a471-da65b785386b-registry-certificates\") pod \"image-registry-6b78dcfd7c-gll52\" (UID: \"46c3aeb9-b4ad-4654-a471-da65b785386b\") " pod="openshift-image-registry/image-registry-6b78dcfd7c-gll52"
Sep 11 03:54:34.740927 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.740866    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/46c3aeb9-b4ad-4654-a471-da65b785386b-trusted-ca\") pod \"image-registry-6b78dcfd7c-gll52\" (UID: \"46c3aeb9-b4ad-4654-a471-da65b785386b\") " pod="openshift-image-registry/image-registry-6b78dcfd7c-gll52"
Sep 11 03:54:34.742348 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.742329    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/46c3aeb9-b4ad-4654-a471-da65b785386b-installation-pull-secrets\") pod \"image-registry-6b78dcfd7c-gll52\" (UID: \"46c3aeb9-b4ad-4654-a471-da65b785386b\") " pod="openshift-image-registry/image-registry-6b78dcfd7c-gll52"
Sep 11 03:54:34.742558 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.742525    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/46c3aeb9-b4ad-4654-a471-da65b785386b-registry-tls\") pod \"image-registry-6b78dcfd7c-gll52\" (UID: \"46c3aeb9-b4ad-4654-a471-da65b785386b\") " pod="openshift-image-registry/image-registry-6b78dcfd7c-gll52"
Sep 11 03:54:34.742626 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.742547    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/46c3aeb9-b4ad-4654-a471-da65b785386b-image-registry-private-configuration\") pod \"image-registry-6b78dcfd7c-gll52\" (UID: \"46c3aeb9-b4ad-4654-a471-da65b785386b\") " pod="openshift-image-registry/image-registry-6b78dcfd7c-gll52"
Sep 11 03:54:34.748311 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.748288    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5sz9\" (UniqueName: \"kubernetes.io/projected/e80fdc87-5412-4a97-a1cc-d68c5511edf2-kube-api-access-z5sz9\") pod \"downloads-76f99584f4-b9zbm\" (UID: \"e80fdc87-5412-4a97-a1cc-d68c5511edf2\") " pod="openshift-console/downloads-76f99584f4-b9zbm"
Sep 11 03:54:34.751114 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.751086    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6q5c\" (UniqueName: \"kubernetes.io/projected/46c3aeb9-b4ad-4654-a471-da65b785386b-kube-api-access-l6q5c\") pod \"image-registry-6b78dcfd7c-gll52\" (UID: \"46c3aeb9-b4ad-4654-a471-da65b785386b\") " pod="openshift-image-registry/image-registry-6b78dcfd7c-gll52"
Sep 11 03:54:34.751808 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.751777    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/46c3aeb9-b4ad-4654-a471-da65b785386b-bound-sa-token\") pod \"image-registry-6b78dcfd7c-gll52\" (UID: \"46c3aeb9-b4ad-4654-a471-da65b785386b\") " pod="openshift-image-registry/image-registry-6b78dcfd7c-gll52"
Sep 11 03:54:34.756803 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.756781    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6cbcc5b4-7qjcp"
Sep 11 03:54:34.834191 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.834154    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-b9zbm"
Sep 11 03:54:34.842929 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.842902    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vm2xm\""
Sep 11 03:54:34.851192 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:34.851165    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b78dcfd7c-gll52"
Sep 11 03:54:35.013718 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:35.013693    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd869b74d-hwbxk"]
Sep 11 03:54:35.016363 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:54:35.016319    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02ec3e55_86c0_40c7_a97e_6f758acee98e.slice/crio-d4523487e029b288accf1a16018b59a7221a24c735efa4e379dccf94e8b2baeb WatchSource:0}: Error finding container d4523487e029b288accf1a16018b59a7221a24c735efa4e379dccf94e8b2baeb: Status 404 returned error can't find the container with id d4523487e029b288accf1a16018b59a7221a24c735efa4e379dccf94e8b2baeb
Sep 11 03:54:35.035692 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:35.035666    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6cbcc5b4-7qjcp"]
Sep 11 03:54:35.038123 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:54:35.038095    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3f50223e_090d_49d8_a2e2_f0e16f99b816.slice/crio-c3e8a12322f44ab9cda843b86d5e3931fba5526ef5260b5cf26fbb8df41fabcd WatchSource:0}: Error finding container c3e8a12322f44ab9cda843b86d5e3931fba5526ef5260b5cf26fbb8df41fabcd: Status 404 returned error can't find the container with id c3e8a12322f44ab9cda843b86d5e3931fba5526ef5260b5cf26fbb8df41fabcd
Sep 11 03:54:35.127055 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:35.127021    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-b9zbm"]
Sep 11 03:54:35.130010 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:54:35.129989    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode80fdc87_5412_4a97_a1cc_d68c5511edf2.slice/crio-1a8ec2ac0d1d6d0d4af62f2b4ebb6e520976c3160d55f8648b47ec2333e7b016 WatchSource:0}: Error finding container 1a8ec2ac0d1d6d0d4af62f2b4ebb6e520976c3160d55f8648b47ec2333e7b016: Status 404 returned error can't find the container with id 1a8ec2ac0d1d6d0d4af62f2b4ebb6e520976c3160d55f8648b47ec2333e7b016
Sep 11 03:54:35.166743 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:35.166593    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b78dcfd7c-gll52"]
Sep 11 03:54:35.169266 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:54:35.169242    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46c3aeb9_b4ad_4654_a471_da65b785386b.slice/crio-6bd7fd67a7c348710b25fb3e1ddd7188fe71051612f8b19ab6d191ec7b8d0e1b WatchSource:0}: Error finding container 6bd7fd67a7c348710b25fb3e1ddd7188fe71051612f8b19ab6d191ec7b8d0e1b: Status 404 returned error can't find the container with id 6bd7fd67a7c348710b25fb3e1ddd7188fe71051612f8b19ab6d191ec7b8d0e1b
Sep 11 03:54:35.220655 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:35.220621    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b78dcfd7c-gll52" event={"ID":"46c3aeb9-b4ad-4654-a471-da65b785386b","Type":"ContainerStarted","Data":"6bd7fd67a7c348710b25fb3e1ddd7188fe71051612f8b19ab6d191ec7b8d0e1b"}
Sep 11 03:54:35.221782 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:35.221754    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-b9zbm" event={"ID":"e80fdc87-5412-4a97-a1cc-d68c5511edf2","Type":"ContainerStarted","Data":"1a8ec2ac0d1d6d0d4af62f2b4ebb6e520976c3160d55f8648b47ec2333e7b016"}
Sep 11 03:54:35.223078 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:35.223059    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6cbcc5b4-7qjcp" event={"ID":"3f50223e-090d-49d8-a2e2-f0e16f99b816","Type":"ContainerStarted","Data":"c3e8a12322f44ab9cda843b86d5e3931fba5526ef5260b5cf26fbb8df41fabcd"}
Sep 11 03:54:35.224192 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:35.224171    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cfcb599d4-jzm8b"
Sep 11 03:54:35.224292 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:35.224174    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd869b74d-hwbxk" event={"ID":"02ec3e55-86c0-40c7-a97e-6f758acee98e","Type":"ContainerStarted","Data":"d4523487e029b288accf1a16018b59a7221a24c735efa4e379dccf94e8b2baeb"}
Sep 11 03:54:35.230882 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:35.230861    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cfcb599d4-jzm8b"
Sep 11 03:54:35.361667 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:35.361627    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1c58ba3e-9104-492b-88d9-9f4abdee2c03-installation-pull-secrets\") pod \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\" (UID: \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\") "
Sep 11 03:54:35.361867 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:35.361696    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1c58ba3e-9104-492b-88d9-9f4abdee2c03-trusted-ca\") pod \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\" (UID: \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\") "
Sep 11 03:54:35.361867 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:35.361736    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1c58ba3e-9104-492b-88d9-9f4abdee2c03-ca-trust-extracted\") pod \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\" (UID: \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\") "
Sep 11 03:54:35.361867 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:35.361763    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1c58ba3e-9104-492b-88d9-9f4abdee2c03-registry-certificates\") pod \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\" (UID: \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\") "
Sep 11 03:54:35.361867 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:35.361810    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2x84p\" (UniqueName: \"kubernetes.io/projected/1c58ba3e-9104-492b-88d9-9f4abdee2c03-kube-api-access-2x84p\") pod \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\" (UID: \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\") "
Sep 11 03:54:35.361867 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:35.361840    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1c58ba3e-9104-492b-88d9-9f4abdee2c03-image-registry-private-configuration\") pod \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\" (UID: \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\") "
Sep 11 03:54:35.362120 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:35.361992    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c58ba3e-9104-492b-88d9-9f4abdee2c03-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1c58ba3e-9104-492b-88d9-9f4abdee2c03" (UID: "1c58ba3e-9104-492b-88d9-9f4abdee2c03"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 03:54:35.362120 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:35.362024    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1c58ba3e-9104-492b-88d9-9f4abdee2c03-bound-sa-token\") pod \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\" (UID: \"1c58ba3e-9104-492b-88d9-9f4abdee2c03\") "
Sep 11 03:54:35.362217 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:35.362154    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c58ba3e-9104-492b-88d9-9f4abdee2c03-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1c58ba3e-9104-492b-88d9-9f4abdee2c03" (UID: "1c58ba3e-9104-492b-88d9-9f4abdee2c03"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 03:54:35.362217 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:35.362159    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c58ba3e-9104-492b-88d9-9f4abdee2c03-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1c58ba3e-9104-492b-88d9-9f4abdee2c03" (UID: "1c58ba3e-9104-492b-88d9-9f4abdee2c03"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 03:54:35.362356 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:35.362339    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1c58ba3e-9104-492b-88d9-9f4abdee2c03-trusted-ca\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 03:54:35.362440 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:35.362362    2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1c58ba3e-9104-492b-88d9-9f4abdee2c03-ca-trust-extracted\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 03:54:35.362440 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:35.362377    2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1c58ba3e-9104-492b-88d9-9f4abdee2c03-registry-certificates\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 03:54:35.364449 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:35.364420    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c58ba3e-9104-492b-88d9-9f4abdee2c03-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1c58ba3e-9104-492b-88d9-9f4abdee2c03" (UID: "1c58ba3e-9104-492b-88d9-9f4abdee2c03"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 03:54:35.364583 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:35.364486    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c58ba3e-9104-492b-88d9-9f4abdee2c03-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1c58ba3e-9104-492b-88d9-9f4abdee2c03" (UID: "1c58ba3e-9104-492b-88d9-9f4abdee2c03"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 03:54:35.364583 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:35.364514    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c58ba3e-9104-492b-88d9-9f4abdee2c03-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1c58ba3e-9104-492b-88d9-9f4abdee2c03" (UID: "1c58ba3e-9104-492b-88d9-9f4abdee2c03"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 03:54:35.364689 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:35.364608    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c58ba3e-9104-492b-88d9-9f4abdee2c03-kube-api-access-2x84p" (OuterVolumeSpecName: "kube-api-access-2x84p") pod "1c58ba3e-9104-492b-88d9-9f4abdee2c03" (UID: "1c58ba3e-9104-492b-88d9-9f4abdee2c03"). InnerVolumeSpecName "kube-api-access-2x84p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 03:54:35.463003 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:35.462963    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2x84p\" (UniqueName: \"kubernetes.io/projected/1c58ba3e-9104-492b-88d9-9f4abdee2c03-kube-api-access-2x84p\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 03:54:35.463003 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:35.462994    2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1c58ba3e-9104-492b-88d9-9f4abdee2c03-image-registry-private-configuration\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 03:54:35.463003 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:35.463006    2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1c58ba3e-9104-492b-88d9-9f4abdee2c03-bound-sa-token\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 03:54:35.463257 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:35.463015    2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1c58ba3e-9104-492b-88d9-9f4abdee2c03-installation-pull-secrets\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 03:54:36.233435 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:36.232939    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cfcb599d4-jzm8b"
Sep 11 03:54:36.233903 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:36.233621    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b78dcfd7c-gll52" event={"ID":"46c3aeb9-b4ad-4654-a471-da65b785386b","Type":"ContainerStarted","Data":"959a3286621f19ffc22f4e7f63c18dcbd87182c1addf7a083ea056da95400215"}
Sep 11 03:54:36.233903 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:36.233675    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6b78dcfd7c-gll52"
Sep 11 03:54:36.303580 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:36.303514    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6b78dcfd7c-gll52" podStartSLOduration=2.303488384 podStartE2EDuration="2.303488384s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:54:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:54:36.26678239 +0000 UTC m=+73.064872118" watchObservedRunningTime="2026-09-11 03:54:36.303488384 +0000 UTC m=+73.101578112"
Sep 11 03:54:36.317328 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:36.317259    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5cfcb599d4-jzm8b"]
Sep 11 03:54:36.323568 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:36.323440    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5cfcb599d4-jzm8b"]
Sep 11 03:54:36.374529 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:36.372896    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c58ba3e-9104-492b-88d9-9f4abdee2c03-registry-tls\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 03:54:36.575986 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:36.574896    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42222ece-7ddd-483e-8ca8-934910a8fa25-service-ca-bundle\") pod \"router-default-78556b97cb-rt5r7\" (UID: \"42222ece-7ddd-483e-8ca8-934910a8fa25\") " pod="openshift-ingress/router-default-78556b97cb-rt5r7"
Sep 11 03:54:36.575986 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:36.574953    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53d1b221-40dd-4507-b81a-4af75f45efaf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-lm5hf\" (UID: \"53d1b221-40dd-4507-b81a-4af75f45efaf\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lm5hf"
Sep 11 03:54:36.575986 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:36.575000    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42222ece-7ddd-483e-8ca8-934910a8fa25-metrics-certs\") pod \"router-default-78556b97cb-rt5r7\" (UID: \"42222ece-7ddd-483e-8ca8-934910a8fa25\") " pod="openshift-ingress/router-default-78556b97cb-rt5r7"
Sep 11 03:54:36.575986 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:36.575881    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42222ece-7ddd-483e-8ca8-934910a8fa25-service-ca-bundle\") pod \"router-default-78556b97cb-rt5r7\" (UID: \"42222ece-7ddd-483e-8ca8-934910a8fa25\") " pod="openshift-ingress/router-default-78556b97cb-rt5r7"
Sep 11 03:54:36.578906 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:36.578848    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53d1b221-40dd-4507-b81a-4af75f45efaf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-lm5hf\" (UID: \"53d1b221-40dd-4507-b81a-4af75f45efaf\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lm5hf"
Sep 11 03:54:36.591014 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:36.590978    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42222ece-7ddd-483e-8ca8-934910a8fa25-metrics-certs\") pod \"router-default-78556b97cb-rt5r7\" (UID: \"42222ece-7ddd-483e-8ca8-934910a8fa25\") " pod="openshift-ingress/router-default-78556b97cb-rt5r7"
Sep 11 03:54:36.745044 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:36.745008    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5z74n\""
Sep 11 03:54:36.753575 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:36.753536    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lm5hf"
Sep 11 03:54:36.776582 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:36.776543    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/73868425-41c2-4554-aef0-2528200edc9d-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-h76wv\" (UID: \"73868425-41c2-4554-aef0-2528200edc9d\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-h76wv"
Sep 11 03:54:36.781417 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:36.781374    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/73868425-41c2-4554-aef0-2528200edc9d-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-h76wv\" (UID: \"73868425-41c2-4554-aef0-2528200edc9d\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-h76wv"
Sep 11 03:54:36.832593 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:36.832564    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xfh26\""
Sep 11 03:54:36.840261 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:36.840039    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-78556b97cb-rt5r7"
Sep 11 03:54:36.946276 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:36.946244    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-djzsb\""
Sep 11 03:54:36.953725 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:36.953650    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-h76wv"
Sep 11 03:54:37.066228 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:37.066150    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-lm5hf"]
Sep 11 03:54:37.810099 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:37.810063    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c58ba3e-9104-492b-88d9-9f4abdee2c03" path="/var/lib/kubelet/pods/1c58ba3e-9104-492b-88d9-9f4abdee2c03/volumes"
Sep 11 03:54:38.574798 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:54:38.574759    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53d1b221_40dd_4507_b81a_4af75f45efaf.slice/crio-b00dd4836dedb92bcd6f28bc3cfac5d17dde13888bef7bccb08e4b73f4638cb7 WatchSource:0}: Error finding container b00dd4836dedb92bcd6f28bc3cfac5d17dde13888bef7bccb08e4b73f4638cb7: Status 404 returned error can't find the container with id b00dd4836dedb92bcd6f28bc3cfac5d17dde13888bef7bccb08e4b73f4638cb7
Sep 11 03:54:39.247709 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:39.247665    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lm5hf" event={"ID":"53d1b221-40dd-4507-b81a-4af75f45efaf","Type":"ContainerStarted","Data":"b00dd4836dedb92bcd6f28bc3cfac5d17dde13888bef7bccb08e4b73f4638cb7"}
Sep 11 03:54:41.217996 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:41.217897    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98be0e97-3076-42f5-be44-71b25c72f0ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rzpgp\" (UID: \"98be0e97-3076-42f5-be44-71b25c72f0ba\") " pod="openshift-insights/insights-runtime-extractor-rzpgp"
Sep 11 03:54:41.220931 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:41.220869    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98be0e97-3076-42f5-be44-71b25c72f0ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rzpgp\" (UID: \"98be0e97-3076-42f5-be44-71b25c72f0ba\") " pod="openshift-insights/insights-runtime-extractor-rzpgp"
Sep 11 03:54:41.239312 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:41.239197    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-h76wv"]
Sep 11 03:54:41.242819 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:54:41.242784    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73868425_41c2_4554_aef0_2528200edc9d.slice/crio-33a97f2a2e011380ebfbc8dff588dfcef7052314614db923b4082996382655ab WatchSource:0}: Error finding container 33a97f2a2e011380ebfbc8dff588dfcef7052314614db923b4082996382655ab: Status 404 returned error can't find the container with id 33a97f2a2e011380ebfbc8dff588dfcef7052314614db923b4082996382655ab
Sep 11 03:54:41.257802 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:41.257740    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6cbcc5b4-7qjcp" event={"ID":"3f50223e-090d-49d8-a2e2-f0e16f99b816","Type":"ContainerStarted","Data":"0b6f2393b6b7385877b9294c5999b25cd8a401ec1550a69ea9b0f3bf84b1d8c7"}
Sep 11 03:54:41.259568 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:41.259542    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd869b74d-hwbxk" event={"ID":"02ec3e55-86c0-40c7-a97e-6f758acee98e","Type":"ContainerStarted","Data":"7ed591e438ab58aa07a2d215ddacea265533b29af09d108fab49531449fef79e"}
Sep 11 03:54:41.259693 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:41.259593    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd869b74d-hwbxk"
Sep 11 03:54:41.261030 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:41.260974    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-h76wv" event={"ID":"73868425-41c2-4554-aef0-2528200edc9d","Type":"ContainerStarted","Data":"33a97f2a2e011380ebfbc8dff588dfcef7052314614db923b4082996382655ab"}
Sep 11 03:54:41.261687 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:41.261664    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd869b74d-hwbxk"
Sep 11 03:54:41.273705 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:41.273642    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6cbcc5b4-7qjcp" podStartSLOduration=1.309124874 podStartE2EDuration="7.273619793s" totalImagesPullingTime="5.964494919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:54:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:54:41.272662806 +0000 UTC m=+78.070752537" watchObservedRunningTime="2026-09-11 03:54:41.273619793 +0000 UTC m=+78.071709520"
Sep 11 03:54:41.278536 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:41.278466    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-78556b97cb-rt5r7"]
Sep 11 03:54:41.292704 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:41.292639    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd869b74d-hwbxk" podStartSLOduration=1.317411174 podStartE2EDuration="7.292612299s" totalImagesPullingTime="5.975201125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:54:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:54:41.292022507 +0000 UTC m=+78.090112235" watchObservedRunningTime="2026-09-11 03:54:41.292612299 +0000 UTC m=+78.090702023"
Sep 11 03:54:41.379015 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:41.378891    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xkdhm\""
Sep 11 03:54:41.387161 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:41.387120    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rzpgp"
Sep 11 03:54:41.838871 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:54:41.838829    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42222ece_7ddd_483e_8ca8_934910a8fa25.slice/crio-9afb9f7f84d72341d39f27fff550747ae1e3540f28f457e482a30a9f81dd6fe5 WatchSource:0}: Error finding container 9afb9f7f84d72341d39f27fff550747ae1e3540f28f457e482a30a9f81dd6fe5: Status 404 returned error can't find the container with id 9afb9f7f84d72341d39f27fff550747ae1e3540f28f457e482a30a9f81dd6fe5
Sep 11 03:54:42.131575 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:42.131504    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rzpgp"]
Sep 11 03:54:42.134204 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:54:42.134170    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98be0e97_3076_42f5_be44_71b25c72f0ba.slice/crio-0535b2b144a36a8d50a30fda36e5272bceaf3ffa92f4e37f3a7591afac83367a WatchSource:0}: Error finding container 0535b2b144a36a8d50a30fda36e5272bceaf3ffa92f4e37f3a7591afac83367a: Status 404 returned error can't find the container with id 0535b2b144a36a8d50a30fda36e5272bceaf3ffa92f4e37f3a7591afac83367a
Sep 11 03:54:42.269940 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:42.269898    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-78556b97cb-rt5r7" event={"ID":"42222ece-7ddd-483e-8ca8-934910a8fa25","Type":"ContainerStarted","Data":"f0f7886904c9234a91136776939e966c0ba3317dc53ab5d8f3502e50f9374b2a"}
Sep 11 03:54:42.270456 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:42.269972    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-78556b97cb-rt5r7" event={"ID":"42222ece-7ddd-483e-8ca8-934910a8fa25","Type":"ContainerStarted","Data":"9afb9f7f84d72341d39f27fff550747ae1e3540f28f457e482a30a9f81dd6fe5"}
Sep 11 03:54:42.274033 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:42.273471    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lm5hf" event={"ID":"53d1b221-40dd-4507-b81a-4af75f45efaf","Type":"ContainerStarted","Data":"92065a3f7911d70397c9cce3614f29c2c66c593545883a7b9ad85a5f2fb0eb4a"}
Sep 11 03:54:42.276180 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:42.276148    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rzpgp" event={"ID":"98be0e97-3076-42f5-be44-71b25c72f0ba","Type":"ContainerStarted","Data":"a6b70ee252520a860bfea27dcd953e153234d646e801570de0e6d0142cef5c61"}
Sep 11 03:54:42.276332 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:42.276225    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rzpgp" event={"ID":"98be0e97-3076-42f5-be44-71b25c72f0ba","Type":"ContainerStarted","Data":"0535b2b144a36a8d50a30fda36e5272bceaf3ffa92f4e37f3a7591afac83367a"}
Sep 11 03:54:42.296885 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:42.296713    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-78556b97cb-rt5r7" podStartSLOduration=38.296688619 podStartE2EDuration="38.296688619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:54:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:54:42.296301667 +0000 UTC m=+79.094391396" watchObservedRunningTime="2026-09-11 03:54:42.296688619 +0000 UTC m=+79.094778347"
Sep 11 03:54:42.317310 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:42.317244    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lm5hf" podStartSLOduration=34.990156337 podStartE2EDuration="38.317218963s" totalImagesPullingTime="3.327062626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:54:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:54:42.316476298 +0000 UTC m=+79.114566023" watchObservedRunningTime="2026-09-11 03:54:42.317218963 +0000 UTC m=+79.115308671"
Sep 11 03:54:42.841351 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:42.841307    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-78556b97cb-rt5r7"
Sep 11 03:54:42.844920 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:42.844884    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-78556b97cb-rt5r7"
Sep 11 03:54:43.219003 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:43.218971    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jcsgz"
Sep 11 03:54:43.282896 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:43.282808    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rzpgp" event={"ID":"98be0e97-3076-42f5-be44-71b25c72f0ba","Type":"ContainerStarted","Data":"097f21be19c815d9cdb4f504c8b2753e883bf91cb61c147a56254a13a75f9010"}
Sep 11 03:54:43.284786 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:43.284754    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-h76wv" event={"ID":"73868425-41c2-4554-aef0-2528200edc9d","Type":"ContainerStarted","Data":"66bccee5c47a4d5d1c042ad4da77fcb132f728d1d2c1c93f574ebb029f407583"}
Sep 11 03:54:43.285374 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:43.285353    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-78556b97cb-rt5r7"
Sep 11 03:54:43.286780 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:43.286749    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-78556b97cb-rt5r7"
Sep 11 03:54:43.301979 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:43.301922    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-h76wv" podStartSLOduration=37.827940275 podStartE2EDuration="39.301902363s" totalImagesPullingTime="1.473962088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:54:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:54:43.301145993 +0000 UTC m=+80.099235721" watchObservedRunningTime="2026-09-11 03:54:43.301902363 +0000 UTC m=+80.099992090"
Sep 11 03:54:45.296404 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:45.296351    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rzpgp" event={"ID":"98be0e97-3076-42f5-be44-71b25c72f0ba","Type":"ContainerStarted","Data":"db3afe5fb4d432be5d142ed14e4fd472327edaf7d318676e2aed2831d2406ea3"}
Sep 11 03:54:45.317944 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:45.317877    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rzpgp" podStartSLOduration=34.051838166 podStartE2EDuration="36.317853722s" totalImagesPullingTime="2.266015556s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:54:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:54:45.316186092 +0000 UTC m=+82.114275820" watchObservedRunningTime="2026-09-11 03:54:45.317853722 +0000 UTC m=+82.115943451"
Sep 11 03:54:50.980769 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:50.980635    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wl6cc"]
Sep 11 03:54:50.994263 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:50.994226    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wl6cc"
Sep 11 03:54:50.998465 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:50.998131    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 03:54:50.998465 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:50.998278    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 03:54:50.998465 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:50.998350    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 03:54:50.998465 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:50.998361    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zn7tg\""
Sep 11 03:54:50.999216 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:50.999182    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 03:54:51.106456 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:51.106421    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4b207435-8f38-4d10-81a1-2a5c8948e12c-root\") pod \"node-exporter-wl6cc\" (UID: \"4b207435-8f38-4d10-81a1-2a5c8948e12c\") " pod="openshift-monitoring/node-exporter-wl6cc"
Sep 11 03:54:51.106643 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:51.106472    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4b207435-8f38-4d10-81a1-2a5c8948e12c-node-exporter-accelerators-collector-config\") pod \"node-exporter-wl6cc\" (UID: \"4b207435-8f38-4d10-81a1-2a5c8948e12c\") " pod="openshift-monitoring/node-exporter-wl6cc"
Sep 11 03:54:51.106643 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:51.106515    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b207435-8f38-4d10-81a1-2a5c8948e12c-metrics-client-ca\") pod \"node-exporter-wl6cc\" (UID: \"4b207435-8f38-4d10-81a1-2a5c8948e12c\") " pod="openshift-monitoring/node-exporter-wl6cc"
Sep 11 03:54:51.106643 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:51.106566    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b207435-8f38-4d10-81a1-2a5c8948e12c-sys\") pod \"node-exporter-wl6cc\" (UID: \"4b207435-8f38-4d10-81a1-2a5c8948e12c\") " pod="openshift-monitoring/node-exporter-wl6cc"
Sep 11 03:54:51.106643 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:51.106590    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4b207435-8f38-4d10-81a1-2a5c8948e12c-node-exporter-wtmp\") pod \"node-exporter-wl6cc\" (UID: \"4b207435-8f38-4d10-81a1-2a5c8948e12c\") " pod="openshift-monitoring/node-exporter-wl6cc"
Sep 11 03:54:51.106643 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:51.106617    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4b207435-8f38-4d10-81a1-2a5c8948e12c-node-exporter-tls\") pod \"node-exporter-wl6cc\" (UID: \"4b207435-8f38-4d10-81a1-2a5c8948e12c\") " pod="openshift-monitoring/node-exporter-wl6cc"
Sep 11 03:54:51.106861 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:51.106687    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4b207435-8f38-4d10-81a1-2a5c8948e12c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wl6cc\" (UID: \"4b207435-8f38-4d10-81a1-2a5c8948e12c\") " pod="openshift-monitoring/node-exporter-wl6cc"
Sep 11 03:54:51.106861 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:51.106703    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4b207435-8f38-4d10-81a1-2a5c8948e12c-node-exporter-textfile\") pod \"node-exporter-wl6cc\" (UID: \"4b207435-8f38-4d10-81a1-2a5c8948e12c\") " pod="openshift-monitoring/node-exporter-wl6cc"
Sep 11 03:54:51.106861 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:51.106722    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-277kq\" (UniqueName: \"kubernetes.io/projected/4b207435-8f38-4d10-81a1-2a5c8948e12c-kube-api-access-277kq\") pod \"node-exporter-wl6cc\" (UID: \"4b207435-8f38-4d10-81a1-2a5c8948e12c\") " pod="openshift-monitoring/node-exporter-wl6cc"
Sep 11 03:54:51.208014 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:51.207970    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4b207435-8f38-4d10-81a1-2a5c8948e12c-node-exporter-tls\") pod \"node-exporter-wl6cc\" (UID: \"4b207435-8f38-4d10-81a1-2a5c8948e12c\") " pod="openshift-monitoring/node-exporter-wl6cc"
Sep 11 03:54:51.208203 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:51.208039    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4b207435-8f38-4d10-81a1-2a5c8948e12c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wl6cc\" (UID: \"4b207435-8f38-4d10-81a1-2a5c8948e12c\") " pod="openshift-monitoring/node-exporter-wl6cc"
Sep 11 03:54:51.208203 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:51.208067    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4b207435-8f38-4d10-81a1-2a5c8948e12c-node-exporter-textfile\") pod \"node-exporter-wl6cc\" (UID: \"4b207435-8f38-4d10-81a1-2a5c8948e12c\") " pod="openshift-monitoring/node-exporter-wl6cc"
Sep 11 03:54:51.208203 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:51.208093    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-277kq\" (UniqueName: \"kubernetes.io/projected/4b207435-8f38-4d10-81a1-2a5c8948e12c-kube-api-access-277kq\") pod \"node-exporter-wl6cc\" (UID: \"4b207435-8f38-4d10-81a1-2a5c8948e12c\") " pod="openshift-monitoring/node-exporter-wl6cc"
Sep 11 03:54:51.208203 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:51.208136    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4b207435-8f38-4d10-81a1-2a5c8948e12c-root\") pod \"node-exporter-wl6cc\" (UID: \"4b207435-8f38-4d10-81a1-2a5c8948e12c\") " pod="openshift-monitoring/node-exporter-wl6cc"
Sep 11 03:54:51.208203 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:51.208171    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4b207435-8f38-4d10-81a1-2a5c8948e12c-node-exporter-accelerators-collector-config\") pod \"node-exporter-wl6cc\" (UID: \"4b207435-8f38-4d10-81a1-2a5c8948e12c\") " pod="openshift-monitoring/node-exporter-wl6cc"
Sep 11 03:54:51.209355 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:51.208216    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b207435-8f38-4d10-81a1-2a5c8948e12c-metrics-client-ca\") pod \"node-exporter-wl6cc\" (UID: \"4b207435-8f38-4d10-81a1-2a5c8948e12c\") " pod="openshift-monitoring/node-exporter-wl6cc"
Sep 11 03:54:51.209355 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:51.208250    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b207435-8f38-4d10-81a1-2a5c8948e12c-sys\") pod \"node-exporter-wl6cc\" (UID: \"4b207435-8f38-4d10-81a1-2a5c8948e12c\") " pod="openshift-monitoring/node-exporter-wl6cc"
Sep 11 03:54:51.209355 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:51.208273    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4b207435-8f38-4d10-81a1-2a5c8948e12c-node-exporter-wtmp\") pod \"node-exporter-wl6cc\" (UID: \"4b207435-8f38-4d10-81a1-2a5c8948e12c\") " pod="openshift-monitoring/node-exporter-wl6cc"
Sep 11 03:54:51.209355 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:51.208480    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4b207435-8f38-4d10-81a1-2a5c8948e12c-node-exporter-wtmp\") pod \"node-exporter-wl6cc\" (UID: \"4b207435-8f38-4d10-81a1-2a5c8948e12c\") " pod="openshift-monitoring/node-exporter-wl6cc"
Sep 11 03:54:51.209355 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:51.208551    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4b207435-8f38-4d10-81a1-2a5c8948e12c-root\") pod \"node-exporter-wl6cc\" (UID: \"4b207435-8f38-4d10-81a1-2a5c8948e12c\") " pod="openshift-monitoring/node-exporter-wl6cc"
Sep 11 03:54:51.209355 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:51.209102    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4b207435-8f38-4d10-81a1-2a5c8948e12c-node-exporter-textfile\") pod \"node-exporter-wl6cc\" (UID: \"4b207435-8f38-4d10-81a1-2a5c8948e12c\") " pod="openshift-monitoring/node-exporter-wl6cc"
Sep 11 03:54:51.209355 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:51.209136    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4b207435-8f38-4d10-81a1-2a5c8948e12c-node-exporter-accelerators-collector-config\") pod \"node-exporter-wl6cc\" (UID: \"4b207435-8f38-4d10-81a1-2a5c8948e12c\") " pod="openshift-monitoring/node-exporter-wl6cc"
Sep 11 03:54:51.209355 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:51.209190    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b207435-8f38-4d10-81a1-2a5c8948e12c-sys\") pod \"node-exporter-wl6cc\" (UID: \"4b207435-8f38-4d10-81a1-2a5c8948e12c\") " pod="openshift-monitoring/node-exporter-wl6cc"
Sep 11 03:54:51.209808 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:51.209720    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b207435-8f38-4d10-81a1-2a5c8948e12c-metrics-client-ca\") pod \"node-exporter-wl6cc\" (UID: \"4b207435-8f38-4d10-81a1-2a5c8948e12c\") " pod="openshift-monitoring/node-exporter-wl6cc"
Sep 11 03:54:51.211947 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:51.211925    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4b207435-8f38-4d10-81a1-2a5c8948e12c-node-exporter-tls\") pod \"node-exporter-wl6cc\" (UID: \"4b207435-8f38-4d10-81a1-2a5c8948e12c\") " pod="openshift-monitoring/node-exporter-wl6cc"
Sep 11 03:54:51.212137 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:51.212113    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4b207435-8f38-4d10-81a1-2a5c8948e12c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wl6cc\" (UID: \"4b207435-8f38-4d10-81a1-2a5c8948e12c\") " pod="openshift-monitoring/node-exporter-wl6cc"
Sep 11 03:54:51.218142 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:51.218110    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-277kq\" (UniqueName: \"kubernetes.io/projected/4b207435-8f38-4d10-81a1-2a5c8948e12c-kube-api-access-277kq\") pod \"node-exporter-wl6cc\" (UID: \"4b207435-8f38-4d10-81a1-2a5c8948e12c\") " pod="openshift-monitoring/node-exporter-wl6cc"
Sep 11 03:54:51.305629 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:51.305528    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wl6cc"
Sep 11 03:54:52.777378 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:54:52.777346    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b207435_8f38_4d10_81a1_2a5c8948e12c.slice/crio-c22bb6b0f822cf35975dd44f70c8b10b7a518f7202fff1aceaa64628499077ec WatchSource:0}: Error finding container c22bb6b0f822cf35975dd44f70c8b10b7a518f7202fff1aceaa64628499077ec: Status 404 returned error can't find the container with id c22bb6b0f822cf35975dd44f70c8b10b7a518f7202fff1aceaa64628499077ec
Sep 11 03:54:53.330684 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:53.330650    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-b9zbm" event={"ID":"e80fdc87-5412-4a97-a1cc-d68c5511edf2","Type":"ContainerStarted","Data":"5f96f9727ab232e99b29bab7745f3de120c0fbeb507a4ba36ed6b04bea1da124"}
Sep 11 03:54:53.330898 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:53.330875    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-b9zbm"
Sep 11 03:54:53.332486 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:53.332442    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wl6cc" event={"ID":"4b207435-8f38-4d10-81a1-2a5c8948e12c","Type":"ContainerStarted","Data":"c22bb6b0f822cf35975dd44f70c8b10b7a518f7202fff1aceaa64628499077ec"}
Sep 11 03:54:53.332839 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:53.332809    2558 patch_prober.go:28] interesting pod/downloads-76f99584f4-b9zbm container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.17:8080/\": dial tcp 10.133.0.17:8080: connect: connection refused" start-of-body=
Sep 11 03:54:53.332956 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:53.332869    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-76f99584f4-b9zbm" podUID="e80fdc87-5412-4a97-a1cc-d68c5511edf2" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.17:8080/\": dial tcp 10.133.0.17:8080: connect: connection refused"
Sep 11 03:54:53.361218 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:53.361100    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-b9zbm" podStartSLOduration=1.38581687 podStartE2EDuration="19.361076188s" totalImagesPullingTime="17.975259318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:54:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:54:53.358856826 +0000 UTC m=+90.156946557" watchObservedRunningTime="2026-09-11 03:54:53.361076188 +0000 UTC m=+90.159165915"
Sep 11 03:54:54.339252 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:54.339212    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wl6cc" event={"ID":"4b207435-8f38-4d10-81a1-2a5c8948e12c","Type":"ContainerStarted","Data":"52dff422da516ddbb94f6e29a815a7d60aecd1556572ae3fd9976ef9a45d4b47"}
Sep 11 03:54:54.354256 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:54.354219    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-b9zbm"
Sep 11 03:54:55.346039 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:55.345992    2558 generic.go:356] "Generic (PLEG): container finished" podID="4b207435-8f38-4d10-81a1-2a5c8948e12c" containerID="52dff422da516ddbb94f6e29a815a7d60aecd1556572ae3fd9976ef9a45d4b47" exitCode=0
Sep 11 03:54:55.346613 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:55.346076    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wl6cc" event={"ID":"4b207435-8f38-4d10-81a1-2a5c8948e12c","Type":"ContainerDied","Data":"52dff422da516ddbb94f6e29a815a7d60aecd1556572ae3fd9976ef9a45d4b47"}
Sep 11 03:54:56.353338 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:56.353294    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wl6cc" event={"ID":"4b207435-8f38-4d10-81a1-2a5c8948e12c","Type":"ContainerStarted","Data":"32c5ac960098093ff618974e732f6a246274b18b769e5e88204eeda3fdb5db9a"}
Sep 11 03:54:56.353838 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:56.353358    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wl6cc" event={"ID":"4b207435-8f38-4d10-81a1-2a5c8948e12c","Type":"ContainerStarted","Data":"31a2618e29b7a1b6118bdeac19907a77ac08d560c45383ca7dee48b25e69f963"}
Sep 11 03:54:56.374186 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:56.374128    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wl6cc" podStartSLOduration=4.935696483 podStartE2EDuration="6.374107466s" totalImagesPullingTime="1.338682647s" totalInitContainerRuntime="99.728336ms" isStatefulPod=true podCreationTimestamp="2026-09-11 03:54:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:54:56.371990114 +0000 UTC m=+93.170079841" watchObservedRunningTime="2026-09-11 03:54:56.374107466 +0000 UTC m=+93.172197197"
Sep 11 03:54:57.244358 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:54:57.244324    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6b78dcfd7c-gll52"
Sep 11 03:55:00.194872 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:55:00.194835    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5bl6k"
Sep 11 03:55:15.425013 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:55:15.424977    2558 generic.go:356] "Generic (PLEG): container finished" podID="3edf877a-83ca-403f-a8f2-68e71b208eb4" containerID="7eb79193f31638bd0c0a675eb728e1c1f8375962899be023e4b24a079843616a" exitCode=0
Sep 11 03:55:15.425435 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:55:15.425045    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4z8c9" event={"ID":"3edf877a-83ca-403f-a8f2-68e71b208eb4","Type":"ContainerDied","Data":"7eb79193f31638bd0c0a675eb728e1c1f8375962899be023e4b24a079843616a"}
Sep 11 03:55:15.425435 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:55:15.425419    2558 scope.go:117] "RemoveContainer" containerID="7eb79193f31638bd0c0a675eb728e1c1f8375962899be023e4b24a079843616a"
Sep 11 03:55:16.432854 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:55:16.432816    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4z8c9" event={"ID":"3edf877a-83ca-403f-a8f2-68e71b208eb4","Type":"ContainerStarted","Data":"5af01f6eb8abf166e4f38ae3285ca02a19da6b75969a2c8966237f1297700f00"}
Sep 11 03:55:39.939832 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:55:39.939797    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78556b97cb-rt5r7_42222ece-7ddd-483e-8ca8-934910a8fa25/router/0.log"
Sep 11 03:55:39.967804 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:55:39.967773    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tfr46_57ce4512-0f2a-462f-bf95-6cd72f7f727b/serve-healthcheck-canary/0.log"
Sep 11 03:58:23.685055 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:23.685027    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nfssn_c9add74a-5c51-4ccf-9edd-3b90a66b9ef9/ovn-acl-logging/0.log"
Sep 11 03:58:23.688068 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:23.688045    2558 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 03:58:23.688483 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:23.688458    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nfssn_c9add74a-5c51-4ccf-9edd-3b90a66b9ef9/ovn-acl-logging/0.log"
Sep 11 03:58:37.691774 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:37.691741    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407lnqb"]
Sep 11 03:58:37.694038 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:37.694023    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407lnqb"
Sep 11 03:58:37.696379 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:37.696356    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 03:58:37.697268 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:37.697253    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kd9lt\""
Sep 11 03:58:37.697337 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:37.697255    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 03:58:37.703483 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:37.703456    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407lnqb"]
Sep 11 03:58:37.787849 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:37.787817    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/172e322f-9de8-418c-9afb-de4bd027edcf-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407lnqb\" (UID: \"172e322f-9de8-418c-9afb-de4bd027edcf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407lnqb"
Sep 11 03:58:37.788024 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:37.787860    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/172e322f-9de8-418c-9afb-de4bd027edcf-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407lnqb\" (UID: \"172e322f-9de8-418c-9afb-de4bd027edcf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407lnqb"
Sep 11 03:58:37.788024 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:37.787922    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2swpf\" (UniqueName: \"kubernetes.io/projected/172e322f-9de8-418c-9afb-de4bd027edcf-kube-api-access-2swpf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407lnqb\" (UID: \"172e322f-9de8-418c-9afb-de4bd027edcf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407lnqb"
Sep 11 03:58:37.888555 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:37.888519    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/172e322f-9de8-418c-9afb-de4bd027edcf-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407lnqb\" (UID: \"172e322f-9de8-418c-9afb-de4bd027edcf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407lnqb"
Sep 11 03:58:37.888717 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:37.888562    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/172e322f-9de8-418c-9afb-de4bd027edcf-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407lnqb\" (UID: \"172e322f-9de8-418c-9afb-de4bd027edcf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407lnqb"
Sep 11 03:58:37.888717 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:37.888610    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2swpf\" (UniqueName: \"kubernetes.io/projected/172e322f-9de8-418c-9afb-de4bd027edcf-kube-api-access-2swpf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407lnqb\" (UID: \"172e322f-9de8-418c-9afb-de4bd027edcf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407lnqb"
Sep 11 03:58:37.888987 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:37.888966    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/172e322f-9de8-418c-9afb-de4bd027edcf-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407lnqb\" (UID: \"172e322f-9de8-418c-9afb-de4bd027edcf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407lnqb"
Sep 11 03:58:37.889055 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:37.888985    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/172e322f-9de8-418c-9afb-de4bd027edcf-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407lnqb\" (UID: \"172e322f-9de8-418c-9afb-de4bd027edcf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407lnqb"
Sep 11 03:58:37.896549 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:37.896526    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2swpf\" (UniqueName: \"kubernetes.io/projected/172e322f-9de8-418c-9afb-de4bd027edcf-kube-api-access-2swpf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407lnqb\" (UID: \"172e322f-9de8-418c-9afb-de4bd027edcf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407lnqb"
Sep 11 03:58:38.002898 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:38.002849    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407lnqb"
Sep 11 03:58:38.269484 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:38.269454    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407lnqb"]
Sep 11 03:58:38.271792 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:58:38.271760    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod172e322f_9de8_418c_9afb_de4bd027edcf.slice/crio-a30d35b7b992b0057f489043dd84a254b2225e7924e93c5644e93c6987b93c26 WatchSource:0}: Error finding container a30d35b7b992b0057f489043dd84a254b2225e7924e93c5644e93c6987b93c26: Status 404 returned error can't find the container with id a30d35b7b992b0057f489043dd84a254b2225e7924e93c5644e93c6987b93c26
Sep 11 03:58:38.273770 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:38.273752    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 03:58:39.131612 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:39.131572    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407lnqb" event={"ID":"172e322f-9de8-418c-9afb-de4bd027edcf","Type":"ContainerStarted","Data":"a30d35b7b992b0057f489043dd84a254b2225e7924e93c5644e93c6987b93c26"}
Sep 11 03:58:45.155488 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:45.155453    2558 generic.go:356] "Generic (PLEG): container finished" podID="172e322f-9de8-418c-9afb-de4bd027edcf" containerID="7fae93c239d8b272743257de95f20ea997dfe94beabe94be957f25694018aa4a" exitCode=0
Sep 11 03:58:45.155863 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:45.155503    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407lnqb" event={"ID":"172e322f-9de8-418c-9afb-de4bd027edcf","Type":"ContainerDied","Data":"7fae93c239d8b272743257de95f20ea997dfe94beabe94be957f25694018aa4a"}
Sep 11 03:58:48.169014 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:48.168972    2558 generic.go:356] "Generic (PLEG): container finished" podID="172e322f-9de8-418c-9afb-de4bd027edcf" containerID="6e6ceded82aa5ff980d70936a458d85d9c1220221bd2b57ec9a3391c31feb6c0" exitCode=0
Sep 11 03:58:48.169459 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:48.169043    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407lnqb" event={"ID":"172e322f-9de8-418c-9afb-de4bd027edcf","Type":"ContainerDied","Data":"6e6ceded82aa5ff980d70936a458d85d9c1220221bd2b57ec9a3391c31feb6c0"}
Sep 11 03:58:56.201745 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:56.201708    2558 generic.go:356] "Generic (PLEG): container finished" podID="172e322f-9de8-418c-9afb-de4bd027edcf" containerID="44ebd906871ee6bac80ae757215f2c3ad4804254691cb1e6d9ada6fef049fab9" exitCode=0
Sep 11 03:58:56.201745 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:56.201749    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407lnqb" event={"ID":"172e322f-9de8-418c-9afb-de4bd027edcf","Type":"ContainerDied","Data":"44ebd906871ee6bac80ae757215f2c3ad4804254691cb1e6d9ada6fef049fab9"}
Sep 11 03:58:57.320982 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:57.320960    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407lnqb"
Sep 11 03:58:57.448936 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:57.448905    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/172e322f-9de8-418c-9afb-de4bd027edcf-bundle\") pod \"172e322f-9de8-418c-9afb-de4bd027edcf\" (UID: \"172e322f-9de8-418c-9afb-de4bd027edcf\") "
Sep 11 03:58:57.449101 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:57.448953    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2swpf\" (UniqueName: \"kubernetes.io/projected/172e322f-9de8-418c-9afb-de4bd027edcf-kube-api-access-2swpf\") pod \"172e322f-9de8-418c-9afb-de4bd027edcf\" (UID: \"172e322f-9de8-418c-9afb-de4bd027edcf\") "
Sep 11 03:58:57.449101 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:57.448990    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/172e322f-9de8-418c-9afb-de4bd027edcf-util\") pod \"172e322f-9de8-418c-9afb-de4bd027edcf\" (UID: \"172e322f-9de8-418c-9afb-de4bd027edcf\") "
Sep 11 03:58:57.449610 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:57.449581    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/172e322f-9de8-418c-9afb-de4bd027edcf-bundle" (OuterVolumeSpecName: "bundle") pod "172e322f-9de8-418c-9afb-de4bd027edcf" (UID: "172e322f-9de8-418c-9afb-de4bd027edcf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 03:58:57.451108 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:57.451076    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/172e322f-9de8-418c-9afb-de4bd027edcf-kube-api-access-2swpf" (OuterVolumeSpecName: "kube-api-access-2swpf") pod "172e322f-9de8-418c-9afb-de4bd027edcf" (UID: "172e322f-9de8-418c-9afb-de4bd027edcf"). InnerVolumeSpecName "kube-api-access-2swpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 03:58:57.453104 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:57.453084    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/172e322f-9de8-418c-9afb-de4bd027edcf-util" (OuterVolumeSpecName: "util") pod "172e322f-9de8-418c-9afb-de4bd027edcf" (UID: "172e322f-9de8-418c-9afb-de4bd027edcf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 03:58:57.549710 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:57.549657    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2swpf\" (UniqueName: \"kubernetes.io/projected/172e322f-9de8-418c-9afb-de4bd027edcf-kube-api-access-2swpf\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 03:58:57.549710 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:57.549677    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/172e322f-9de8-418c-9afb-de4bd027edcf-util\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 03:58:57.549710 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:57.549687    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/172e322f-9de8-418c-9afb-de4bd027edcf-bundle\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 03:58:58.210698 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:58.210616    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407lnqb"
Sep 11 03:58:58.210698 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:58.210624    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407lnqb" event={"ID":"172e322f-9de8-418c-9afb-de4bd027edcf","Type":"ContainerDied","Data":"a30d35b7b992b0057f489043dd84a254b2225e7924e93c5644e93c6987b93c26"}
Sep 11 03:58:58.210698 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:58:58.210693    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a30d35b7b992b0057f489043dd84a254b2225e7924e93c5644e93c6987b93c26"
Sep 11 03:59:05.787120 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:05.787086    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g95gs"]
Sep 11 03:59:05.787562 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:05.787375    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="172e322f-9de8-418c-9afb-de4bd027edcf" containerName="pull"
Sep 11 03:59:05.787562 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:05.787405    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="172e322f-9de8-418c-9afb-de4bd027edcf" containerName="pull"
Sep 11 03:59:05.787562 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:05.787413    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="172e322f-9de8-418c-9afb-de4bd027edcf" containerName="extract"
Sep 11 03:59:05.787562 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:05.787419    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="172e322f-9de8-418c-9afb-de4bd027edcf" containerName="extract"
Sep 11 03:59:05.787562 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:05.787432    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="172e322f-9de8-418c-9afb-de4bd027edcf" containerName="util"
Sep 11 03:59:05.787562 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:05.787437    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="172e322f-9de8-418c-9afb-de4bd027edcf" containerName="util"
Sep 11 03:59:05.787562 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:05.787486    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="172e322f-9de8-418c-9afb-de4bd027edcf" containerName="extract"
Sep 11 03:59:05.792012 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:05.791995    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g95gs"
Sep 11 03:59:05.794954 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:05.794935    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 11 03:59:05.795325 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:05.795306    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 11 03:59:05.795584 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:05.795564    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-8pffg\""
Sep 11 03:59:05.809167 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:05.809144    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g95gs"]
Sep 11 03:59:05.912534 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:05.912509    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/292dece8-edd8-4c6a-af96-fe54106e7d8d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-g95gs\" (UID: \"292dece8-edd8-4c6a-af96-fe54106e7d8d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g95gs"
Sep 11 03:59:05.912641 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:05.912565    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6qbx\" (UniqueName: \"kubernetes.io/projected/292dece8-edd8-4c6a-af96-fe54106e7d8d-kube-api-access-v6qbx\") pod \"cert-manager-operator-controller-manager-55c444bf86-g95gs\" (UID: \"292dece8-edd8-4c6a-af96-fe54106e7d8d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g95gs"
Sep 11 03:59:06.013229 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:06.013188    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6qbx\" (UniqueName: \"kubernetes.io/projected/292dece8-edd8-4c6a-af96-fe54106e7d8d-kube-api-access-v6qbx\") pod \"cert-manager-operator-controller-manager-55c444bf86-g95gs\" (UID: \"292dece8-edd8-4c6a-af96-fe54106e7d8d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g95gs"
Sep 11 03:59:06.013370 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:06.013255    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/292dece8-edd8-4c6a-af96-fe54106e7d8d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-g95gs\" (UID: \"292dece8-edd8-4c6a-af96-fe54106e7d8d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g95gs"
Sep 11 03:59:06.013617 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:06.013598    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/292dece8-edd8-4c6a-af96-fe54106e7d8d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-g95gs\" (UID: \"292dece8-edd8-4c6a-af96-fe54106e7d8d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g95gs"
Sep 11 03:59:06.023807 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:06.023782    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6qbx\" (UniqueName: \"kubernetes.io/projected/292dece8-edd8-4c6a-af96-fe54106e7d8d-kube-api-access-v6qbx\") pod \"cert-manager-operator-controller-manager-55c444bf86-g95gs\" (UID: \"292dece8-edd8-4c6a-af96-fe54106e7d8d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g95gs"
Sep 11 03:59:06.100918 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:06.100895    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g95gs"
Sep 11 03:59:06.376120 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:06.376041    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g95gs"]
Sep 11 03:59:06.379089 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:59:06.379063    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod292dece8_edd8_4c6a_af96_fe54106e7d8d.slice/crio-02922fecc0af3507b656be8985dcc16068cb3e29f1f8f17cc7f0700f18a74a22 WatchSource:0}: Error finding container 02922fecc0af3507b656be8985dcc16068cb3e29f1f8f17cc7f0700f18a74a22: Status 404 returned error can't find the container with id 02922fecc0af3507b656be8985dcc16068cb3e29f1f8f17cc7f0700f18a74a22
Sep 11 03:59:07.245150 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:07.245115    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g95gs" event={"ID":"292dece8-edd8-4c6a-af96-fe54106e7d8d","Type":"ContainerStarted","Data":"02922fecc0af3507b656be8985dcc16068cb3e29f1f8f17cc7f0700f18a74a22"}
Sep 11 03:59:08.250706 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:08.250667    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g95gs" event={"ID":"292dece8-edd8-4c6a-af96-fe54106e7d8d","Type":"ContainerStarted","Data":"aafb53eef3264189065aa805418797df332f1c95313804dab17e10fae092d959"}
Sep 11 03:59:08.280810 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:08.280757    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g95gs" podStartSLOduration=1.51462582 podStartE2EDuration="3.280741563s" totalImagesPullingTime="1.766115743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:59:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:59:08.278311349 +0000 UTC m=+345.076401075" watchObservedRunningTime="2026-09-11 03:59:08.280741563 +0000 UTC m=+345.078831290"
Sep 11 03:59:09.481366 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:09.481333    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flcjz6"]
Sep 11 03:59:09.483561 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:09.483544    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flcjz6"
Sep 11 03:59:09.485867 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:09.485845    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 03:59:09.486841 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:09.486824    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kd9lt\""
Sep 11 03:59:09.486930 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:09.486839    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 03:59:09.494088 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:09.494064    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flcjz6"]
Sep 11 03:59:09.646216 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:09.646180    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/648e87b6-d59e-4e83-a784-8080fcddcdac-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flcjz6\" (UID: \"648e87b6-d59e-4e83-a784-8080fcddcdac\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flcjz6"
Sep 11 03:59:09.646372 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:09.646223    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xrhd\" (UniqueName: \"kubernetes.io/projected/648e87b6-d59e-4e83-a784-8080fcddcdac-kube-api-access-6xrhd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flcjz6\" (UID: \"648e87b6-d59e-4e83-a784-8080fcddcdac\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flcjz6"
Sep 11 03:59:09.646372 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:09.646249    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/648e87b6-d59e-4e83-a784-8080fcddcdac-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flcjz6\" (UID: \"648e87b6-d59e-4e83-a784-8080fcddcdac\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flcjz6"
Sep 11 03:59:09.747006 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:09.746927    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/648e87b6-d59e-4e83-a784-8080fcddcdac-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flcjz6\" (UID: \"648e87b6-d59e-4e83-a784-8080fcddcdac\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flcjz6"
Sep 11 03:59:09.747006 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:09.746992    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/648e87b6-d59e-4e83-a784-8080fcddcdac-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flcjz6\" (UID: \"648e87b6-d59e-4e83-a784-8080fcddcdac\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flcjz6"
Sep 11 03:59:09.747194 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:09.747016    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xrhd\" (UniqueName: \"kubernetes.io/projected/648e87b6-d59e-4e83-a784-8080fcddcdac-kube-api-access-6xrhd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flcjz6\" (UID: \"648e87b6-d59e-4e83-a784-8080fcddcdac\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flcjz6"
Sep 11 03:59:09.747382 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:09.747358    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/648e87b6-d59e-4e83-a784-8080fcddcdac-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flcjz6\" (UID: \"648e87b6-d59e-4e83-a784-8080fcddcdac\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flcjz6"
Sep 11 03:59:09.747382 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:09.747373    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/648e87b6-d59e-4e83-a784-8080fcddcdac-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flcjz6\" (UID: \"648e87b6-d59e-4e83-a784-8080fcddcdac\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flcjz6"
Sep 11 03:59:09.757965 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:09.757937    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xrhd\" (UniqueName: \"kubernetes.io/projected/648e87b6-d59e-4e83-a784-8080fcddcdac-kube-api-access-6xrhd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flcjz6\" (UID: \"648e87b6-d59e-4e83-a784-8080fcddcdac\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flcjz6"
Sep 11 03:59:09.797813 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:09.797774    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flcjz6"
Sep 11 03:59:10.066212 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:10.066077    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flcjz6"]
Sep 11 03:59:10.068658 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:59:10.068633    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod648e87b6_d59e_4e83_a784_8080fcddcdac.slice/crio-73f763b87d9598115c8af53f46a923453fae2b46be642defbbf98f4f49b84531 WatchSource:0}: Error finding container 73f763b87d9598115c8af53f46a923453fae2b46be642defbbf98f4f49b84531: Status 404 returned error can't find the container with id 73f763b87d9598115c8af53f46a923453fae2b46be642defbbf98f4f49b84531
Sep 11 03:59:10.259800 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:10.259768    2558 generic.go:356] "Generic (PLEG): container finished" podID="648e87b6-d59e-4e83-a784-8080fcddcdac" containerID="5fcf89e0d338b1a1b566727de7783b96546894c27ad2e9fbc5ea57fe4443ea32" exitCode=0
Sep 11 03:59:10.259970 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:10.259850    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flcjz6" event={"ID":"648e87b6-d59e-4e83-a784-8080fcddcdac","Type":"ContainerDied","Data":"5fcf89e0d338b1a1b566727de7783b96546894c27ad2e9fbc5ea57fe4443ea32"}
Sep 11 03:59:10.259970 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:10.259888    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flcjz6" event={"ID":"648e87b6-d59e-4e83-a784-8080fcddcdac","Type":"ContainerStarted","Data":"73f763b87d9598115c8af53f46a923453fae2b46be642defbbf98f4f49b84531"}
Sep 11 03:59:12.269631 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:12.269604    2558 generic.go:356] "Generic (PLEG): container finished" podID="648e87b6-d59e-4e83-a784-8080fcddcdac" containerID="3f3f5b73b6236897679bdb9952698d28298443f4650318a6c6319d430bfa67e3" exitCode=0
Sep 11 03:59:12.269966 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:12.269646    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flcjz6" event={"ID":"648e87b6-d59e-4e83-a784-8080fcddcdac","Type":"ContainerDied","Data":"3f3f5b73b6236897679bdb9952698d28298443f4650318a6c6319d430bfa67e3"}
Sep 11 03:59:13.275758 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:13.275724    2558 generic.go:356] "Generic (PLEG): container finished" podID="648e87b6-d59e-4e83-a784-8080fcddcdac" containerID="d57458d7e8b5c3ab1bb77060abf51615a847ce661583c163a3e0a62540122686" exitCode=0
Sep 11 03:59:13.276121 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:13.275768    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flcjz6" event={"ID":"648e87b6-d59e-4e83-a784-8080fcddcdac","Type":"ContainerDied","Data":"d57458d7e8b5c3ab1bb77060abf51615a847ce661583c163a3e0a62540122686"}
Sep 11 03:59:14.403555 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:14.403524    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flcjz6"
Sep 11 03:59:14.584483 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:14.584456    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xrhd\" (UniqueName: \"kubernetes.io/projected/648e87b6-d59e-4e83-a784-8080fcddcdac-kube-api-access-6xrhd\") pod \"648e87b6-d59e-4e83-a784-8080fcddcdac\" (UID: \"648e87b6-d59e-4e83-a784-8080fcddcdac\") "
Sep 11 03:59:14.584624 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:14.584515    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/648e87b6-d59e-4e83-a784-8080fcddcdac-util\") pod \"648e87b6-d59e-4e83-a784-8080fcddcdac\" (UID: \"648e87b6-d59e-4e83-a784-8080fcddcdac\") "
Sep 11 03:59:14.584624 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:14.584560    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/648e87b6-d59e-4e83-a784-8080fcddcdac-bundle\") pod \"648e87b6-d59e-4e83-a784-8080fcddcdac\" (UID: \"648e87b6-d59e-4e83-a784-8080fcddcdac\") "
Sep 11 03:59:14.584988 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:14.584959    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/648e87b6-d59e-4e83-a784-8080fcddcdac-bundle" (OuterVolumeSpecName: "bundle") pod "648e87b6-d59e-4e83-a784-8080fcddcdac" (UID: "648e87b6-d59e-4e83-a784-8080fcddcdac"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 03:59:14.586479 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:14.586456    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/648e87b6-d59e-4e83-a784-8080fcddcdac-kube-api-access-6xrhd" (OuterVolumeSpecName: "kube-api-access-6xrhd") pod "648e87b6-d59e-4e83-a784-8080fcddcdac" (UID: "648e87b6-d59e-4e83-a784-8080fcddcdac"). InnerVolumeSpecName "kube-api-access-6xrhd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 03:59:14.589943 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:14.589911    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/648e87b6-d59e-4e83-a784-8080fcddcdac-util" (OuterVolumeSpecName: "util") pod "648e87b6-d59e-4e83-a784-8080fcddcdac" (UID: "648e87b6-d59e-4e83-a784-8080fcddcdac"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 03:59:14.686005 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:14.685972    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/648e87b6-d59e-4e83-a784-8080fcddcdac-util\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 03:59:14.686005 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:14.685999    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/648e87b6-d59e-4e83-a784-8080fcddcdac-bundle\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 03:59:14.686005 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:14.686009    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xrhd\" (UniqueName: \"kubernetes.io/projected/648e87b6-d59e-4e83-a784-8080fcddcdac-kube-api-access-6xrhd\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 03:59:15.286267 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:15.286235    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flcjz6" event={"ID":"648e87b6-d59e-4e83-a784-8080fcddcdac","Type":"ContainerDied","Data":"73f763b87d9598115c8af53f46a923453fae2b46be642defbbf98f4f49b84531"}
Sep 11 03:59:15.286267 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:15.286268    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flcjz6"
Sep 11 03:59:15.286494 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:15.286286    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="73f763b87d9598115c8af53f46a923453fae2b46be642defbbf98f4f49b84531"
Sep 11 03:59:17.288184 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:17.288104    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-h8gwm"]
Sep 11 03:59:17.288568 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:17.288424    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="648e87b6-d59e-4e83-a784-8080fcddcdac" containerName="util"
Sep 11 03:59:17.288568 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:17.288438    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="648e87b6-d59e-4e83-a784-8080fcddcdac" containerName="util"
Sep 11 03:59:17.288568 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:17.288456    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="648e87b6-d59e-4e83-a784-8080fcddcdac" containerName="pull"
Sep 11 03:59:17.288568 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:17.288462    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="648e87b6-d59e-4e83-a784-8080fcddcdac" containerName="pull"
Sep 11 03:59:17.288568 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:17.288468    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="648e87b6-d59e-4e83-a784-8080fcddcdac" containerName="extract"
Sep 11 03:59:17.288568 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:17.288474    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="648e87b6-d59e-4e83-a784-8080fcddcdac" containerName="extract"
Sep 11 03:59:17.288568 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:17.288515    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="648e87b6-d59e-4e83-a784-8080fcddcdac" containerName="extract"
Sep 11 03:59:17.290215 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:17.290195    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-h8gwm"
Sep 11 03:59:17.292654 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:17.292630    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-9jw9f\""
Sep 11 03:59:17.292777 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:17.292653    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 11 03:59:17.293648 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:17.293629    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 11 03:59:17.298085 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:17.298065    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-h8gwm"]
Sep 11 03:59:17.305729 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:17.305705    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa19b772-e605-4cf8-ac25-2907fcb0efad-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-h8gwm\" (UID: \"aa19b772-e605-4cf8-ac25-2907fcb0efad\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-h8gwm"
Sep 11 03:59:17.305815 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:17.305789    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnzx4\" (UniqueName: \"kubernetes.io/projected/aa19b772-e605-4cf8-ac25-2907fcb0efad-kube-api-access-cnzx4\") pod \"cert-manager-cainjector-559cdd8c87-h8gwm\" (UID: \"aa19b772-e605-4cf8-ac25-2907fcb0efad\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-h8gwm"
Sep 11 03:59:17.406945 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:17.406904    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa19b772-e605-4cf8-ac25-2907fcb0efad-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-h8gwm\" (UID: \"aa19b772-e605-4cf8-ac25-2907fcb0efad\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-h8gwm"
Sep 11 03:59:17.407119 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:17.406979    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnzx4\" (UniqueName: \"kubernetes.io/projected/aa19b772-e605-4cf8-ac25-2907fcb0efad-kube-api-access-cnzx4\") pod \"cert-manager-cainjector-559cdd8c87-h8gwm\" (UID: \"aa19b772-e605-4cf8-ac25-2907fcb0efad\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-h8gwm"
Sep 11 03:59:17.416879 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:17.416846    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa19b772-e605-4cf8-ac25-2907fcb0efad-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-h8gwm\" (UID: \"aa19b772-e605-4cf8-ac25-2907fcb0efad\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-h8gwm"
Sep 11 03:59:17.417055 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:17.417034    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnzx4\" (UniqueName: \"kubernetes.io/projected/aa19b772-e605-4cf8-ac25-2907fcb0efad-kube-api-access-cnzx4\") pod \"cert-manager-cainjector-559cdd8c87-h8gwm\" (UID: \"aa19b772-e605-4cf8-ac25-2907fcb0efad\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-h8gwm"
Sep 11 03:59:17.599703 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:17.599669    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-h8gwm"
Sep 11 03:59:17.865408 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:17.865312    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-h8gwm"]
Sep 11 03:59:17.872310 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:59:17.872285    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa19b772_e605_4cf8_ac25_2907fcb0efad.slice/crio-62df7a2a6fec1b0b91011a4a1f6d6d0e0a6547a11d49a6e7812813ae6c712eca WatchSource:0}: Error finding container 62df7a2a6fec1b0b91011a4a1f6d6d0e0a6547a11d49a6e7812813ae6c712eca: Status 404 returned error can't find the container with id 62df7a2a6fec1b0b91011a4a1f6d6d0e0a6547a11d49a6e7812813ae6c712eca
Sep 11 03:59:18.299113 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:18.299030    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-h8gwm" event={"ID":"aa19b772-e605-4cf8-ac25-2907fcb0efad","Type":"ContainerStarted","Data":"62df7a2a6fec1b0b91011a4a1f6d6d0e0a6547a11d49a6e7812813ae6c712eca"}
Sep 11 03:59:21.314288 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:21.314252    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-h8gwm" event={"ID":"aa19b772-e605-4cf8-ac25-2907fcb0efad","Type":"ContainerStarted","Data":"b9523c3b255ca9715026b7a7e5a1ffe78bd9e321f20026b84275fa7721e3dee4"}
Sep 11 03:59:21.329545 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:21.329492    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-h8gwm" podStartSLOduration=1.806236744 podStartE2EDuration="4.329474911s" totalImagesPullingTime="2.523238167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:59:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:59:21.32843825 +0000 UTC m=+358.126527978" watchObservedRunningTime="2026-09-11 03:59:21.329474911 +0000 UTC m=+358.127564637"
Sep 11 03:59:29.772587 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:29.772555    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbx2tg"]
Sep 11 03:59:29.775218 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:29.775201    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbx2tg"
Sep 11 03:59:29.777666 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:29.777645    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 03:59:29.777780 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:29.777707    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 03:59:29.777780 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:29.777769    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kd9lt\""
Sep 11 03:59:29.783851 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:29.783824    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbx2tg"]
Sep 11 03:59:29.791166 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:29.791140    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf13d51f-eaed-4163-8f48-08e5c5575cb3-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbx2tg\" (UID: \"cf13d51f-eaed-4163-8f48-08e5c5575cb3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbx2tg"
Sep 11 03:59:29.791277 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:29.791207    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z89rk\" (UniqueName: \"kubernetes.io/projected/cf13d51f-eaed-4163-8f48-08e5c5575cb3-kube-api-access-z89rk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbx2tg\" (UID: \"cf13d51f-eaed-4163-8f48-08e5c5575cb3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbx2tg"
Sep 11 03:59:29.791277 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:29.791227    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf13d51f-eaed-4163-8f48-08e5c5575cb3-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbx2tg\" (UID: \"cf13d51f-eaed-4163-8f48-08e5c5575cb3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbx2tg"
Sep 11 03:59:29.891720 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:29.891681    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z89rk\" (UniqueName: \"kubernetes.io/projected/cf13d51f-eaed-4163-8f48-08e5c5575cb3-kube-api-access-z89rk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbx2tg\" (UID: \"cf13d51f-eaed-4163-8f48-08e5c5575cb3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbx2tg"
Sep 11 03:59:29.891926 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:29.891727    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf13d51f-eaed-4163-8f48-08e5c5575cb3-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbx2tg\" (UID: \"cf13d51f-eaed-4163-8f48-08e5c5575cb3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbx2tg"
Sep 11 03:59:29.891926 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:29.891765    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf13d51f-eaed-4163-8f48-08e5c5575cb3-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbx2tg\" (UID: \"cf13d51f-eaed-4163-8f48-08e5c5575cb3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbx2tg"
Sep 11 03:59:29.892160 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:29.892139    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf13d51f-eaed-4163-8f48-08e5c5575cb3-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbx2tg\" (UID: \"cf13d51f-eaed-4163-8f48-08e5c5575cb3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbx2tg"
Sep 11 03:59:29.892221 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:29.892178    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf13d51f-eaed-4163-8f48-08e5c5575cb3-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbx2tg\" (UID: \"cf13d51f-eaed-4163-8f48-08e5c5575cb3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbx2tg"
Sep 11 03:59:29.899660 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:29.899629    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z89rk\" (UniqueName: \"kubernetes.io/projected/cf13d51f-eaed-4163-8f48-08e5c5575cb3-kube-api-access-z89rk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbx2tg\" (UID: \"cf13d51f-eaed-4163-8f48-08e5c5575cb3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbx2tg"
Sep 11 03:59:30.084282 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:30.084252    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbx2tg"
Sep 11 03:59:30.350504 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:30.350341    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbx2tg"]
Sep 11 03:59:30.352801 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:59:30.352770    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf13d51f_eaed_4163_8f48_08e5c5575cb3.slice/crio-2996313878a27cfb100e4b8e2df86b74f6de8b0e8a454e64ba8bbddba857d269 WatchSource:0}: Error finding container 2996313878a27cfb100e4b8e2df86b74f6de8b0e8a454e64ba8bbddba857d269: Status 404 returned error can't find the container with id 2996313878a27cfb100e4b8e2df86b74f6de8b0e8a454e64ba8bbddba857d269
Sep 11 03:59:31.356874 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:31.356839    2558 generic.go:356] "Generic (PLEG): container finished" podID="cf13d51f-eaed-4163-8f48-08e5c5575cb3" containerID="ba8466c8624dad3892263d14bb885a165f096b2576e9e4e485e067474549d91e" exitCode=0
Sep 11 03:59:31.357333 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:31.356888    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbx2tg" event={"ID":"cf13d51f-eaed-4163-8f48-08e5c5575cb3","Type":"ContainerDied","Data":"ba8466c8624dad3892263d14bb885a165f096b2576e9e4e485e067474549d91e"}
Sep 11 03:59:31.357333 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:31.356936    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbx2tg" event={"ID":"cf13d51f-eaed-4163-8f48-08e5c5575cb3","Type":"ContainerStarted","Data":"2996313878a27cfb100e4b8e2df86b74f6de8b0e8a454e64ba8bbddba857d269"}
Sep 11 03:59:32.366921 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:32.366878    2558 generic.go:356] "Generic (PLEG): container finished" podID="cf13d51f-eaed-4163-8f48-08e5c5575cb3" containerID="6accd905c3798d88016fe4aeb35c70a3d85a435fdb9f6aed3511412fdec7f22d" exitCode=0
Sep 11 03:59:32.366921 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:32.366923    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbx2tg" event={"ID":"cf13d51f-eaed-4163-8f48-08e5c5575cb3","Type":"ContainerDied","Data":"6accd905c3798d88016fe4aeb35c70a3d85a435fdb9f6aed3511412fdec7f22d"}
Sep 11 03:59:33.373172 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:33.373133    2558 generic.go:356] "Generic (PLEG): container finished" podID="cf13d51f-eaed-4163-8f48-08e5c5575cb3" containerID="06c74b568a7c88e086947d5d328683fdbe977dc85525aca8952363696449145d" exitCode=0
Sep 11 03:59:33.373549 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:33.373189    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbx2tg" event={"ID":"cf13d51f-eaed-4163-8f48-08e5c5575cb3","Type":"ContainerDied","Data":"06c74b568a7c88e086947d5d328683fdbe977dc85525aca8952363696449145d"}
Sep 11 03:59:34.506013 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:34.505991    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbx2tg"
Sep 11 03:59:34.525315 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:34.525290    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf13d51f-eaed-4163-8f48-08e5c5575cb3-bundle\") pod \"cf13d51f-eaed-4163-8f48-08e5c5575cb3\" (UID: \"cf13d51f-eaed-4163-8f48-08e5c5575cb3\") "
Sep 11 03:59:34.525422 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:34.525344    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z89rk\" (UniqueName: \"kubernetes.io/projected/cf13d51f-eaed-4163-8f48-08e5c5575cb3-kube-api-access-z89rk\") pod \"cf13d51f-eaed-4163-8f48-08e5c5575cb3\" (UID: \"cf13d51f-eaed-4163-8f48-08e5c5575cb3\") "
Sep 11 03:59:34.525422 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:34.525379    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf13d51f-eaed-4163-8f48-08e5c5575cb3-util\") pod \"cf13d51f-eaed-4163-8f48-08e5c5575cb3\" (UID: \"cf13d51f-eaed-4163-8f48-08e5c5575cb3\") "
Sep 11 03:59:34.526198 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:34.526165    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf13d51f-eaed-4163-8f48-08e5c5575cb3-bundle" (OuterVolumeSpecName: "bundle") pod "cf13d51f-eaed-4163-8f48-08e5c5575cb3" (UID: "cf13d51f-eaed-4163-8f48-08e5c5575cb3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 03:59:34.527956 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:34.527915    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf13d51f-eaed-4163-8f48-08e5c5575cb3-kube-api-access-z89rk" (OuterVolumeSpecName: "kube-api-access-z89rk") pod "cf13d51f-eaed-4163-8f48-08e5c5575cb3" (UID: "cf13d51f-eaed-4163-8f48-08e5c5575cb3"). InnerVolumeSpecName "kube-api-access-z89rk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 03:59:34.532695 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:34.532672    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf13d51f-eaed-4163-8f48-08e5c5575cb3-util" (OuterVolumeSpecName: "util") pod "cf13d51f-eaed-4163-8f48-08e5c5575cb3" (UID: "cf13d51f-eaed-4163-8f48-08e5c5575cb3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 03:59:34.625983 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:34.625929    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf13d51f-eaed-4163-8f48-08e5c5575cb3-util\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 03:59:34.625983 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:34.625975    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf13d51f-eaed-4163-8f48-08e5c5575cb3-bundle\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 03:59:34.625983 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:34.625990    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z89rk\" (UniqueName: \"kubernetes.io/projected/cf13d51f-eaed-4163-8f48-08e5c5575cb3-kube-api-access-z89rk\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 03:59:35.383669 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:35.383635    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbx2tg" event={"ID":"cf13d51f-eaed-4163-8f48-08e5c5575cb3","Type":"ContainerDied","Data":"2996313878a27cfb100e4b8e2df86b74f6de8b0e8a454e64ba8bbddba857d269"}
Sep 11 03:59:35.383862 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:35.383688    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2996313878a27cfb100e4b8e2df86b74f6de8b0e8a454e64ba8bbddba857d269"
Sep 11 03:59:35.383862 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:35.383651    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbx2tg"
Sep 11 03:59:41.177883 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:41.177851    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077z4l"]
Sep 11 03:59:41.178261 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:41.178167    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf13d51f-eaed-4163-8f48-08e5c5575cb3" containerName="util"
Sep 11 03:59:41.178261 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:41.178180    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf13d51f-eaed-4163-8f48-08e5c5575cb3" containerName="util"
Sep 11 03:59:41.178261 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:41.178192    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf13d51f-eaed-4163-8f48-08e5c5575cb3" containerName="extract"
Sep 11 03:59:41.178261 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:41.178197    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf13d51f-eaed-4163-8f48-08e5c5575cb3" containerName="extract"
Sep 11 03:59:41.178261 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:41.178205    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf13d51f-eaed-4163-8f48-08e5c5575cb3" containerName="pull"
Sep 11 03:59:41.178261 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:41.178210    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf13d51f-eaed-4163-8f48-08e5c5575cb3" containerName="pull"
Sep 11 03:59:41.178261 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:41.178262    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf13d51f-eaed-4163-8f48-08e5c5575cb3" containerName="extract"
Sep 11 03:59:41.180898 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:41.180881    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077z4l"
Sep 11 03:59:41.183824 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:41.183792    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 03:59:41.183924 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:41.183793    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 03:59:41.184807 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:41.184789    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kd9lt\""
Sep 11 03:59:41.192527 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:41.192504    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077z4l"]
Sep 11 03:59:41.270936 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:41.270912    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7407d4e-caad-480e-b7ba-7f5e91c56f2e-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077z4l\" (UID: \"c7407d4e-caad-480e-b7ba-7f5e91c56f2e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077z4l"
Sep 11 03:59:41.271054 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:41.270949    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7407d4e-caad-480e-b7ba-7f5e91c56f2e-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077z4l\" (UID: \"c7407d4e-caad-480e-b7ba-7f5e91c56f2e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077z4l"
Sep 11 03:59:41.271054 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:41.270985    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzbmz\" (UniqueName: \"kubernetes.io/projected/c7407d4e-caad-480e-b7ba-7f5e91c56f2e-kube-api-access-jzbmz\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077z4l\" (UID: \"c7407d4e-caad-480e-b7ba-7f5e91c56f2e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077z4l"
Sep 11 03:59:41.372246 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:41.372213    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7407d4e-caad-480e-b7ba-7f5e91c56f2e-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077z4l\" (UID: \"c7407d4e-caad-480e-b7ba-7f5e91c56f2e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077z4l"
Sep 11 03:59:41.372408 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:41.372262    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzbmz\" (UniqueName: \"kubernetes.io/projected/c7407d4e-caad-480e-b7ba-7f5e91c56f2e-kube-api-access-jzbmz\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077z4l\" (UID: \"c7407d4e-caad-480e-b7ba-7f5e91c56f2e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077z4l"
Sep 11 03:59:41.372408 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:41.372302    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7407d4e-caad-480e-b7ba-7f5e91c56f2e-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077z4l\" (UID: \"c7407d4e-caad-480e-b7ba-7f5e91c56f2e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077z4l"
Sep 11 03:59:41.372651 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:41.372632    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7407d4e-caad-480e-b7ba-7f5e91c56f2e-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077z4l\" (UID: \"c7407d4e-caad-480e-b7ba-7f5e91c56f2e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077z4l"
Sep 11 03:59:41.372688 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:41.372666    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7407d4e-caad-480e-b7ba-7f5e91c56f2e-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077z4l\" (UID: \"c7407d4e-caad-480e-b7ba-7f5e91c56f2e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077z4l"
Sep 11 03:59:41.387832 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:41.387802    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzbmz\" (UniqueName: \"kubernetes.io/projected/c7407d4e-caad-480e-b7ba-7f5e91c56f2e-kube-api-access-jzbmz\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077z4l\" (UID: \"c7407d4e-caad-480e-b7ba-7f5e91c56f2e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077z4l"
Sep 11 03:59:41.489535 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:41.489474    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077z4l"
Sep 11 03:59:41.784093 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:59:41.784041    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7407d4e_caad_480e_b7ba_7f5e91c56f2e.slice/crio-8bd7f3ff13bb9238656b6bf6e93be3a2875d81cb170b5b0a4db5a92c71b7434d WatchSource:0}: Error finding container 8bd7f3ff13bb9238656b6bf6e93be3a2875d81cb170b5b0a4db5a92c71b7434d: Status 404 returned error can't find the container with id 8bd7f3ff13bb9238656b6bf6e93be3a2875d81cb170b5b0a4db5a92c71b7434d
Sep 11 03:59:41.786121 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:41.786090    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077z4l"]
Sep 11 03:59:42.414263 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:42.414230    2558 generic.go:356] "Generic (PLEG): container finished" podID="c7407d4e-caad-480e-b7ba-7f5e91c56f2e" containerID="ffd9b3bb1420a49da5b5cdaff1d3a8868763dd512d2ed339a919eda305d88a4c" exitCode=0
Sep 11 03:59:42.414583 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:42.414314    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077z4l" event={"ID":"c7407d4e-caad-480e-b7ba-7f5e91c56f2e","Type":"ContainerDied","Data":"ffd9b3bb1420a49da5b5cdaff1d3a8868763dd512d2ed339a919eda305d88a4c"}
Sep 11 03:59:42.414583 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:42.414423    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077z4l" event={"ID":"c7407d4e-caad-480e-b7ba-7f5e91c56f2e","Type":"ContainerStarted","Data":"8bd7f3ff13bb9238656b6bf6e93be3a2875d81cb170b5b0a4db5a92c71b7434d"}
Sep 11 03:59:43.342253 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:43.342220    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65b869c898-hlqb7"]
Sep 11 03:59:43.345338 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:43.345317    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65b869c898-hlqb7"
Sep 11 03:59:43.350221 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:43.350199    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 03:59:43.350595 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:43.350577    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-nmbvm\""
Sep 11 03:59:43.352539 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:43.352521    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 03:59:43.352644 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:43.352595    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 03:59:43.353343 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:43.353325    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 03:59:43.385632 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:43.385605    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65b869c898-hlqb7"]
Sep 11 03:59:43.389227 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:43.389206    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f70cd365-5791-4e3d-a0ad-6bbff9bc48af-webhook-cert\") pod \"opendatahub-operator-controller-manager-65b869c898-hlqb7\" (UID: \"f70cd365-5791-4e3d-a0ad-6bbff9bc48af\") " pod="opendatahub/opendatahub-operator-controller-manager-65b869c898-hlqb7"
Sep 11 03:59:43.389301 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:43.389239    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrz2l\" (UniqueName: \"kubernetes.io/projected/f70cd365-5791-4e3d-a0ad-6bbff9bc48af-kube-api-access-nrz2l\") pod \"opendatahub-operator-controller-manager-65b869c898-hlqb7\" (UID: \"f70cd365-5791-4e3d-a0ad-6bbff9bc48af\") " pod="opendatahub/opendatahub-operator-controller-manager-65b869c898-hlqb7"
Sep 11 03:59:43.389301 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:43.389265    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f70cd365-5791-4e3d-a0ad-6bbff9bc48af-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65b869c898-hlqb7\" (UID: \"f70cd365-5791-4e3d-a0ad-6bbff9bc48af\") " pod="opendatahub/opendatahub-operator-controller-manager-65b869c898-hlqb7"
Sep 11 03:59:43.389371 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:43.389360    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f70cd365-5791-4e3d-a0ad-6bbff9bc48af-tmp\") pod \"opendatahub-operator-controller-manager-65b869c898-hlqb7\" (UID: \"f70cd365-5791-4e3d-a0ad-6bbff9bc48af\") " pod="opendatahub/opendatahub-operator-controller-manager-65b869c898-hlqb7"
Sep 11 03:59:43.389432 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:43.389420    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f70cd365-5791-4e3d-a0ad-6bbff9bc48af-manifests\") pod \"opendatahub-operator-controller-manager-65b869c898-hlqb7\" (UID: \"f70cd365-5791-4e3d-a0ad-6bbff9bc48af\") " pod="opendatahub/opendatahub-operator-controller-manager-65b869c898-hlqb7"
Sep 11 03:59:43.420198 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:43.420168    2558 generic.go:356] "Generic (PLEG): container finished" podID="c7407d4e-caad-480e-b7ba-7f5e91c56f2e" containerID="eff9fb881c60a6819bee4faa95f649644641f8cd8a15e002632d36ea3bb319ad" exitCode=0
Sep 11 03:59:43.420544 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:43.420210    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077z4l" event={"ID":"c7407d4e-caad-480e-b7ba-7f5e91c56f2e","Type":"ContainerDied","Data":"eff9fb881c60a6819bee4faa95f649644641f8cd8a15e002632d36ea3bb319ad"}
Sep 11 03:59:43.489740 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:43.489717    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f70cd365-5791-4e3d-a0ad-6bbff9bc48af-manifests\") pod \"opendatahub-operator-controller-manager-65b869c898-hlqb7\" (UID: \"f70cd365-5791-4e3d-a0ad-6bbff9bc48af\") " pod="opendatahub/opendatahub-operator-controller-manager-65b869c898-hlqb7"
Sep 11 03:59:43.489863 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:43.489751    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f70cd365-5791-4e3d-a0ad-6bbff9bc48af-webhook-cert\") pod \"opendatahub-operator-controller-manager-65b869c898-hlqb7\" (UID: \"f70cd365-5791-4e3d-a0ad-6bbff9bc48af\") " pod="opendatahub/opendatahub-operator-controller-manager-65b869c898-hlqb7"
Sep 11 03:59:43.489863 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:43.489770    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrz2l\" (UniqueName: \"kubernetes.io/projected/f70cd365-5791-4e3d-a0ad-6bbff9bc48af-kube-api-access-nrz2l\") pod \"opendatahub-operator-controller-manager-65b869c898-hlqb7\" (UID: \"f70cd365-5791-4e3d-a0ad-6bbff9bc48af\") " pod="opendatahub/opendatahub-operator-controller-manager-65b869c898-hlqb7"
Sep 11 03:59:43.489863 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:43.489793    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f70cd365-5791-4e3d-a0ad-6bbff9bc48af-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65b869c898-hlqb7\" (UID: \"f70cd365-5791-4e3d-a0ad-6bbff9bc48af\") " pod="opendatahub/opendatahub-operator-controller-manager-65b869c898-hlqb7"
Sep 11 03:59:43.490014 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:43.489963    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f70cd365-5791-4e3d-a0ad-6bbff9bc48af-tmp\") pod \"opendatahub-operator-controller-manager-65b869c898-hlqb7\" (UID: \"f70cd365-5791-4e3d-a0ad-6bbff9bc48af\") " pod="opendatahub/opendatahub-operator-controller-manager-65b869c898-hlqb7"
Sep 11 03:59:43.490143 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:43.490123    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f70cd365-5791-4e3d-a0ad-6bbff9bc48af-manifests\") pod \"opendatahub-operator-controller-manager-65b869c898-hlqb7\" (UID: \"f70cd365-5791-4e3d-a0ad-6bbff9bc48af\") " pod="opendatahub/opendatahub-operator-controller-manager-65b869c898-hlqb7"
Sep 11 03:59:43.492106 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:43.492086    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f70cd365-5791-4e3d-a0ad-6bbff9bc48af-tmp\") pod \"opendatahub-operator-controller-manager-65b869c898-hlqb7\" (UID: \"f70cd365-5791-4e3d-a0ad-6bbff9bc48af\") " pod="opendatahub/opendatahub-operator-controller-manager-65b869c898-hlqb7"
Sep 11 03:59:43.492199 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:43.492181    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f70cd365-5791-4e3d-a0ad-6bbff9bc48af-webhook-cert\") pod \"opendatahub-operator-controller-manager-65b869c898-hlqb7\" (UID: \"f70cd365-5791-4e3d-a0ad-6bbff9bc48af\") " pod="opendatahub/opendatahub-operator-controller-manager-65b869c898-hlqb7"
Sep 11 03:59:43.492326 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:43.492303    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f70cd365-5791-4e3d-a0ad-6bbff9bc48af-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65b869c898-hlqb7\" (UID: \"f70cd365-5791-4e3d-a0ad-6bbff9bc48af\") " pod="opendatahub/opendatahub-operator-controller-manager-65b869c898-hlqb7"
Sep 11 03:59:43.498559 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:43.498529    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrz2l\" (UniqueName: \"kubernetes.io/projected/f70cd365-5791-4e3d-a0ad-6bbff9bc48af-kube-api-access-nrz2l\") pod \"opendatahub-operator-controller-manager-65b869c898-hlqb7\" (UID: \"f70cd365-5791-4e3d-a0ad-6bbff9bc48af\") " pod="opendatahub/opendatahub-operator-controller-manager-65b869c898-hlqb7"
Sep 11 03:59:43.655616 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:43.655528    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65b869c898-hlqb7"
Sep 11 03:59:43.929672 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:43.929581    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65b869c898-hlqb7"]
Sep 11 03:59:43.932768 ip-10-0-130-195 kubenswrapper[2558]: W0911 03:59:43.932742    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf70cd365_5791_4e3d_a0ad_6bbff9bc48af.slice/crio-775583f5e9204913519f42713880e5448041cf883aa72e808bba35a5d4f6bfb2 WatchSource:0}: Error finding container 775583f5e9204913519f42713880e5448041cf883aa72e808bba35a5d4f6bfb2: Status 404 returned error can't find the container with id 775583f5e9204913519f42713880e5448041cf883aa72e808bba35a5d4f6bfb2
Sep 11 03:59:44.426815 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:44.426780    2558 generic.go:356] "Generic (PLEG): container finished" podID="c7407d4e-caad-480e-b7ba-7f5e91c56f2e" containerID="6c4907d39249d2c746fb121eb3d9475c9da22d760d7e2805c8d8191e76e83f7c" exitCode=0
Sep 11 03:59:44.427190 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:44.426861    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077z4l" event={"ID":"c7407d4e-caad-480e-b7ba-7f5e91c56f2e","Type":"ContainerDied","Data":"6c4907d39249d2c746fb121eb3d9475c9da22d760d7e2805c8d8191e76e83f7c"}
Sep 11 03:59:44.428163 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:44.428140    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65b869c898-hlqb7" event={"ID":"f70cd365-5791-4e3d-a0ad-6bbff9bc48af","Type":"ContainerStarted","Data":"775583f5e9204913519f42713880e5448041cf883aa72e808bba35a5d4f6bfb2"}
Sep 11 03:59:45.585190 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:45.585161    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077z4l"
Sep 11 03:59:45.610832 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:45.610798    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzbmz\" (UniqueName: \"kubernetes.io/projected/c7407d4e-caad-480e-b7ba-7f5e91c56f2e-kube-api-access-jzbmz\") pod \"c7407d4e-caad-480e-b7ba-7f5e91c56f2e\" (UID: \"c7407d4e-caad-480e-b7ba-7f5e91c56f2e\") "
Sep 11 03:59:45.610981 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:45.610894    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7407d4e-caad-480e-b7ba-7f5e91c56f2e-bundle\") pod \"c7407d4e-caad-480e-b7ba-7f5e91c56f2e\" (UID: \"c7407d4e-caad-480e-b7ba-7f5e91c56f2e\") "
Sep 11 03:59:45.610981 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:45.610924    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7407d4e-caad-480e-b7ba-7f5e91c56f2e-util\") pod \"c7407d4e-caad-480e-b7ba-7f5e91c56f2e\" (UID: \"c7407d4e-caad-480e-b7ba-7f5e91c56f2e\") "
Sep 11 03:59:45.611882 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:45.611841    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7407d4e-caad-480e-b7ba-7f5e91c56f2e-bundle" (OuterVolumeSpecName: "bundle") pod "c7407d4e-caad-480e-b7ba-7f5e91c56f2e" (UID: "c7407d4e-caad-480e-b7ba-7f5e91c56f2e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 03:59:45.613659 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:45.613633    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7407d4e-caad-480e-b7ba-7f5e91c56f2e-kube-api-access-jzbmz" (OuterVolumeSpecName: "kube-api-access-jzbmz") pod "c7407d4e-caad-480e-b7ba-7f5e91c56f2e" (UID: "c7407d4e-caad-480e-b7ba-7f5e91c56f2e"). InnerVolumeSpecName "kube-api-access-jzbmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 03:59:45.619060 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:45.619021    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7407d4e-caad-480e-b7ba-7f5e91c56f2e-util" (OuterVolumeSpecName: "util") pod "c7407d4e-caad-480e-b7ba-7f5e91c56f2e" (UID: "c7407d4e-caad-480e-b7ba-7f5e91c56f2e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 03:59:45.712429 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:45.712347    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7407d4e-caad-480e-b7ba-7f5e91c56f2e-bundle\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 03:59:45.712429 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:45.712373    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7407d4e-caad-480e-b7ba-7f5e91c56f2e-util\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 03:59:45.712429 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:45.712406    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzbmz\" (UniqueName: \"kubernetes.io/projected/c7407d4e-caad-480e-b7ba-7f5e91c56f2e-kube-api-access-jzbmz\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 03:59:46.439553 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:46.439506    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077z4l" event={"ID":"c7407d4e-caad-480e-b7ba-7f5e91c56f2e","Type":"ContainerDied","Data":"8bd7f3ff13bb9238656b6bf6e93be3a2875d81cb170b5b0a4db5a92c71b7434d"}
Sep 11 03:59:46.439728 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:46.439533    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b077z4l"
Sep 11 03:59:46.439728 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:46.439621    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8bd7f3ff13bb9238656b6bf6e93be3a2875d81cb170b5b0a4db5a92c71b7434d"
Sep 11 03:59:47.444364 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:47.444335    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65b869c898-hlqb7" event={"ID":"f70cd365-5791-4e3d-a0ad-6bbff9bc48af","Type":"ContainerStarted","Data":"709ed2d55dc697eb525c36507040974cafeefc0766fec2b0a4eea72c2e2c14a2"}
Sep 11 03:59:48.449987 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:48.449958    2558 generic.go:356] "Generic (PLEG): container finished" podID="f70cd365-5791-4e3d-a0ad-6bbff9bc48af" containerID="709ed2d55dc697eb525c36507040974cafeefc0766fec2b0a4eea72c2e2c14a2" exitCode=0
Sep 11 03:59:48.450333 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:48.450037    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65b869c898-hlqb7" event={"ID":"f70cd365-5791-4e3d-a0ad-6bbff9bc48af","Type":"ContainerDied","Data":"709ed2d55dc697eb525c36507040974cafeefc0766fec2b0a4eea72c2e2c14a2"}
Sep 11 03:59:49.456714 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:49.456679    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65b869c898-hlqb7" event={"ID":"f70cd365-5791-4e3d-a0ad-6bbff9bc48af","Type":"ContainerStarted","Data":"1961606c832feb076d0566656e0a43383e098d88db89862f82cc8465dfc1e129"}
Sep 11 03:59:49.457178 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:49.456805    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-65b869c898-hlqb7"
Sep 11 03:59:49.480648 ip-10-0-130-195 kubenswrapper[2558]: I0911 03:59:49.480598    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-65b869c898-hlqb7" podStartSLOduration=1.53368765 podStartE2EDuration="6.480585213s" totalImagesPullingTime="3.939784256s" totalInitContainerRuntime="1.007113307s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:59:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:59:49.479114651 +0000 UTC m=+386.277204388" watchObservedRunningTime="2026-09-11 03:59:49.480585213 +0000 UTC m=+386.278674939"
Sep 11 04:00:00.464399 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:00.464354    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-65b869c898-hlqb7"
Sep 11 04:00:03.500196 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:03.500157    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7f78fb9f44-czvpr"]
Sep 11 04:00:03.500599 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:03.500453    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7407d4e-caad-480e-b7ba-7f5e91c56f2e" containerName="extract"
Sep 11 04:00:03.500599 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:03.500466    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7407d4e-caad-480e-b7ba-7f5e91c56f2e" containerName="extract"
Sep 11 04:00:03.500599 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:03.500477    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7407d4e-caad-480e-b7ba-7f5e91c56f2e" containerName="util"
Sep 11 04:00:03.500599 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:03.500483    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7407d4e-caad-480e-b7ba-7f5e91c56f2e" containerName="util"
Sep 11 04:00:03.500599 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:03.500500    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7407d4e-caad-480e-b7ba-7f5e91c56f2e" containerName="pull"
Sep 11 04:00:03.500599 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:03.500506    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7407d4e-caad-480e-b7ba-7f5e91c56f2e" containerName="pull"
Sep 11 04:00:03.500599 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:03.500554    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7407d4e-caad-480e-b7ba-7f5e91c56f2e" containerName="extract"
Sep 11 04:00:03.505602 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:03.505577    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f78fb9f44-czvpr"
Sep 11 04:00:03.509310 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:03.509286    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 11 04:00:03.510377 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:03.510359    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-pn9zb\""
Sep 11 04:00:03.510489 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:03.510413    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 11 04:00:03.531215 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:03.531193    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f78fb9f44-czvpr"]
Sep 11 04:00:03.553288 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:03.553262    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhq78\" (UniqueName: \"kubernetes.io/projected/fc6b6b0e-dab5-46e4-bec9-12a6db67525e-kube-api-access-xhq78\") pod \"kube-auth-proxy-7f78fb9f44-czvpr\" (UID: \"fc6b6b0e-dab5-46e4-bec9-12a6db67525e\") " pod="openshift-ingress/kube-auth-proxy-7f78fb9f44-czvpr"
Sep 11 04:00:03.553374 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:03.553307    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc6b6b0e-dab5-46e4-bec9-12a6db67525e-tls-certs\") pod \"kube-auth-proxy-7f78fb9f44-czvpr\" (UID: \"fc6b6b0e-dab5-46e4-bec9-12a6db67525e\") " pod="openshift-ingress/kube-auth-proxy-7f78fb9f44-czvpr"
Sep 11 04:00:03.553374 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:03.553342    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc6b6b0e-dab5-46e4-bec9-12a6db67525e-tmp\") pod \"kube-auth-proxy-7f78fb9f44-czvpr\" (UID: \"fc6b6b0e-dab5-46e4-bec9-12a6db67525e\") " pod="openshift-ingress/kube-auth-proxy-7f78fb9f44-czvpr"
Sep 11 04:00:03.653836 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:03.653801    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhq78\" (UniqueName: \"kubernetes.io/projected/fc6b6b0e-dab5-46e4-bec9-12a6db67525e-kube-api-access-xhq78\") pod \"kube-auth-proxy-7f78fb9f44-czvpr\" (UID: \"fc6b6b0e-dab5-46e4-bec9-12a6db67525e\") " pod="openshift-ingress/kube-auth-proxy-7f78fb9f44-czvpr"
Sep 11 04:00:03.653994 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:03.653864    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc6b6b0e-dab5-46e4-bec9-12a6db67525e-tls-certs\") pod \"kube-auth-proxy-7f78fb9f44-czvpr\" (UID: \"fc6b6b0e-dab5-46e4-bec9-12a6db67525e\") " pod="openshift-ingress/kube-auth-proxy-7f78fb9f44-czvpr"
Sep 11 04:00:03.653994 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:03.653894    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc6b6b0e-dab5-46e4-bec9-12a6db67525e-tmp\") pod \"kube-auth-proxy-7f78fb9f44-czvpr\" (UID: \"fc6b6b0e-dab5-46e4-bec9-12a6db67525e\") " pod="openshift-ingress/kube-auth-proxy-7f78fb9f44-czvpr"
Sep 11 04:00:03.656132 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:03.656102    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc6b6b0e-dab5-46e4-bec9-12a6db67525e-tmp\") pod \"kube-auth-proxy-7f78fb9f44-czvpr\" (UID: \"fc6b6b0e-dab5-46e4-bec9-12a6db67525e\") " pod="openshift-ingress/kube-auth-proxy-7f78fb9f44-czvpr"
Sep 11 04:00:03.656356 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:03.656334    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc6b6b0e-dab5-46e4-bec9-12a6db67525e-tls-certs\") pod \"kube-auth-proxy-7f78fb9f44-czvpr\" (UID: \"fc6b6b0e-dab5-46e4-bec9-12a6db67525e\") " pod="openshift-ingress/kube-auth-proxy-7f78fb9f44-czvpr"
Sep 11 04:00:03.667236 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:03.667208    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhq78\" (UniqueName: \"kubernetes.io/projected/fc6b6b0e-dab5-46e4-bec9-12a6db67525e-kube-api-access-xhq78\") pod \"kube-auth-proxy-7f78fb9f44-czvpr\" (UID: \"fc6b6b0e-dab5-46e4-bec9-12a6db67525e\") " pod="openshift-ingress/kube-auth-proxy-7f78fb9f44-czvpr"
Sep 11 04:00:03.815212 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:03.815190    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f78fb9f44-czvpr"
Sep 11 04:00:04.087240 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:04.087216    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f78fb9f44-czvpr"]
Sep 11 04:00:04.089399 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:00:04.089370    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc6b6b0e_dab5_46e4_bec9_12a6db67525e.slice/crio-32b69bbc337c5076ec943f3179d5b6ce6de25d5b4147aa51a6803fcea5ef42fa WatchSource:0}: Error finding container 32b69bbc337c5076ec943f3179d5b6ce6de25d5b4147aa51a6803fcea5ef42fa: Status 404 returned error can't find the container with id 32b69bbc337c5076ec943f3179d5b6ce6de25d5b4147aa51a6803fcea5ef42fa
Sep 11 04:00:04.528866 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:04.528781    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f78fb9f44-czvpr" event={"ID":"fc6b6b0e-dab5-46e4-bec9-12a6db67525e","Type":"ContainerStarted","Data":"32b69bbc337c5076ec943f3179d5b6ce6de25d5b4147aa51a6803fcea5ef42fa"}
Sep 11 04:00:04.902186 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:04.902154    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc"]
Sep 11 04:00:04.905046 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:04.905024    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc"
Sep 11 04:00:04.907571 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:04.907552    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 04:00:04.907679 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:04.907600    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-5v57b\""
Sep 11 04:00:04.907790 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:04.907773    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 11 04:00:04.907867 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:04.907809    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 11 04:00:04.907931 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:04.907876    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 11 04:00:04.916717 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:04.916698    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc"]
Sep 11 04:00:04.965734 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:04.965703    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqrct\" (UniqueName: \"kubernetes.io/projected/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-kube-api-access-vqrct\") pod \"istiod-openshift-gateway-7b7995d5cd-vw9wc\" (UID: \"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc"
Sep 11 04:00:04.965734 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:04.965738    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-vw9wc\" (UID: \"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc"
Sep 11 04:00:04.965950 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:04.965758    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-vw9wc\" (UID: \"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc"
Sep 11 04:00:04.965950 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:04.965794    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-vw9wc\" (UID: \"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc"
Sep 11 04:00:04.965950 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:04.965831    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-vw9wc\" (UID: \"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc"
Sep 11 04:00:04.965950 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:04.965866    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-vw9wc\" (UID: \"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc"
Sep 11 04:00:04.965950 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:04.965884    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-vw9wc\" (UID: \"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc"
Sep 11 04:00:05.066867 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:05.066830    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqrct\" (UniqueName: \"kubernetes.io/projected/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-kube-api-access-vqrct\") pod \"istiod-openshift-gateway-7b7995d5cd-vw9wc\" (UID: \"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc"
Sep 11 04:00:05.067040 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:05.066875    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-vw9wc\" (UID: \"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc"
Sep 11 04:00:05.067040 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:05.066907    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-vw9wc\" (UID: \"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc"
Sep 11 04:00:05.067040 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:05.066937    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-vw9wc\" (UID: \"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc"
Sep 11 04:00:05.067040 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:05.066965    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-vw9wc\" (UID: \"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc"
Sep 11 04:00:05.067040 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:05.067019    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-vw9wc\" (UID: \"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc"
Sep 11 04:00:05.067306 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:05.067051    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-vw9wc\" (UID: \"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc"
Sep 11 04:00:05.067630 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:05.067577    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-vw9wc\" (UID: \"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc"
Sep 11 04:00:05.070891 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:05.070825    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-vw9wc\" (UID: \"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc"
Sep 11 04:00:05.070891 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:05.070825    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-vw9wc\" (UID: \"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc"
Sep 11 04:00:05.071745 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:05.071677    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-vw9wc\" (UID: \"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc"
Sep 11 04:00:05.072216 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:05.072172    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-vw9wc\" (UID: \"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc"
Sep 11 04:00:05.080293 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:05.079838    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqrct\" (UniqueName: \"kubernetes.io/projected/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-kube-api-access-vqrct\") pod \"istiod-openshift-gateway-7b7995d5cd-vw9wc\" (UID: \"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc"
Sep 11 04:00:05.081338 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:05.081295    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-vw9wc\" (UID: \"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc"
Sep 11 04:00:05.215365 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:05.215274    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc"
Sep 11 04:00:05.507965 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:05.507856    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc"]
Sep 11 04:00:05.510952 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:00:05.510921    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44a5aa72_d8fb_46cb_ac3b_4fb4df889f3b.slice/crio-c6c01b69a8520f55175b818d8b68736aa82028dbe514c65b3b22391ae0ea8bb9 WatchSource:0}: Error finding container c6c01b69a8520f55175b818d8b68736aa82028dbe514c65b3b22391ae0ea8bb9: Status 404 returned error can't find the container with id c6c01b69a8520f55175b818d8b68736aa82028dbe514c65b3b22391ae0ea8bb9
Sep 11 04:00:05.535761 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:05.535727    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc" event={"ID":"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b","Type":"ContainerStarted","Data":"c6c01b69a8520f55175b818d8b68736aa82028dbe514c65b3b22391ae0ea8bb9"}
Sep 11 04:00:07.545474 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:07.545374    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f78fb9f44-czvpr" event={"ID":"fc6b6b0e-dab5-46e4-bec9-12a6db67525e","Type":"ContainerStarted","Data":"7a8b5c59f11830df57882aefd83c4a756f6209fafda39f9137f47a88a330768d"}
Sep 11 04:00:07.561205 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:07.561158    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7f78fb9f44-czvpr" podStartSLOduration=1.4903765789999999 podStartE2EDuration="4.561142533s" totalImagesPullingTime="3.070765954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:00:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:00:07.560012356 +0000 UTC m=+404.358102082" watchObservedRunningTime="2026-09-11 04:00:07.561142533 +0000 UTC m=+404.359232259"
Sep 11 04:00:09.880243 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:09.880201    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:00:09.880485 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:09.880277    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:00:10.560506 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:10.560465    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc" event={"ID":"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b","Type":"ContainerStarted","Data":"e5f5ddd33b7e1909b36f7fef2d6c314e2080a337914aad61136b632e1adabb28"}
Sep 11 04:00:10.560704 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:10.560685    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc"
Sep 11 04:00:10.562516 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:10.562491    2558 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-vw9wc container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 04:00:10.562635 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:10.562553    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc" podUID="44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 04:00:10.585741 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:10.585699    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc" podStartSLOduration=2.219047665 podStartE2EDuration="6.585684679s" totalImagesPullingTime="4.366637014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:00:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:00:10.583132042 +0000 UTC m=+407.381221769" watchObservedRunningTime="2026-09-11 04:00:10.585684679 +0000 UTC m=+407.383774406"
Sep 11 04:00:10.989179 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:10.989143    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk"]
Sep 11 04:00:10.991484 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:10.991466    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk"
Sep 11 04:00:10.994056 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:10.994034    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-22dtx\""
Sep 11 04:00:11.004014 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:11.003991    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk"]
Sep 11 04:00:11.124361 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:11.124317    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a925516e-8aba-415b-b45d-b4ad1ef84f74-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk\" (UID: \"a925516e-8aba-415b-b45d-b4ad1ef84f74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk"
Sep 11 04:00:11.124538 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:11.124371    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a925516e-8aba-415b-b45d-b4ad1ef84f74-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk\" (UID: \"a925516e-8aba-415b-b45d-b4ad1ef84f74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk"
Sep 11 04:00:11.124538 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:11.124449    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a925516e-8aba-415b-b45d-b4ad1ef84f74-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk\" (UID: \"a925516e-8aba-415b-b45d-b4ad1ef84f74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk"
Sep 11 04:00:11.124538 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:11.124474    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a925516e-8aba-415b-b45d-b4ad1ef84f74-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk\" (UID: \"a925516e-8aba-415b-b45d-b4ad1ef84f74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk"
Sep 11 04:00:11.124538 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:11.124492    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a925516e-8aba-415b-b45d-b4ad1ef84f74-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk\" (UID: \"a925516e-8aba-415b-b45d-b4ad1ef84f74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk"
Sep 11 04:00:11.124538 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:11.124511    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flssw\" (UniqueName: \"kubernetes.io/projected/a925516e-8aba-415b-b45d-b4ad1ef84f74-kube-api-access-flssw\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk\" (UID: \"a925516e-8aba-415b-b45d-b4ad1ef84f74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk"
Sep 11 04:00:11.124698 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:11.124541    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a925516e-8aba-415b-b45d-b4ad1ef84f74-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk\" (UID: \"a925516e-8aba-415b-b45d-b4ad1ef84f74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk"
Sep 11 04:00:11.124698 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:11.124569    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a925516e-8aba-415b-b45d-b4ad1ef84f74-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk\" (UID: \"a925516e-8aba-415b-b45d-b4ad1ef84f74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk"
Sep 11 04:00:11.124698 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:11.124589    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a925516e-8aba-415b-b45d-b4ad1ef84f74-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk\" (UID: \"a925516e-8aba-415b-b45d-b4ad1ef84f74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk"
Sep 11 04:00:11.225229 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:11.225191    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a925516e-8aba-415b-b45d-b4ad1ef84f74-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk\" (UID: \"a925516e-8aba-415b-b45d-b4ad1ef84f74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk"
Sep 11 04:00:11.225458 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:11.225241    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a925516e-8aba-415b-b45d-b4ad1ef84f74-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk\" (UID: \"a925516e-8aba-415b-b45d-b4ad1ef84f74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk"
Sep 11 04:00:11.225458 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:11.225278    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a925516e-8aba-415b-b45d-b4ad1ef84f74-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk\" (UID: \"a925516e-8aba-415b-b45d-b4ad1ef84f74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk"
Sep 11 04:00:11.225458 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:11.225325    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a925516e-8aba-415b-b45d-b4ad1ef84f74-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk\" (UID: \"a925516e-8aba-415b-b45d-b4ad1ef84f74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk"
Sep 11 04:00:11.225642 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:11.225473    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a925516e-8aba-415b-b45d-b4ad1ef84f74-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk\" (UID: \"a925516e-8aba-415b-b45d-b4ad1ef84f74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk"
Sep 11 04:00:11.225642 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:11.225520    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a925516e-8aba-415b-b45d-b4ad1ef84f74-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk\" (UID: \"a925516e-8aba-415b-b45d-b4ad1ef84f74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk"
Sep 11 04:00:11.225642 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:11.225558    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flssw\" (UniqueName: \"kubernetes.io/projected/a925516e-8aba-415b-b45d-b4ad1ef84f74-kube-api-access-flssw\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk\" (UID: \"a925516e-8aba-415b-b45d-b4ad1ef84f74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk"
Sep 11 04:00:11.225642 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:11.225602    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a925516e-8aba-415b-b45d-b4ad1ef84f74-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk\" (UID: \"a925516e-8aba-415b-b45d-b4ad1ef84f74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk"
Sep 11 04:00:11.225826 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:11.225654    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a925516e-8aba-415b-b45d-b4ad1ef84f74-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk\" (UID: \"a925516e-8aba-415b-b45d-b4ad1ef84f74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk"
Sep 11 04:00:11.225826 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:11.225780    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a925516e-8aba-415b-b45d-b4ad1ef84f74-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk\" (UID: \"a925516e-8aba-415b-b45d-b4ad1ef84f74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk"
Sep 11 04:00:11.225916 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:11.225847    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a925516e-8aba-415b-b45d-b4ad1ef84f74-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk\" (UID: \"a925516e-8aba-415b-b45d-b4ad1ef84f74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk"
Sep 11 04:00:11.225916 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:11.225861    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a925516e-8aba-415b-b45d-b4ad1ef84f74-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk\" (UID: \"a925516e-8aba-415b-b45d-b4ad1ef84f74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk"
Sep 11 04:00:11.226125 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:11.226104    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a925516e-8aba-415b-b45d-b4ad1ef84f74-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk\" (UID: \"a925516e-8aba-415b-b45d-b4ad1ef84f74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk"
Sep 11 04:00:11.226125 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:11.226118    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a925516e-8aba-415b-b45d-b4ad1ef84f74-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk\" (UID: \"a925516e-8aba-415b-b45d-b4ad1ef84f74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk"
Sep 11 04:00:11.227612 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:11.227590    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a925516e-8aba-415b-b45d-b4ad1ef84f74-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk\" (UID: \"a925516e-8aba-415b-b45d-b4ad1ef84f74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk"
Sep 11 04:00:11.227910 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:11.227892    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a925516e-8aba-415b-b45d-b4ad1ef84f74-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk\" (UID: \"a925516e-8aba-415b-b45d-b4ad1ef84f74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk"
Sep 11 04:00:11.234264 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:11.234225    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a925516e-8aba-415b-b45d-b4ad1ef84f74-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk\" (UID: \"a925516e-8aba-415b-b45d-b4ad1ef84f74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk"
Sep 11 04:00:11.234518 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:11.234495    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flssw\" (UniqueName: \"kubernetes.io/projected/a925516e-8aba-415b-b45d-b4ad1ef84f74-kube-api-access-flssw\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk\" (UID: \"a925516e-8aba-415b-b45d-b4ad1ef84f74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk"
Sep 11 04:00:11.300940 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:11.300882    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk"
Sep 11 04:00:11.566032 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:11.566009    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc"
Sep 11 04:00:11.576237 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:11.576219    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk"]
Sep 11 04:00:11.578008 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:00:11.577980    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda925516e_8aba_415b_b45d_b4ad1ef84f74.slice/crio-4a6040f62576b69812196106053191780a239c7212e78525f33d3a4ae5b9521f WatchSource:0}: Error finding container 4a6040f62576b69812196106053191780a239c7212e78525f33d3a4ae5b9521f: Status 404 returned error can't find the container with id 4a6040f62576b69812196106053191780a239c7212e78525f33d3a4ae5b9521f
Sep 11 04:00:12.570598 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:12.570561    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk" event={"ID":"a925516e-8aba-415b-b45d-b4ad1ef84f74","Type":"ContainerStarted","Data":"4a6040f62576b69812196106053191780a239c7212e78525f33d3a4ae5b9521f"}
Sep 11 04:00:14.463652 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:14.463616    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:00:14.463904 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:14.463688    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:00:14.463904 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:14.463718    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:00:14.582958 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:14.582918    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk" event={"ID":"a925516e-8aba-415b-b45d-b4ad1ef84f74","Type":"ContainerStarted","Data":"aa1a8318a14d5cd4f86004aa1c024b1239224da35d7620bac02be7d42317af11"}
Sep 11 04:00:14.606654 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:14.606602    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk" podStartSLOduration=1.7233066799999999 podStartE2EDuration="4.606584883s" totalImagesPullingTime="2.883278203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:00:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:00:14.604946592 +0000 UTC m=+411.403036321" watchObservedRunningTime="2026-09-11 04:00:14.606584883 +0000 UTC m=+411.404674621"
Sep 11 04:00:15.301962 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:15.301926    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk"
Sep 11 04:00:15.306230 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:15.306203    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk"
Sep 11 04:00:15.586982 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:15.586951    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk"
Sep 11 04:00:15.587973 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:15.587952    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk"
Sep 11 04:00:21.865909 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:21.865874    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-lb4tw"]
Sep 11 04:00:21.876339 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:21.876311    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lb4tw"
Sep 11 04:00:21.882845 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:21.882817    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-lb4tw"]
Sep 11 04:00:22.017672 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:22.017636    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk8xh\" (UniqueName: \"kubernetes.io/projected/b03f904a-27b1-4a1d-b44d-601e0eb00785-kube-api-access-qk8xh\") pod \"istiod-openshift-gateway-5677ccb49b-lb4tw\" (UID: \"b03f904a-27b1-4a1d-b44d-601e0eb00785\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lb4tw"
Sep 11 04:00:22.017804 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:22.017703    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b03f904a-27b1-4a1d-b44d-601e0eb00785-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-lb4tw\" (UID: \"b03f904a-27b1-4a1d-b44d-601e0eb00785\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lb4tw"
Sep 11 04:00:22.017804 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:22.017728    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b03f904a-27b1-4a1d-b44d-601e0eb00785-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-lb4tw\" (UID: \"b03f904a-27b1-4a1d-b44d-601e0eb00785\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lb4tw"
Sep 11 04:00:22.017804 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:22.017765    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b03f904a-27b1-4a1d-b44d-601e0eb00785-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-lb4tw\" (UID: \"b03f904a-27b1-4a1d-b44d-601e0eb00785\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lb4tw"
Sep 11 04:00:22.017911 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:22.017846    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b03f904a-27b1-4a1d-b44d-601e0eb00785-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-lb4tw\" (UID: \"b03f904a-27b1-4a1d-b44d-601e0eb00785\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lb4tw"
Sep 11 04:00:22.017911 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:22.017882    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b03f904a-27b1-4a1d-b44d-601e0eb00785-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-lb4tw\" (UID: \"b03f904a-27b1-4a1d-b44d-601e0eb00785\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lb4tw"
Sep 11 04:00:22.017911 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:22.017899    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b03f904a-27b1-4a1d-b44d-601e0eb00785-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-lb4tw\" (UID: \"b03f904a-27b1-4a1d-b44d-601e0eb00785\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lb4tw"
Sep 11 04:00:22.118654 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:22.118577    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b03f904a-27b1-4a1d-b44d-601e0eb00785-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-lb4tw\" (UID: \"b03f904a-27b1-4a1d-b44d-601e0eb00785\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lb4tw"
Sep 11 04:00:22.118654 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:22.118612    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b03f904a-27b1-4a1d-b44d-601e0eb00785-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-lb4tw\" (UID: \"b03f904a-27b1-4a1d-b44d-601e0eb00785\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lb4tw"
Sep 11 04:00:22.118654 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:22.118640    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b03f904a-27b1-4a1d-b44d-601e0eb00785-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-lb4tw\" (UID: \"b03f904a-27b1-4a1d-b44d-601e0eb00785\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lb4tw"
Sep 11 04:00:22.118909 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:22.118676    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b03f904a-27b1-4a1d-b44d-601e0eb00785-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-lb4tw\" (UID: \"b03f904a-27b1-4a1d-b44d-601e0eb00785\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lb4tw"
Sep 11 04:00:22.118909 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:22.118711    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b03f904a-27b1-4a1d-b44d-601e0eb00785-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-lb4tw\" (UID: \"b03f904a-27b1-4a1d-b44d-601e0eb00785\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lb4tw"
Sep 11 04:00:22.118909 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:22.118737    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b03f904a-27b1-4a1d-b44d-601e0eb00785-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-lb4tw\" (UID: \"b03f904a-27b1-4a1d-b44d-601e0eb00785\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lb4tw"
Sep 11 04:00:22.118909 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:22.118792    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk8xh\" (UniqueName: \"kubernetes.io/projected/b03f904a-27b1-4a1d-b44d-601e0eb00785-kube-api-access-qk8xh\") pod \"istiod-openshift-gateway-5677ccb49b-lb4tw\" (UID: \"b03f904a-27b1-4a1d-b44d-601e0eb00785\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lb4tw"
Sep 11 04:00:22.119505 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:22.119480    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b03f904a-27b1-4a1d-b44d-601e0eb00785-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-lb4tw\" (UID: \"b03f904a-27b1-4a1d-b44d-601e0eb00785\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lb4tw"
Sep 11 04:00:22.121064 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:22.121030    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b03f904a-27b1-4a1d-b44d-601e0eb00785-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-lb4tw\" (UID: \"b03f904a-27b1-4a1d-b44d-601e0eb00785\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lb4tw"
Sep 11 04:00:22.121195 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:22.121092    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b03f904a-27b1-4a1d-b44d-601e0eb00785-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-lb4tw\" (UID: \"b03f904a-27b1-4a1d-b44d-601e0eb00785\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lb4tw"
Sep 11 04:00:22.121195 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:22.121170    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b03f904a-27b1-4a1d-b44d-601e0eb00785-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-lb4tw\" (UID: \"b03f904a-27b1-4a1d-b44d-601e0eb00785\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lb4tw"
Sep 11 04:00:22.121379 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:22.121358    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b03f904a-27b1-4a1d-b44d-601e0eb00785-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-lb4tw\" (UID: \"b03f904a-27b1-4a1d-b44d-601e0eb00785\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lb4tw"
Sep 11 04:00:22.127066 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:22.127039    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b03f904a-27b1-4a1d-b44d-601e0eb00785-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-lb4tw\" (UID: \"b03f904a-27b1-4a1d-b44d-601e0eb00785\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lb4tw"
Sep 11 04:00:22.127378 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:22.127359    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk8xh\" (UniqueName: \"kubernetes.io/projected/b03f904a-27b1-4a1d-b44d-601e0eb00785-kube-api-access-qk8xh\") pod \"istiod-openshift-gateway-5677ccb49b-lb4tw\" (UID: \"b03f904a-27b1-4a1d-b44d-601e0eb00785\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lb4tw"
Sep 11 04:00:22.187454 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:22.187411    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lb4tw"
Sep 11 04:00:22.474583 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:22.474555    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-lb4tw"]
Sep 11 04:00:22.476106 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:00:22.476076    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb03f904a_27b1_4a1d_b44d_601e0eb00785.slice/crio-9b83a17f9a080f09d46341fcf22423b09a1dc823f38b6687fb09a3908fff434c WatchSource:0}: Error finding container 9b83a17f9a080f09d46341fcf22423b09a1dc823f38b6687fb09a3908fff434c: Status 404 returned error can't find the container with id 9b83a17f9a080f09d46341fcf22423b09a1dc823f38b6687fb09a3908fff434c
Sep 11 04:00:22.479066 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:22.479028    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:00:22.479178 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:22.479121    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:00:22.620193 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:22.620150    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lb4tw" event={"ID":"b03f904a-27b1-4a1d-b44d-601e0eb00785","Type":"ContainerStarted","Data":"e907f3182ecc6b52c4867987bc0861794c8d647aee21aab96c1a596606fa5ec8"}
Sep 11 04:00:22.620350 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:22.620213    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lb4tw" event={"ID":"b03f904a-27b1-4a1d-b44d-601e0eb00785","Type":"ContainerStarted","Data":"9b83a17f9a080f09d46341fcf22423b09a1dc823f38b6687fb09a3908fff434c"}
Sep 11 04:00:22.620350 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:22.620255    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lb4tw"
Sep 11 04:00:22.645371 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:22.645308    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lb4tw" podStartSLOduration=1.645287317 podStartE2EDuration="1.645287317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:00:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:00:22.643373125 +0000 UTC m=+419.441462852" watchObservedRunningTime="2026-09-11 04:00:22.645287317 +0000 UTC m=+419.443377045"
Sep 11 04:00:23.626680 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:23.626639    2558 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-lb4tw container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 04:00:23.627037 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:23.626700    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lb4tw" podUID="b03f904a-27b1-4a1d-b44d-601e0eb00785" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 04:00:26.626249 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:26.626219    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lb4tw"
Sep 11 04:00:26.686644 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:26.686615    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc"]
Sep 11 04:00:26.686815 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:26.686793    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc" podUID="44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b" containerName="discovery" containerID="cri-o://e5f5ddd33b7e1909b36f7fef2d6c314e2080a337914aad61136b632e1adabb28" gracePeriod=30
Sep 11 04:00:26.930121 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:26.930097    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc"
Sep 11 04:00:27.059024 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:27.058995    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-local-certs\") pod \"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b\" (UID: \"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b\") "
Sep 11 04:00:27.059024 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:27.059025    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-istio-kubeconfig\") pod \"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b\" (UID: \"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b\") "
Sep 11 04:00:27.059240 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:27.059058    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqrct\" (UniqueName: \"kubernetes.io/projected/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-kube-api-access-vqrct\") pod \"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b\" (UID: \"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b\") "
Sep 11 04:00:27.059240 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:27.059086    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-cacerts\") pod \"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b\" (UID: \"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b\") "
Sep 11 04:00:27.059240 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:27.059112    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-istio-csr-dns-cert\") pod \"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b\" (UID: \"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b\") "
Sep 11 04:00:27.059240 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:27.059154    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-istio-token\") pod \"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b\" (UID: \"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b\") "
Sep 11 04:00:27.059240 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:27.059186    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-istio-csr-ca-configmap\") pod \"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b\" (UID: \"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b\") "
Sep 11 04:00:27.059759 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:27.059727    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b" (UID: "44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:00:27.061487 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:27.061463    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-cacerts" (OuterVolumeSpecName: "cacerts") pod "44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b" (UID: "44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:00:27.061623 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:27.061606    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b" (UID: "44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:00:27.061684 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:27.061628    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b" (UID: "44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:00:27.061732 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:27.061698    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-local-certs" (OuterVolumeSpecName: "local-certs") pod "44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b" (UID: "44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:00:27.061768 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:27.061754    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-istio-token" (OuterVolumeSpecName: "istio-token") pod "44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b" (UID: "44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:00:27.061800 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:27.061766    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-kube-api-access-vqrct" (OuterVolumeSpecName: "kube-api-access-vqrct") pod "44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b" (UID: "44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b"). InnerVolumeSpecName "kube-api-access-vqrct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:00:27.160320 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:27.160287    2558 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-local-certs\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:00:27.160320 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:27.160315    2558 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-istio-kubeconfig\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:00:27.160320 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:27.160325    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqrct\" (UniqueName: \"kubernetes.io/projected/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-kube-api-access-vqrct\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:00:27.160541 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:27.160336    2558 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-cacerts\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:00:27.160541 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:27.160345    2558 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-istio-csr-dns-cert\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:00:27.160541 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:27.160354    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-istio-token\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:00:27.160541 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:27.160362    2558 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b-istio-csr-ca-configmap\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:00:27.643618 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:27.643586    2558 generic.go:356] "Generic (PLEG): container finished" podID="44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b" containerID="e5f5ddd33b7e1909b36f7fef2d6c314e2080a337914aad61136b632e1adabb28" exitCode=0
Sep 11 04:00:27.644046 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:27.643638    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc"
Sep 11 04:00:27.644046 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:27.643676    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc" event={"ID":"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b","Type":"ContainerDied","Data":"e5f5ddd33b7e1909b36f7fef2d6c314e2080a337914aad61136b632e1adabb28"}
Sep 11 04:00:27.644046 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:27.643781    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc" event={"ID":"44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b","Type":"ContainerDied","Data":"c6c01b69a8520f55175b818d8b68736aa82028dbe514c65b3b22391ae0ea8bb9"}
Sep 11 04:00:27.644046 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:27.643813    2558 scope.go:117] "RemoveContainer" containerID="e5f5ddd33b7e1909b36f7fef2d6c314e2080a337914aad61136b632e1adabb28"
Sep 11 04:00:27.652099 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:27.652083    2558 scope.go:117] "RemoveContainer" containerID="e5f5ddd33b7e1909b36f7fef2d6c314e2080a337914aad61136b632e1adabb28"
Sep 11 04:00:27.652414 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:00:27.652379    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5f5ddd33b7e1909b36f7fef2d6c314e2080a337914aad61136b632e1adabb28\": container with ID starting with e5f5ddd33b7e1909b36f7fef2d6c314e2080a337914aad61136b632e1adabb28 not found: ID does not exist" containerID="e5f5ddd33b7e1909b36f7fef2d6c314e2080a337914aad61136b632e1adabb28"
Sep 11 04:00:27.652475 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:27.652422    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5f5ddd33b7e1909b36f7fef2d6c314e2080a337914aad61136b632e1adabb28"} err="failed to get container status \"e5f5ddd33b7e1909b36f7fef2d6c314e2080a337914aad61136b632e1adabb28\": rpc error: code = NotFound desc = could not find container \"e5f5ddd33b7e1909b36f7fef2d6c314e2080a337914aad61136b632e1adabb28\": container with ID starting with e5f5ddd33b7e1909b36f7fef2d6c314e2080a337914aad61136b632e1adabb28 not found: ID does not exist"
Sep 11 04:00:27.671607 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:27.671583    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc"]
Sep 11 04:00:27.677837 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:27.677816    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc"]
Sep 11 04:00:27.809363 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:00:27.809341    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b" path="/var/lib/kubelet/pods/44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b/volumes"
Sep 11 04:01:18.812734 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:18.812696    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77mnck"]
Sep 11 04:01:18.813182 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:18.812975    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b" containerName="discovery"
Sep 11 04:01:18.813182 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:18.812987    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b" containerName="discovery"
Sep 11 04:01:18.813182 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:18.813054    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="44a5aa72-d8fb-46cb-ac3b-4fb4df889f3b" containerName="discovery"
Sep 11 04:01:18.816246 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:18.816228    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77mnck"
Sep 11 04:01:18.818824 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:18.818797    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 04:01:18.819736 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:18.819717    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 04:01:18.819796 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:18.819722    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kd9lt\""
Sep 11 04:01:18.824156 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:18.824126    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77mnck"]
Sep 11 04:01:18.909198 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:18.909173    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b6dc9"]
Sep 11 04:01:18.912320 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:18.912305    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b6dc9"
Sep 11 04:01:18.921938 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:18.921917    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b6dc9"]
Sep 11 04:01:18.928514 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:18.928490    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd6kl\" (UniqueName: \"kubernetes.io/projected/4b13a416-bbdd-490f-92b2-331ad4a2d72d-kube-api-access-kd6kl\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77mnck\" (UID: \"4b13a416-bbdd-490f-92b2-331ad4a2d72d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77mnck"
Sep 11 04:01:18.928633 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:18.928614    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b13a416-bbdd-490f-92b2-331ad4a2d72d-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77mnck\" (UID: \"4b13a416-bbdd-490f-92b2-331ad4a2d72d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77mnck"
Sep 11 04:01:18.928675 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:18.928658    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b13a416-bbdd-490f-92b2-331ad4a2d72d-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77mnck\" (UID: \"4b13a416-bbdd-490f-92b2-331ad4a2d72d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77mnck"
Sep 11 04:01:19.026021 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.025998    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7pnfr"]
Sep 11 04:01:19.029205 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.029190    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7pnfr"
Sep 11 04:01:19.029418 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.029377    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b13a416-bbdd-490f-92b2-331ad4a2d72d-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77mnck\" (UID: \"4b13a416-bbdd-490f-92b2-331ad4a2d72d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77mnck"
Sep 11 04:01:19.029480 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.029435    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b13a416-bbdd-490f-92b2-331ad4a2d72d-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77mnck\" (UID: \"4b13a416-bbdd-490f-92b2-331ad4a2d72d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77mnck"
Sep 11 04:01:19.029480 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.029458    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa077b8d-785b-4ea9-bfeb-38eab4c3f66c-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b6dc9\" (UID: \"aa077b8d-785b-4ea9-bfeb-38eab4c3f66c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b6dc9"
Sep 11 04:01:19.029573 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.029485    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tb7jh\" (UniqueName: \"kubernetes.io/projected/aa077b8d-785b-4ea9-bfeb-38eab4c3f66c-kube-api-access-tb7jh\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b6dc9\" (UID: \"aa077b8d-785b-4ea9-bfeb-38eab4c3f66c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b6dc9"
Sep 11 04:01:19.029573 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.029552    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd6kl\" (UniqueName: \"kubernetes.io/projected/4b13a416-bbdd-490f-92b2-331ad4a2d72d-kube-api-access-kd6kl\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77mnck\" (UID: \"4b13a416-bbdd-490f-92b2-331ad4a2d72d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77mnck"
Sep 11 04:01:19.029672 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.029646    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa077b8d-785b-4ea9-bfeb-38eab4c3f66c-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b6dc9\" (UID: \"aa077b8d-785b-4ea9-bfeb-38eab4c3f66c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b6dc9"
Sep 11 04:01:19.029770 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.029752    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b13a416-bbdd-490f-92b2-331ad4a2d72d-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77mnck\" (UID: \"4b13a416-bbdd-490f-92b2-331ad4a2d72d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77mnck"
Sep 11 04:01:19.029770 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.029763    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b13a416-bbdd-490f-92b2-331ad4a2d72d-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77mnck\" (UID: \"4b13a416-bbdd-490f-92b2-331ad4a2d72d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77mnck"
Sep 11 04:01:19.037559 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.037538    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7pnfr"]
Sep 11 04:01:19.040180 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.040151    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd6kl\" (UniqueName: \"kubernetes.io/projected/4b13a416-bbdd-490f-92b2-331ad4a2d72d-kube-api-access-kd6kl\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77mnck\" (UID: \"4b13a416-bbdd-490f-92b2-331ad4a2d72d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77mnck"
Sep 11 04:01:19.115072 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.115048    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afjqcb"]
Sep 11 04:01:19.118314 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.118300    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afjqcb"
Sep 11 04:01:19.126208 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.126188    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77mnck"
Sep 11 04:01:19.127473 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.127456    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afjqcb"]
Sep 11 04:01:19.129993 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.129973    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tb7jh\" (UniqueName: \"kubernetes.io/projected/aa077b8d-785b-4ea9-bfeb-38eab4c3f66c-kube-api-access-tb7jh\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b6dc9\" (UID: \"aa077b8d-785b-4ea9-bfeb-38eab4c3f66c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b6dc9"
Sep 11 04:01:19.130083 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.130012    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe847bb1-7daa-4d8b-8244-c5053f658675-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7pnfr\" (UID: \"fe847bb1-7daa-4d8b-8244-c5053f658675\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7pnfr"
Sep 11 04:01:19.130083 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.130033    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8jch\" (UniqueName: \"kubernetes.io/projected/fe847bb1-7daa-4d8b-8244-c5053f658675-kube-api-access-q8jch\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7pnfr\" (UID: \"fe847bb1-7daa-4d8b-8244-c5053f658675\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7pnfr"
Sep 11 04:01:19.130194 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.130129    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa077b8d-785b-4ea9-bfeb-38eab4c3f66c-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b6dc9\" (UID: \"aa077b8d-785b-4ea9-bfeb-38eab4c3f66c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b6dc9"
Sep 11 04:01:19.130252 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.130194    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe847bb1-7daa-4d8b-8244-c5053f658675-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7pnfr\" (UID: \"fe847bb1-7daa-4d8b-8244-c5053f658675\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7pnfr"
Sep 11 04:01:19.130310 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.130249    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa077b8d-785b-4ea9-bfeb-38eab4c3f66c-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b6dc9\" (UID: \"aa077b8d-785b-4ea9-bfeb-38eab4c3f66c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b6dc9"
Sep 11 04:01:19.130426 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.130409    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa077b8d-785b-4ea9-bfeb-38eab4c3f66c-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b6dc9\" (UID: \"aa077b8d-785b-4ea9-bfeb-38eab4c3f66c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b6dc9"
Sep 11 04:01:19.130616 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.130597    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa077b8d-785b-4ea9-bfeb-38eab4c3f66c-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b6dc9\" (UID: \"aa077b8d-785b-4ea9-bfeb-38eab4c3f66c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b6dc9"
Sep 11 04:01:19.138239 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.138209    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tb7jh\" (UniqueName: \"kubernetes.io/projected/aa077b8d-785b-4ea9-bfeb-38eab4c3f66c-kube-api-access-tb7jh\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b6dc9\" (UID: \"aa077b8d-785b-4ea9-bfeb-38eab4c3f66c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b6dc9"
Sep 11 04:01:19.221197 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.221174    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b6dc9"
Sep 11 04:01:19.231156 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.231131    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c3469a3-fe08-48a0-9f05-368b1a64c995-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afjqcb\" (UID: \"9c3469a3-fe08-48a0-9f05-368b1a64c995\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afjqcb"
Sep 11 04:01:19.231263 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.231177    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe847bb1-7daa-4d8b-8244-c5053f658675-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7pnfr\" (UID: \"fe847bb1-7daa-4d8b-8244-c5053f658675\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7pnfr"
Sep 11 04:01:19.231263 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.231225    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c3469a3-fe08-48a0-9f05-368b1a64c995-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afjqcb\" (UID: \"9c3469a3-fe08-48a0-9f05-368b1a64c995\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afjqcb"
Sep 11 04:01:19.231263 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.231258    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe847bb1-7daa-4d8b-8244-c5053f658675-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7pnfr\" (UID: \"fe847bb1-7daa-4d8b-8244-c5053f658675\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7pnfr"
Sep 11 04:01:19.231492 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.231284    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8jch\" (UniqueName: \"kubernetes.io/projected/fe847bb1-7daa-4d8b-8244-c5053f658675-kube-api-access-q8jch\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7pnfr\" (UID: \"fe847bb1-7daa-4d8b-8244-c5053f658675\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7pnfr"
Sep 11 04:01:19.231492 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.231343    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vvrj\" (UniqueName: \"kubernetes.io/projected/9c3469a3-fe08-48a0-9f05-368b1a64c995-kube-api-access-2vvrj\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afjqcb\" (UID: \"9c3469a3-fe08-48a0-9f05-368b1a64c995\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afjqcb"
Sep 11 04:01:19.231596 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.231576    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe847bb1-7daa-4d8b-8244-c5053f658675-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7pnfr\" (UID: \"fe847bb1-7daa-4d8b-8244-c5053f658675\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7pnfr"
Sep 11 04:01:19.231632 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.231607    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe847bb1-7daa-4d8b-8244-c5053f658675-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7pnfr\" (UID: \"fe847bb1-7daa-4d8b-8244-c5053f658675\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7pnfr"
Sep 11 04:01:19.239324 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.239302    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8jch\" (UniqueName: \"kubernetes.io/projected/fe847bb1-7daa-4d8b-8244-c5053f658675-kube-api-access-q8jch\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7pnfr\" (UID: \"fe847bb1-7daa-4d8b-8244-c5053f658675\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7pnfr"
Sep 11 04:01:19.332144 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.332117    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vvrj\" (UniqueName: \"kubernetes.io/projected/9c3469a3-fe08-48a0-9f05-368b1a64c995-kube-api-access-2vvrj\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afjqcb\" (UID: \"9c3469a3-fe08-48a0-9f05-368b1a64c995\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afjqcb"
Sep 11 04:01:19.332256 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.332177    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c3469a3-fe08-48a0-9f05-368b1a64c995-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afjqcb\" (UID: \"9c3469a3-fe08-48a0-9f05-368b1a64c995\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afjqcb"
Sep 11 04:01:19.332256 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.332223    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c3469a3-fe08-48a0-9f05-368b1a64c995-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afjqcb\" (UID: \"9c3469a3-fe08-48a0-9f05-368b1a64c995\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afjqcb"
Sep 11 04:01:19.332613 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.332591    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c3469a3-fe08-48a0-9f05-368b1a64c995-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afjqcb\" (UID: \"9c3469a3-fe08-48a0-9f05-368b1a64c995\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afjqcb"
Sep 11 04:01:19.332694 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.332594    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c3469a3-fe08-48a0-9f05-368b1a64c995-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afjqcb\" (UID: \"9c3469a3-fe08-48a0-9f05-368b1a64c995\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afjqcb"
Sep 11 04:01:19.338071 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.338041    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7pnfr"
Sep 11 04:01:19.340769 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.340751    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vvrj\" (UniqueName: \"kubernetes.io/projected/9c3469a3-fe08-48a0-9f05-368b1a64c995-kube-api-access-2vvrj\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afjqcb\" (UID: \"9c3469a3-fe08-48a0-9f05-368b1a64c995\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afjqcb"
Sep 11 04:01:19.398524 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.398486    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77mnck"]
Sep 11 04:01:19.398781 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:01:19.398758    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b13a416_bbdd_490f_92b2_331ad4a2d72d.slice/crio-b30b0cdb6468b12bd47fbf706cc17bfe7080745a07bba51e6f1900723ed202d0 WatchSource:0}: Error finding container b30b0cdb6468b12bd47fbf706cc17bfe7080745a07bba51e6f1900723ed202d0: Status 404 returned error can't find the container with id b30b0cdb6468b12bd47fbf706cc17bfe7080745a07bba51e6f1900723ed202d0
Sep 11 04:01:19.427506 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.427479    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afjqcb"
Sep 11 04:01:19.492811 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.492778    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b6dc9"]
Sep 11 04:01:19.493615 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:01:19.493575    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa077b8d_785b_4ea9_bfeb_38eab4c3f66c.slice/crio-f2db670b7362e734110847bd14780d86a0fc78224a8c5803d91a755a7632ebae WatchSource:0}: Error finding container f2db670b7362e734110847bd14780d86a0fc78224a8c5803d91a755a7632ebae: Status 404 returned error can't find the container with id f2db670b7362e734110847bd14780d86a0fc78224a8c5803d91a755a7632ebae
Sep 11 04:01:19.607685 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.607606    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7pnfr"]
Sep 11 04:01:19.610205 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:01:19.610178    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe847bb1_7daa_4d8b_8244_c5053f658675.slice/crio-594269aad6843c7c7627a47e772a651afb468fdce79b1380b9e11f84a690f170 WatchSource:0}: Error finding container 594269aad6843c7c7627a47e772a651afb468fdce79b1380b9e11f84a690f170: Status 404 returned error can't find the container with id 594269aad6843c7c7627a47e772a651afb468fdce79b1380b9e11f84a690f170
Sep 11 04:01:19.701381 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.701359    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afjqcb"]
Sep 11 04:01:19.703043 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:01:19.703019    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c3469a3_fe08_48a0_9f05_368b1a64c995.slice/crio-e24d403999a4daaca1b6f9422221ec265d409a41c457f403fc7b04f5943e3e13 WatchSource:0}: Error finding container e24d403999a4daaca1b6f9422221ec265d409a41c457f403fc7b04f5943e3e13: Status 404 returned error can't find the container with id e24d403999a4daaca1b6f9422221ec265d409a41c457f403fc7b04f5943e3e13
Sep 11 04:01:19.887490 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.887459    2558 generic.go:356] "Generic (PLEG): container finished" podID="fe847bb1-7daa-4d8b-8244-c5053f658675" containerID="00a344a9788a53858c4de2a9a5734793e55e940219d93130b7f5a0ce0afdf009" exitCode=0
Sep 11 04:01:19.887868 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.887531    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7pnfr" event={"ID":"fe847bb1-7daa-4d8b-8244-c5053f658675","Type":"ContainerDied","Data":"00a344a9788a53858c4de2a9a5734793e55e940219d93130b7f5a0ce0afdf009"}
Sep 11 04:01:19.887868 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.887575    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7pnfr" event={"ID":"fe847bb1-7daa-4d8b-8244-c5053f658675","Type":"ContainerStarted","Data":"594269aad6843c7c7627a47e772a651afb468fdce79b1380b9e11f84a690f170"}
Sep 11 04:01:19.889251 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.889227    2558 generic.go:356] "Generic (PLEG): container finished" podID="aa077b8d-785b-4ea9-bfeb-38eab4c3f66c" containerID="aaccb8731eff39c92f84120e001c428b2395530f934561814d32c09651b4f5a7" exitCode=0
Sep 11 04:01:19.889354 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.889298    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b6dc9" event={"ID":"aa077b8d-785b-4ea9-bfeb-38eab4c3f66c","Type":"ContainerDied","Data":"aaccb8731eff39c92f84120e001c428b2395530f934561814d32c09651b4f5a7"}
Sep 11 04:01:19.889354 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.889332    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b6dc9" event={"ID":"aa077b8d-785b-4ea9-bfeb-38eab4c3f66c","Type":"ContainerStarted","Data":"f2db670b7362e734110847bd14780d86a0fc78224a8c5803d91a755a7632ebae"}
Sep 11 04:01:19.891075 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.891029    2558 generic.go:356] "Generic (PLEG): container finished" podID="4b13a416-bbdd-490f-92b2-331ad4a2d72d" containerID="5558133a4782642bdf5159d2bccd601783ef09d9768e360f68d61e94583b876b" exitCode=0
Sep 11 04:01:19.891199 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.891080    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77mnck" event={"ID":"4b13a416-bbdd-490f-92b2-331ad4a2d72d","Type":"ContainerDied","Data":"5558133a4782642bdf5159d2bccd601783ef09d9768e360f68d61e94583b876b"}
Sep 11 04:01:19.891199 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.891147    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77mnck" event={"ID":"4b13a416-bbdd-490f-92b2-331ad4a2d72d","Type":"ContainerStarted","Data":"b30b0cdb6468b12bd47fbf706cc17bfe7080745a07bba51e6f1900723ed202d0"}
Sep 11 04:01:19.892823 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.892800    2558 generic.go:356] "Generic (PLEG): container finished" podID="9c3469a3-fe08-48a0-9f05-368b1a64c995" containerID="dbd9b9bf219c9aba6a14d3b5d4f77dd1dc74b86f29bd8a6da76872546de55190" exitCode=0
Sep 11 04:01:19.892913 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.892848    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afjqcb" event={"ID":"9c3469a3-fe08-48a0-9f05-368b1a64c995","Type":"ContainerDied","Data":"dbd9b9bf219c9aba6a14d3b5d4f77dd1dc74b86f29bd8a6da76872546de55190"}
Sep 11 04:01:19.892913 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:19.892878    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afjqcb" event={"ID":"9c3469a3-fe08-48a0-9f05-368b1a64c995","Type":"ContainerStarted","Data":"e24d403999a4daaca1b6f9422221ec265d409a41c457f403fc7b04f5943e3e13"}
Sep 11 04:01:20.899471 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:20.899442    2558 generic.go:356] "Generic (PLEG): container finished" podID="9c3469a3-fe08-48a0-9f05-368b1a64c995" containerID="21468c2658a2025a86a750a55a59aca0794708f483fa200b9df23fe46856ebb4" exitCode=0
Sep 11 04:01:20.899793 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:20.899532    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afjqcb" event={"ID":"9c3469a3-fe08-48a0-9f05-368b1a64c995","Type":"ContainerDied","Data":"21468c2658a2025a86a750a55a59aca0794708f483fa200b9df23fe46856ebb4"}
Sep 11 04:01:20.901510 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:20.901491    2558 generic.go:356] "Generic (PLEG): container finished" podID="aa077b8d-785b-4ea9-bfeb-38eab4c3f66c" containerID="9237a7e01ea18f1496e27826a8e95f1623c69437ea0173b30ca2d6dccb023ef2" exitCode=0
Sep 11 04:01:20.901599 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:20.901522    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b6dc9" event={"ID":"aa077b8d-785b-4ea9-bfeb-38eab4c3f66c","Type":"ContainerDied","Data":"9237a7e01ea18f1496e27826a8e95f1623c69437ea0173b30ca2d6dccb023ef2"}
Sep 11 04:01:21.908643 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:21.908613    2558 generic.go:356] "Generic (PLEG): container finished" podID="aa077b8d-785b-4ea9-bfeb-38eab4c3f66c" containerID="7a62943eb7e0cbe381878a1df1a345245c2a84a9a6c351e847dfc8aa4e7b2900" exitCode=0
Sep 11 04:01:21.909045 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:21.908689    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b6dc9" event={"ID":"aa077b8d-785b-4ea9-bfeb-38eab4c3f66c","Type":"ContainerDied","Data":"7a62943eb7e0cbe381878a1df1a345245c2a84a9a6c351e847dfc8aa4e7b2900"}
Sep 11 04:01:21.910563 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:21.910539    2558 generic.go:356] "Generic (PLEG): container finished" podID="4b13a416-bbdd-490f-92b2-331ad4a2d72d" containerID="ba5ff247ddb9296f35b97e8b009e6e17fa4f59040323f4dfc03acc5a05a00d33" exitCode=0
Sep 11 04:01:21.910657 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:21.910623    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77mnck" event={"ID":"4b13a416-bbdd-490f-92b2-331ad4a2d72d","Type":"ContainerDied","Data":"ba5ff247ddb9296f35b97e8b009e6e17fa4f59040323f4dfc03acc5a05a00d33"}
Sep 11 04:01:21.913154 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:21.913134    2558 generic.go:356] "Generic (PLEG): container finished" podID="9c3469a3-fe08-48a0-9f05-368b1a64c995" containerID="af811f7cf30ad7e3bd6e4e4ef3b36917386bc0239b6d249a46747ef4fe625b15" exitCode=0
Sep 11 04:01:21.913235 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:21.913178    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afjqcb" event={"ID":"9c3469a3-fe08-48a0-9f05-368b1a64c995","Type":"ContainerDied","Data":"af811f7cf30ad7e3bd6e4e4ef3b36917386bc0239b6d249a46747ef4fe625b15"}
Sep 11 04:01:22.923109 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:22.923068    2558 generic.go:356] "Generic (PLEG): container finished" podID="fe847bb1-7daa-4d8b-8244-c5053f658675" containerID="13b4b2b92df38e8ecd25feac45c10e604e99f11cde0d0df5b339639ffdc1ac1d" exitCode=0
Sep 11 04:01:22.923546 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:22.923148    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7pnfr" event={"ID":"fe847bb1-7daa-4d8b-8244-c5053f658675","Type":"ContainerDied","Data":"13b4b2b92df38e8ecd25feac45c10e604e99f11cde0d0df5b339639ffdc1ac1d"}
Sep 11 04:01:22.925797 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:22.925771    2558 generic.go:356] "Generic (PLEG): container finished" podID="4b13a416-bbdd-490f-92b2-331ad4a2d72d" containerID="7ef884408fd84135f19bd3b9cfd0337d92e60515ba391538f9ca91337690a05d" exitCode=0
Sep 11 04:01:22.925912 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:22.925861    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77mnck" event={"ID":"4b13a416-bbdd-490f-92b2-331ad4a2d72d","Type":"ContainerDied","Data":"7ef884408fd84135f19bd3b9cfd0337d92e60515ba391538f9ca91337690a05d"}
Sep 11 04:01:23.068857 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:23.068833    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b6dc9"
Sep 11 04:01:23.140476 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:23.140452    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afjqcb"
Sep 11 04:01:23.164969 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:23.164943    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa077b8d-785b-4ea9-bfeb-38eab4c3f66c-bundle\") pod \"aa077b8d-785b-4ea9-bfeb-38eab4c3f66c\" (UID: \"aa077b8d-785b-4ea9-bfeb-38eab4c3f66c\") "
Sep 11 04:01:23.165089 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:23.165009    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tb7jh\" (UniqueName: \"kubernetes.io/projected/aa077b8d-785b-4ea9-bfeb-38eab4c3f66c-kube-api-access-tb7jh\") pod \"aa077b8d-785b-4ea9-bfeb-38eab4c3f66c\" (UID: \"aa077b8d-785b-4ea9-bfeb-38eab4c3f66c\") "
Sep 11 04:01:23.165164 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:23.165097    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa077b8d-785b-4ea9-bfeb-38eab4c3f66c-util\") pod \"aa077b8d-785b-4ea9-bfeb-38eab4c3f66c\" (UID: \"aa077b8d-785b-4ea9-bfeb-38eab4c3f66c\") "
Sep 11 04:01:23.165484 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:23.165439    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa077b8d-785b-4ea9-bfeb-38eab4c3f66c-bundle" (OuterVolumeSpecName: "bundle") pod "aa077b8d-785b-4ea9-bfeb-38eab4c3f66c" (UID: "aa077b8d-785b-4ea9-bfeb-38eab4c3f66c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:01:23.166944 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:23.166918    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa077b8d-785b-4ea9-bfeb-38eab4c3f66c-kube-api-access-tb7jh" (OuterVolumeSpecName: "kube-api-access-tb7jh") pod "aa077b8d-785b-4ea9-bfeb-38eab4c3f66c" (UID: "aa077b8d-785b-4ea9-bfeb-38eab4c3f66c"). InnerVolumeSpecName "kube-api-access-tb7jh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:01:23.170071 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:23.170045    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa077b8d-785b-4ea9-bfeb-38eab4c3f66c-util" (OuterVolumeSpecName: "util") pod "aa077b8d-785b-4ea9-bfeb-38eab4c3f66c" (UID: "aa077b8d-785b-4ea9-bfeb-38eab4c3f66c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:01:23.266351 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:23.266299    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c3469a3-fe08-48a0-9f05-368b1a64c995-bundle\") pod \"9c3469a3-fe08-48a0-9f05-368b1a64c995\" (UID: \"9c3469a3-fe08-48a0-9f05-368b1a64c995\") "
Sep 11 04:01:23.266351 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:23.266342    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c3469a3-fe08-48a0-9f05-368b1a64c995-util\") pod \"9c3469a3-fe08-48a0-9f05-368b1a64c995\" (UID: \"9c3469a3-fe08-48a0-9f05-368b1a64c995\") "
Sep 11 04:01:23.266509 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:23.266366    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vvrj\" (UniqueName: \"kubernetes.io/projected/9c3469a3-fe08-48a0-9f05-368b1a64c995-kube-api-access-2vvrj\") pod \"9c3469a3-fe08-48a0-9f05-368b1a64c995\" (UID: \"9c3469a3-fe08-48a0-9f05-368b1a64c995\") "
Sep 11 04:01:23.266615 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:23.266596    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa077b8d-785b-4ea9-bfeb-38eab4c3f66c-util\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:01:23.266673 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:23.266620    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa077b8d-785b-4ea9-bfeb-38eab4c3f66c-bundle\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:01:23.266673 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:23.266633    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tb7jh\" (UniqueName: \"kubernetes.io/projected/aa077b8d-785b-4ea9-bfeb-38eab4c3f66c-kube-api-access-tb7jh\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:01:23.266962 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:23.266939    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c3469a3-fe08-48a0-9f05-368b1a64c995-bundle" (OuterVolumeSpecName: "bundle") pod "9c3469a3-fe08-48a0-9f05-368b1a64c995" (UID: "9c3469a3-fe08-48a0-9f05-368b1a64c995"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:01:23.268360 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:23.268336    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c3469a3-fe08-48a0-9f05-368b1a64c995-kube-api-access-2vvrj" (OuterVolumeSpecName: "kube-api-access-2vvrj") pod "9c3469a3-fe08-48a0-9f05-368b1a64c995" (UID: "9c3469a3-fe08-48a0-9f05-368b1a64c995"). InnerVolumeSpecName "kube-api-access-2vvrj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:01:23.271725 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:23.271700    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c3469a3-fe08-48a0-9f05-368b1a64c995-util" (OuterVolumeSpecName: "util") pod "9c3469a3-fe08-48a0-9f05-368b1a64c995" (UID: "9c3469a3-fe08-48a0-9f05-368b1a64c995"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:01:23.367821 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:23.367797    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c3469a3-fe08-48a0-9f05-368b1a64c995-bundle\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:01:23.367821 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:23.367818    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c3469a3-fe08-48a0-9f05-368b1a64c995-util\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:01:23.367937 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:23.367827    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vvrj\" (UniqueName: \"kubernetes.io/projected/9c3469a3-fe08-48a0-9f05-368b1a64c995-kube-api-access-2vvrj\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:01:23.932466 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:23.932434    2558 generic.go:356] "Generic (PLEG): container finished" podID="fe847bb1-7daa-4d8b-8244-c5053f658675" containerID="6cd97c901a391e7e2b6463c1a415ef1c515f796341888e6a2ea349cd69d726a8" exitCode=0
Sep 11 04:01:23.932823 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:23.932516    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7pnfr" event={"ID":"fe847bb1-7daa-4d8b-8244-c5053f658675","Type":"ContainerDied","Data":"6cd97c901a391e7e2b6463c1a415ef1c515f796341888e6a2ea349cd69d726a8"}
Sep 11 04:01:23.934376 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:23.934359    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b6dc9"
Sep 11 04:01:23.934488 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:23.934408    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6b6dc9" event={"ID":"aa077b8d-785b-4ea9-bfeb-38eab4c3f66c","Type":"ContainerDied","Data":"f2db670b7362e734110847bd14780d86a0fc78224a8c5803d91a755a7632ebae"}
Sep 11 04:01:23.934488 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:23.934439    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f2db670b7362e734110847bd14780d86a0fc78224a8c5803d91a755a7632ebae"
Sep 11 04:01:23.936446 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:23.936339    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afjqcb" event={"ID":"9c3469a3-fe08-48a0-9f05-368b1a64c995","Type":"ContainerDied","Data":"e24d403999a4daaca1b6f9422221ec265d409a41c457f403fc7b04f5943e3e13"}
Sep 11 04:01:23.936446 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:23.936354    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afjqcb"
Sep 11 04:01:23.936446 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:23.936419    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e24d403999a4daaca1b6f9422221ec265d409a41c457f403fc7b04f5943e3e13"
Sep 11 04:01:24.064368 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:24.064347    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77mnck"
Sep 11 04:01:24.174371 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:24.174344    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kd6kl\" (UniqueName: \"kubernetes.io/projected/4b13a416-bbdd-490f-92b2-331ad4a2d72d-kube-api-access-kd6kl\") pod \"4b13a416-bbdd-490f-92b2-331ad4a2d72d\" (UID: \"4b13a416-bbdd-490f-92b2-331ad4a2d72d\") "
Sep 11 04:01:24.174591 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:24.174457    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b13a416-bbdd-490f-92b2-331ad4a2d72d-bundle\") pod \"4b13a416-bbdd-490f-92b2-331ad4a2d72d\" (UID: \"4b13a416-bbdd-490f-92b2-331ad4a2d72d\") "
Sep 11 04:01:24.174591 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:24.174483    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b13a416-bbdd-490f-92b2-331ad4a2d72d-util\") pod \"4b13a416-bbdd-490f-92b2-331ad4a2d72d\" (UID: \"4b13a416-bbdd-490f-92b2-331ad4a2d72d\") "
Sep 11 04:01:24.174968 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:24.174935    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b13a416-bbdd-490f-92b2-331ad4a2d72d-bundle" (OuterVolumeSpecName: "bundle") pod "4b13a416-bbdd-490f-92b2-331ad4a2d72d" (UID: "4b13a416-bbdd-490f-92b2-331ad4a2d72d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:01:24.176307 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:24.176280    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b13a416-bbdd-490f-92b2-331ad4a2d72d-kube-api-access-kd6kl" (OuterVolumeSpecName: "kube-api-access-kd6kl") pod "4b13a416-bbdd-490f-92b2-331ad4a2d72d" (UID: "4b13a416-bbdd-490f-92b2-331ad4a2d72d"). InnerVolumeSpecName "kube-api-access-kd6kl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:01:24.180482 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:24.180455    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b13a416-bbdd-490f-92b2-331ad4a2d72d-util" (OuterVolumeSpecName: "util") pod "4b13a416-bbdd-490f-92b2-331ad4a2d72d" (UID: "4b13a416-bbdd-490f-92b2-331ad4a2d72d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:01:24.275172 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:24.275119    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kd6kl\" (UniqueName: \"kubernetes.io/projected/4b13a416-bbdd-490f-92b2-331ad4a2d72d-kube-api-access-kd6kl\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:01:24.275172 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:24.275140    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b13a416-bbdd-490f-92b2-331ad4a2d72d-bundle\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:01:24.275172 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:24.275150    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b13a416-bbdd-490f-92b2-331ad4a2d72d-util\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:01:24.943724 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:24.943695    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77mnck"
Sep 11 04:01:24.944180 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:24.943726    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77mnck" event={"ID":"4b13a416-bbdd-490f-92b2-331ad4a2d72d","Type":"ContainerDied","Data":"b30b0cdb6468b12bd47fbf706cc17bfe7080745a07bba51e6f1900723ed202d0"}
Sep 11 04:01:24.944180 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:24.943769    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b30b0cdb6468b12bd47fbf706cc17bfe7080745a07bba51e6f1900723ed202d0"
Sep 11 04:01:25.074947 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:25.074922    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7pnfr"
Sep 11 04:01:25.182465 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:25.182437    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe847bb1-7daa-4d8b-8244-c5053f658675-util\") pod \"fe847bb1-7daa-4d8b-8244-c5053f658675\" (UID: \"fe847bb1-7daa-4d8b-8244-c5053f658675\") "
Sep 11 04:01:25.182595 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:25.182476    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe847bb1-7daa-4d8b-8244-c5053f658675-bundle\") pod \"fe847bb1-7daa-4d8b-8244-c5053f658675\" (UID: \"fe847bb1-7daa-4d8b-8244-c5053f658675\") "
Sep 11 04:01:25.182595 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:25.182519    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8jch\" (UniqueName: \"kubernetes.io/projected/fe847bb1-7daa-4d8b-8244-c5053f658675-kube-api-access-q8jch\") pod \"fe847bb1-7daa-4d8b-8244-c5053f658675\" (UID: \"fe847bb1-7daa-4d8b-8244-c5053f658675\") "
Sep 11 04:01:25.182988 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:25.182964    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe847bb1-7daa-4d8b-8244-c5053f658675-bundle" (OuterVolumeSpecName: "bundle") pod "fe847bb1-7daa-4d8b-8244-c5053f658675" (UID: "fe847bb1-7daa-4d8b-8244-c5053f658675"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:01:25.184621 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:25.184602    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe847bb1-7daa-4d8b-8244-c5053f658675-kube-api-access-q8jch" (OuterVolumeSpecName: "kube-api-access-q8jch") pod "fe847bb1-7daa-4d8b-8244-c5053f658675" (UID: "fe847bb1-7daa-4d8b-8244-c5053f658675"). InnerVolumeSpecName "kube-api-access-q8jch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:01:25.217779 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:25.217712    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe847bb1-7daa-4d8b-8244-c5053f658675-util" (OuterVolumeSpecName: "util") pod "fe847bb1-7daa-4d8b-8244-c5053f658675" (UID: "fe847bb1-7daa-4d8b-8244-c5053f658675"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:01:25.283847 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:25.283823    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8jch\" (UniqueName: \"kubernetes.io/projected/fe847bb1-7daa-4d8b-8244-c5053f658675-kube-api-access-q8jch\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:01:25.283847 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:25.283844    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe847bb1-7daa-4d8b-8244-c5053f658675-util\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:01:25.283965 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:25.283855    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe847bb1-7daa-4d8b-8244-c5053f658675-bundle\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:01:25.949741 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:25.949718    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7pnfr"
Sep 11 04:01:25.950068 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:25.949722    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7pnfr" event={"ID":"fe847bb1-7daa-4d8b-8244-c5053f658675","Type":"ContainerDied","Data":"594269aad6843c7c7627a47e772a651afb468fdce79b1380b9e11f84a690f170"}
Sep 11 04:01:25.950068 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:25.949829    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="594269aad6843c7c7627a47e772a651afb468fdce79b1380b9e11f84a690f170"
Sep 11 04:01:32.290472 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.290438    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-62hc8"]
Sep 11 04:01:32.290844 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.290727    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa077b8d-785b-4ea9-bfeb-38eab4c3f66c" containerName="util"
Sep 11 04:01:32.290844 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.290738    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa077b8d-785b-4ea9-bfeb-38eab4c3f66c" containerName="util"
Sep 11 04:01:32.290844 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.290747    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe847bb1-7daa-4d8b-8244-c5053f658675" containerName="pull"
Sep 11 04:01:32.290844 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.290753    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe847bb1-7daa-4d8b-8244-c5053f658675" containerName="pull"
Sep 11 04:01:32.290844 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.290759    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe847bb1-7daa-4d8b-8244-c5053f658675" containerName="extract"
Sep 11 04:01:32.290844 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.290765    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe847bb1-7daa-4d8b-8244-c5053f658675" containerName="extract"
Sep 11 04:01:32.290844 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.290773    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c3469a3-fe08-48a0-9f05-368b1a64c995" containerName="util"
Sep 11 04:01:32.290844 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.290777    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c3469a3-fe08-48a0-9f05-368b1a64c995" containerName="util"
Sep 11 04:01:32.290844 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.290784    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe847bb1-7daa-4d8b-8244-c5053f658675" containerName="util"
Sep 11 04:01:32.290844 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.290789    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe847bb1-7daa-4d8b-8244-c5053f658675" containerName="util"
Sep 11 04:01:32.290844 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.290796    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b13a416-bbdd-490f-92b2-331ad4a2d72d" containerName="extract"
Sep 11 04:01:32.290844 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.290801    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b13a416-bbdd-490f-92b2-331ad4a2d72d" containerName="extract"
Sep 11 04:01:32.290844 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.290810    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b13a416-bbdd-490f-92b2-331ad4a2d72d" containerName="util"
Sep 11 04:01:32.290844 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.290815    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b13a416-bbdd-490f-92b2-331ad4a2d72d" containerName="util"
Sep 11 04:01:32.290844 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.290820    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c3469a3-fe08-48a0-9f05-368b1a64c995" containerName="extract"
Sep 11 04:01:32.290844 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.290826    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c3469a3-fe08-48a0-9f05-368b1a64c995" containerName="extract"
Sep 11 04:01:32.290844 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.290831    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa077b8d-785b-4ea9-bfeb-38eab4c3f66c" containerName="extract"
Sep 11 04:01:32.290844 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.290836    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa077b8d-785b-4ea9-bfeb-38eab4c3f66c" containerName="extract"
Sep 11 04:01:32.290844 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.290842    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa077b8d-785b-4ea9-bfeb-38eab4c3f66c" containerName="pull"
Sep 11 04:01:32.290844 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.290847    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa077b8d-785b-4ea9-bfeb-38eab4c3f66c" containerName="pull"
Sep 11 04:01:32.291509 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.290858    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b13a416-bbdd-490f-92b2-331ad4a2d72d" containerName="pull"
Sep 11 04:01:32.291509 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.290863    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b13a416-bbdd-490f-92b2-331ad4a2d72d" containerName="pull"
Sep 11 04:01:32.291509 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.290871    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c3469a3-fe08-48a0-9f05-368b1a64c995" containerName="pull"
Sep 11 04:01:32.291509 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.290876    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c3469a3-fe08-48a0-9f05-368b1a64c995" containerName="pull"
Sep 11 04:01:32.291509 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.290926    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c3469a3-fe08-48a0-9f05-368b1a64c995" containerName="extract"
Sep 11 04:01:32.291509 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.290934    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b13a416-bbdd-490f-92b2-331ad4a2d72d" containerName="extract"
Sep 11 04:01:32.291509 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.290940    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe847bb1-7daa-4d8b-8244-c5053f658675" containerName="extract"
Sep 11 04:01:32.291509 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.290958    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa077b8d-785b-4ea9-bfeb-38eab4c3f66c" containerName="extract"
Sep 11 04:01:32.294753 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.294733    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-62hc8"
Sep 11 04:01:32.297511 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.297488    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 11 04:01:32.298091 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.298071    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 11 04:01:32.298178 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.298089    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-96bgd\""
Sep 11 04:01:32.298178 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.298122    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 11 04:01:32.308300 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.308277    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-62hc8"]
Sep 11 04:01:32.438664 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.438633    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8j7l\" (UniqueName: \"kubernetes.io/projected/4b349024-b3f7-4bc4-9d50-076a0f6f7e8e-kube-api-access-z8j7l\") pod \"dns-operator-controller-manager-7b84cd7c9c-62hc8\" (UID: \"4b349024-b3f7-4bc4-9d50-076a0f6f7e8e\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-62hc8"
Sep 11 04:01:32.539582 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.539550    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8j7l\" (UniqueName: \"kubernetes.io/projected/4b349024-b3f7-4bc4-9d50-076a0f6f7e8e-kube-api-access-z8j7l\") pod \"dns-operator-controller-manager-7b84cd7c9c-62hc8\" (UID: \"4b349024-b3f7-4bc4-9d50-076a0f6f7e8e\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-62hc8"
Sep 11 04:01:32.549736 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.549682    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8j7l\" (UniqueName: \"kubernetes.io/projected/4b349024-b3f7-4bc4-9d50-076a0f6f7e8e-kube-api-access-z8j7l\") pod \"dns-operator-controller-manager-7b84cd7c9c-62hc8\" (UID: \"4b349024-b3f7-4bc4-9d50-076a0f6f7e8e\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-62hc8"
Sep 11 04:01:32.605538 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.605514    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-62hc8"
Sep 11 04:01:32.895976 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.895949    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-62hc8"]
Sep 11 04:01:32.896493 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:01:32.896470    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b349024_b3f7_4bc4_9d50_076a0f6f7e8e.slice/crio-aa4894e9c5ea00d7a0e957d927bc30a031be532aa4e7459eba10785a7b17993e WatchSource:0}: Error finding container aa4894e9c5ea00d7a0e957d927bc30a031be532aa4e7459eba10785a7b17993e: Status 404 returned error can't find the container with id aa4894e9c5ea00d7a0e957d927bc30a031be532aa4e7459eba10785a7b17993e
Sep 11 04:01:32.984628 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:32.984598    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-62hc8" event={"ID":"4b349024-b3f7-4bc4-9d50-076a0f6f7e8e","Type":"ContainerStarted","Data":"aa4894e9c5ea00d7a0e957d927bc30a031be532aa4e7459eba10785a7b17993e"}
Sep 11 04:01:34.384744 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:34.384711    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-nb4sf"]
Sep 11 04:01:34.393244 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:34.393220    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nb4sf"
Sep 11 04:01:34.396968 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:34.396937    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-cts89\""
Sep 11 04:01:34.402842 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:34.402783    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-nb4sf"]
Sep 11 04:01:34.455417 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:34.455377    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w9ww\" (UniqueName: \"kubernetes.io/projected/7498e24d-fff9-46ce-8b93-03f599963333-kube-api-access-5w9ww\") pod \"limitador-operator-controller-manager-74495c69f8-nb4sf\" (UID: \"7498e24d-fff9-46ce-8b93-03f599963333\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nb4sf"
Sep 11 04:01:34.556762 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:34.556731    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w9ww\" (UniqueName: \"kubernetes.io/projected/7498e24d-fff9-46ce-8b93-03f599963333-kube-api-access-5w9ww\") pod \"limitador-operator-controller-manager-74495c69f8-nb4sf\" (UID: \"7498e24d-fff9-46ce-8b93-03f599963333\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nb4sf"
Sep 11 04:01:34.568252 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:34.568223    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w9ww\" (UniqueName: \"kubernetes.io/projected/7498e24d-fff9-46ce-8b93-03f599963333-kube-api-access-5w9ww\") pod \"limitador-operator-controller-manager-74495c69f8-nb4sf\" (UID: \"7498e24d-fff9-46ce-8b93-03f599963333\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nb4sf"
Sep 11 04:01:34.705900 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:34.705830    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nb4sf"
Sep 11 04:01:35.437436 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:35.437355    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-nb4sf"]
Sep 11 04:01:35.440540 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:01:35.440513    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7498e24d_fff9_46ce_8b93_03f599963333.slice/crio-a3fea44b00da38c3fb25c2d3e6df9738997fd86f442d8c2be4fb6b7b02d6e8b8 WatchSource:0}: Error finding container a3fea44b00da38c3fb25c2d3e6df9738997fd86f442d8c2be4fb6b7b02d6e8b8: Status 404 returned error can't find the container with id a3fea44b00da38c3fb25c2d3e6df9738997fd86f442d8c2be4fb6b7b02d6e8b8
Sep 11 04:01:36.003820 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:36.003775    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-62hc8" event={"ID":"4b349024-b3f7-4bc4-9d50-076a0f6f7e8e","Type":"ContainerStarted","Data":"de1c7c3ac4f74584aba2dc400d028b146fe3cff53c02b62fe98029ce6ae866a5"}
Sep 11 04:01:36.004004 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:36.003849    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-62hc8"
Sep 11 04:01:36.005668 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:36.005633    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nb4sf" event={"ID":"7498e24d-fff9-46ce-8b93-03f599963333","Type":"ContainerStarted","Data":"a3fea44b00da38c3fb25c2d3e6df9738997fd86f442d8c2be4fb6b7b02d6e8b8"}
Sep 11 04:01:36.041213 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:36.041156    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-62hc8" podStartSLOduration=1.734772282 podStartE2EDuration="4.041136133s" totalImagesPullingTime="2.306363851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:01:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:01:36.040536351 +0000 UTC m=+492.838626091" watchObservedRunningTime="2026-09-11 04:01:36.041136133 +0000 UTC m=+492.839225862"
Sep 11 04:01:37.011864 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:37.011761    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nb4sf" event={"ID":"7498e24d-fff9-46ce-8b93-03f599963333","Type":"ContainerStarted","Data":"7ab14a379440ec07fee4d5d28375bceaa6f032eaec5cbc7855519cb8fadf8431"}
Sep 11 04:01:37.012233 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:37.012057    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nb4sf"
Sep 11 04:01:37.032365 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:37.032312    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nb4sf" podStartSLOduration=1.775945672 podStartE2EDuration="3.032297044s" totalImagesPullingTime="1.256351372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:01:37.029617447 +0000 UTC m=+493.827707185" watchObservedRunningTime="2026-09-11 04:01:37.032297044 +0000 UTC m=+493.830386770"
Sep 11 04:01:47.014091 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:47.014058    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-62hc8"
Sep 11 04:01:48.019589 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:48.019561    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nb4sf"
Sep 11 04:01:56.490243 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:56.490206    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-gzz26"]
Sep 11 04:01:56.493521 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:56.493505    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-gzz26"
Sep 11 04:01:56.496841 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:56.496818    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-dzb9t\""
Sep 11 04:01:56.513684 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:56.513660    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-gzz26"]
Sep 11 04:01:56.616175 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:56.616138    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-gzz26"]
Sep 11 04:01:56.616431 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:01:56.616411    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-5m7mr], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-gzz26" podUID="839c3d60-32c4-4653-be7b-31aa7e9e7fb5"
Sep 11 04:01:56.637689 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:56.637654    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m7mr\" (UniqueName: \"kubernetes.io/projected/839c3d60-32c4-4653-be7b-31aa7e9e7fb5-kube-api-access-5m7mr\") pod \"kuadrant-operator-controller-manager-5f685c496f-gzz26\" (UID: \"839c3d60-32c4-4653-be7b-31aa7e9e7fb5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-gzz26"
Sep 11 04:01:56.637820 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:56.637701    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/839c3d60-32c4-4653-be7b-31aa7e9e7fb5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-gzz26\" (UID: \"839c3d60-32c4-4653-be7b-31aa7e9e7fb5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-gzz26"
Sep 11 04:01:56.738757 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:56.738719    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m7mr\" (UniqueName: \"kubernetes.io/projected/839c3d60-32c4-4653-be7b-31aa7e9e7fb5-kube-api-access-5m7mr\") pod \"kuadrant-operator-controller-manager-5f685c496f-gzz26\" (UID: \"839c3d60-32c4-4653-be7b-31aa7e9e7fb5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-gzz26"
Sep 11 04:01:56.738757 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:56.738764    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/839c3d60-32c4-4653-be7b-31aa7e9e7fb5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-gzz26\" (UID: \"839c3d60-32c4-4653-be7b-31aa7e9e7fb5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-gzz26"
Sep 11 04:01:56.739149 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:56.739133    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/839c3d60-32c4-4653-be7b-31aa7e9e7fb5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-gzz26\" (UID: \"839c3d60-32c4-4653-be7b-31aa7e9e7fb5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-gzz26"
Sep 11 04:01:56.756036 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:56.755959    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m7mr\" (UniqueName: \"kubernetes.io/projected/839c3d60-32c4-4653-be7b-31aa7e9e7fb5-kube-api-access-5m7mr\") pod \"kuadrant-operator-controller-manager-5f685c496f-gzz26\" (UID: \"839c3d60-32c4-4653-be7b-31aa7e9e7fb5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-gzz26"
Sep 11 04:01:57.108818 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:57.108784    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-gzz26"
Sep 11 04:01:57.116046 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:57.116019    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-gzz26"
Sep 11 04:01:57.123593 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:57.123568    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-gzz26"]
Sep 11 04:01:57.137247 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:57.137215    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-gzz26"]
Sep 11 04:01:57.142419 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:01:57.142375    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-gzz26\" is forbidden: User \"system:node:ip-10-0-130-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-195.ec2.internal' and this object" podUID="839c3d60-32c4-4653-be7b-31aa7e9e7fb5" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-gzz26"
Sep 11 04:01:57.175365 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:57.175339    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fr64z"]
Sep 11 04:01:57.178722 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:57.178702    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fr64z"
Sep 11 04:01:57.181696 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:01:57.181666    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-gzz26\" is forbidden: User \"system:node:ip-10-0-130-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-195.ec2.internal' and this object" podUID="839c3d60-32c4-4653-be7b-31aa7e9e7fb5" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-gzz26"
Sep 11 04:01:57.196852 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:57.196826    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fr64z"]
Sep 11 04:01:57.213816 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:57.213787    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-nb4sf"]
Sep 11 04:01:57.213991 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:57.213971    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nb4sf" podUID="7498e24d-fff9-46ce-8b93-03f599963333" containerName="manager" containerID="cri-o://7ab14a379440ec07fee4d5d28375bceaa6f032eaec5cbc7855519cb8fadf8431" gracePeriod=2
Sep 11 04:01:57.235781 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:57.235756    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-nb4sf"]
Sep 11 04:01:57.239280 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:01:57.239246    2558 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"7498e24d-fff9-46ce-8b93-03f599963333\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-74495c69f8-nb4sf\": pods \"limitador-operator-controller-manager-74495c69f8-nb4sf\" not found" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nb4sf"
Sep 11 04:01:57.244278 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:57.244257    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5m7mr\" (UniqueName: \"kubernetes.io/projected/839c3d60-32c4-4653-be7b-31aa7e9e7fb5-kube-api-access-5m7mr\") pod \"839c3d60-32c4-4653-be7b-31aa7e9e7fb5\" (UID: \"839c3d60-32c4-4653-be7b-31aa7e9e7fb5\") "
Sep 11 04:01:57.244412 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:57.244338    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/839c3d60-32c4-4653-be7b-31aa7e9e7fb5-extensions-socket-volume\") pod \"839c3d60-32c4-4653-be7b-31aa7e9e7fb5\" (UID: \"839c3d60-32c4-4653-be7b-31aa7e9e7fb5\") "
Sep 11 04:01:57.244637 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:57.244611    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/839c3d60-32c4-4653-be7b-31aa7e9e7fb5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "839c3d60-32c4-4653-be7b-31aa7e9e7fb5" (UID: "839c3d60-32c4-4653-be7b-31aa7e9e7fb5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:01:57.245914 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:01:57.245887    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-gzz26\" is forbidden: User \"system:node:ip-10-0-130-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-195.ec2.internal' and this object" podUID="839c3d60-32c4-4653-be7b-31aa7e9e7fb5" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-gzz26"
Sep 11 04:01:57.247820 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:57.247783    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/839c3d60-32c4-4653-be7b-31aa7e9e7fb5-kube-api-access-5m7mr" (OuterVolumeSpecName: "kube-api-access-5m7mr") pod "839c3d60-32c4-4653-be7b-31aa7e9e7fb5" (UID: "839c3d60-32c4-4653-be7b-31aa7e9e7fb5"). InnerVolumeSpecName "kube-api-access-5m7mr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:01:57.346027 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:57.345984    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cbd4\" (UniqueName: \"kubernetes.io/projected/9457e3a4-11dd-4ad1-ad57-5be112b4d379-kube-api-access-5cbd4\") pod \"kuadrant-operator-controller-manager-76f8f686bf-fr64z\" (UID: \"9457e3a4-11dd-4ad1-ad57-5be112b4d379\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fr64z"
Sep 11 04:01:57.346195 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:57.346177    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9457e3a4-11dd-4ad1-ad57-5be112b4d379-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-fr64z\" (UID: \"9457e3a4-11dd-4ad1-ad57-5be112b4d379\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fr64z"
Sep 11 04:01:57.346249 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:57.346221    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5m7mr\" (UniqueName: \"kubernetes.io/projected/839c3d60-32c4-4653-be7b-31aa7e9e7fb5-kube-api-access-5m7mr\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:01:57.346249 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:57.346233    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/839c3d60-32c4-4653-be7b-31aa7e9e7fb5-extensions-socket-volume\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:01:57.447601 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:57.447572    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9457e3a4-11dd-4ad1-ad57-5be112b4d379-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-fr64z\" (UID: \"9457e3a4-11dd-4ad1-ad57-5be112b4d379\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fr64z"
Sep 11 04:01:57.447722 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:57.447606    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cbd4\" (UniqueName: \"kubernetes.io/projected/9457e3a4-11dd-4ad1-ad57-5be112b4d379-kube-api-access-5cbd4\") pod \"kuadrant-operator-controller-manager-76f8f686bf-fr64z\" (UID: \"9457e3a4-11dd-4ad1-ad57-5be112b4d379\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fr64z"
Sep 11 04:01:57.447914 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:57.447895    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9457e3a4-11dd-4ad1-ad57-5be112b4d379-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-fr64z\" (UID: \"9457e3a4-11dd-4ad1-ad57-5be112b4d379\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fr64z"
Sep 11 04:01:57.452739 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:57.452720    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nb4sf"
Sep 11 04:01:57.455075 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:01:57.455052    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-gzz26\" is forbidden: User \"system:node:ip-10-0-130-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-195.ec2.internal' and this object" podUID="839c3d60-32c4-4653-be7b-31aa7e9e7fb5" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-gzz26"
Sep 11 04:01:57.457016 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:01:57.456996    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-nb4sf\" is forbidden: User \"system:node:ip-10-0-130-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-195.ec2.internal' and this object" podUID="7498e24d-fff9-46ce-8b93-03f599963333" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nb4sf"
Sep 11 04:01:57.458266 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:57.458249    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cbd4\" (UniqueName: \"kubernetes.io/projected/9457e3a4-11dd-4ad1-ad57-5be112b4d379-kube-api-access-5cbd4\") pod \"kuadrant-operator-controller-manager-76f8f686bf-fr64z\" (UID: \"9457e3a4-11dd-4ad1-ad57-5be112b4d379\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fr64z"
Sep 11 04:01:57.491138 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:57.491118    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fr64z"
Sep 11 04:01:57.650170 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:57.650093    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5w9ww\" (UniqueName: \"kubernetes.io/projected/7498e24d-fff9-46ce-8b93-03f599963333-kube-api-access-5w9ww\") pod \"7498e24d-fff9-46ce-8b93-03f599963333\" (UID: \"7498e24d-fff9-46ce-8b93-03f599963333\") "
Sep 11 04:01:57.652134 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:57.652113    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7498e24d-fff9-46ce-8b93-03f599963333-kube-api-access-5w9ww" (OuterVolumeSpecName: "kube-api-access-5w9ww") pod "7498e24d-fff9-46ce-8b93-03f599963333" (UID: "7498e24d-fff9-46ce-8b93-03f599963333"). InnerVolumeSpecName "kube-api-access-5w9ww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:01:57.750597 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:57.750564    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5w9ww\" (UniqueName: \"kubernetes.io/projected/7498e24d-fff9-46ce-8b93-03f599963333-kube-api-access-5w9ww\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:01:57.800280 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:57.800254    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fr64z"]
Sep 11 04:01:57.801261 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:01:57.801229    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9457e3a4_11dd_4ad1_ad57_5be112b4d379.slice/crio-65cb26848eabf98a478ceb942840d6314f2fbd93637b67ec357dec1301cd5c93 WatchSource:0}: Error finding container 65cb26848eabf98a478ceb942840d6314f2fbd93637b67ec357dec1301cd5c93: Status 404 returned error can't find the container with id 65cb26848eabf98a478ceb942840d6314f2fbd93637b67ec357dec1301cd5c93
Sep 11 04:01:57.809909 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:57.809875    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7498e24d-fff9-46ce-8b93-03f599963333" path="/var/lib/kubelet/pods/7498e24d-fff9-46ce-8b93-03f599963333/volumes"
Sep 11 04:01:57.810313 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:57.810296    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="839c3d60-32c4-4653-be7b-31aa7e9e7fb5" path="/var/lib/kubelet/pods/839c3d60-32c4-4653-be7b-31aa7e9e7fb5/volumes"
Sep 11 04:01:58.115130 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:58.115100    2558 generic.go:356] "Generic (PLEG): container finished" podID="7498e24d-fff9-46ce-8b93-03f599963333" containerID="7ab14a379440ec07fee4d5d28375bceaa6f032eaec5cbc7855519cb8fadf8431" exitCode=0
Sep 11 04:01:58.115294 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:58.115144    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nb4sf"
Sep 11 04:01:58.115294 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:58.115200    2558 scope.go:117] "RemoveContainer" containerID="7ab14a379440ec07fee4d5d28375bceaa6f032eaec5cbc7855519cb8fadf8431"
Sep 11 04:01:58.116880 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:58.116858    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-gzz26"
Sep 11 04:01:58.117020 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:58.116892    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fr64z" event={"ID":"9457e3a4-11dd-4ad1-ad57-5be112b4d379","Type":"ContainerStarted","Data":"65cb26848eabf98a478ceb942840d6314f2fbd93637b67ec357dec1301cd5c93"}
Sep 11 04:01:58.123726 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:58.123707    2558 scope.go:117] "RemoveContainer" containerID="7ab14a379440ec07fee4d5d28375bceaa6f032eaec5cbc7855519cb8fadf8431"
Sep 11 04:01:58.124018 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:01:58.124000    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ab14a379440ec07fee4d5d28375bceaa6f032eaec5cbc7855519cb8fadf8431\": container with ID starting with 7ab14a379440ec07fee4d5d28375bceaa6f032eaec5cbc7855519cb8fadf8431 not found: ID does not exist" containerID="7ab14a379440ec07fee4d5d28375bceaa6f032eaec5cbc7855519cb8fadf8431"
Sep 11 04:01:58.124066 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:01:58.124027    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ab14a379440ec07fee4d5d28375bceaa6f032eaec5cbc7855519cb8fadf8431"} err="failed to get container status \"7ab14a379440ec07fee4d5d28375bceaa6f032eaec5cbc7855519cb8fadf8431\": rpc error: code = NotFound desc = could not find container \"7ab14a379440ec07fee4d5d28375bceaa6f032eaec5cbc7855519cb8fadf8431\": container with ID starting with 7ab14a379440ec07fee4d5d28375bceaa6f032eaec5cbc7855519cb8fadf8431 not found: ID does not exist"
Sep 11 04:02:02.141871 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:02.141831    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fr64z" event={"ID":"9457e3a4-11dd-4ad1-ad57-5be112b4d379","Type":"ContainerStarted","Data":"4d524103a3bb9444d04dcc2688216c93a86d539a4ef0d7a152d053ac174e9290"}
Sep 11 04:02:02.142222 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:02.141926    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fr64z"
Sep 11 04:02:02.197405 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:02.197332    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fr64z" podStartSLOduration=1.287638834 podStartE2EDuration="5.197316232s" totalImagesPullingTime="3.909677398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:01:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:02:02.19632061 +0000 UTC m=+518.994410339" watchObservedRunningTime="2026-09-11 04:02:02.197316232 +0000 UTC m=+518.995405959"
Sep 11 04:02:10.951152 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:10.951120    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fr64z"]
Sep 11 04:02:10.951648 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:10.951413    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fr64z" podUID="9457e3a4-11dd-4ad1-ad57-5be112b4d379" containerName="manager" containerID="cri-o://4d524103a3bb9444d04dcc2688216c93a86d539a4ef0d7a152d053ac174e9290" gracePeriod=10
Sep 11 04:02:10.953064 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:10.953044    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fr64z"
Sep 11 04:02:11.188138 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:11.188109    2558 generic.go:356] "Generic (PLEG): container finished" podID="9457e3a4-11dd-4ad1-ad57-5be112b4d379" containerID="4d524103a3bb9444d04dcc2688216c93a86d539a4ef0d7a152d053ac174e9290" exitCode=0
Sep 11 04:02:11.188285 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:11.188194    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fr64z" event={"ID":"9457e3a4-11dd-4ad1-ad57-5be112b4d379","Type":"ContainerDied","Data":"4d524103a3bb9444d04dcc2688216c93a86d539a4ef0d7a152d053ac174e9290"}
Sep 11 04:02:11.188285 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:11.188255    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fr64z" event={"ID":"9457e3a4-11dd-4ad1-ad57-5be112b4d379","Type":"ContainerDied","Data":"65cb26848eabf98a478ceb942840d6314f2fbd93637b67ec357dec1301cd5c93"}
Sep 11 04:02:11.188285 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:11.188273    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="65cb26848eabf98a478ceb942840d6314f2fbd93637b67ec357dec1301cd5c93"
Sep 11 04:02:11.199707 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:11.199689    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fr64z"
Sep 11 04:02:11.251742 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:11.251690    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cbd4\" (UniqueName: \"kubernetes.io/projected/9457e3a4-11dd-4ad1-ad57-5be112b4d379-kube-api-access-5cbd4\") pod \"9457e3a4-11dd-4ad1-ad57-5be112b4d379\" (UID: \"9457e3a4-11dd-4ad1-ad57-5be112b4d379\") "
Sep 11 04:02:11.251864 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:11.251814    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9457e3a4-11dd-4ad1-ad57-5be112b4d379-extensions-socket-volume\") pod \"9457e3a4-11dd-4ad1-ad57-5be112b4d379\" (UID: \"9457e3a4-11dd-4ad1-ad57-5be112b4d379\") "
Sep 11 04:02:11.252301 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:11.252273    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9457e3a4-11dd-4ad1-ad57-5be112b4d379-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9457e3a4-11dd-4ad1-ad57-5be112b4d379" (UID: "9457e3a4-11dd-4ad1-ad57-5be112b4d379"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:02:11.254027 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:11.253998    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9457e3a4-11dd-4ad1-ad57-5be112b4d379-kube-api-access-5cbd4" (OuterVolumeSpecName: "kube-api-access-5cbd4") pod "9457e3a4-11dd-4ad1-ad57-5be112b4d379" (UID: "9457e3a4-11dd-4ad1-ad57-5be112b4d379"). InnerVolumeSpecName "kube-api-access-5cbd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:02:11.353042 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:11.352997    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cbd4\" (UniqueName: \"kubernetes.io/projected/9457e3a4-11dd-4ad1-ad57-5be112b4d379-kube-api-access-5cbd4\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:02:11.353042 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:11.353036    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9457e3a4-11dd-4ad1-ad57-5be112b4d379-extensions-socket-volume\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:02:12.192754 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:12.192679    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fr64z"
Sep 11 04:02:12.223301 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:12.223261    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fr64z"]
Sep 11 04:02:12.227888 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:12.227862    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fr64z"]
Sep 11 04:02:13.810538 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:13.810504    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9457e3a4-11dd-4ad1-ad57-5be112b4d379" path="/var/lib/kubelet/pods/9457e3a4-11dd-4ad1-ad57-5be112b4d379/volumes"
Sep 11 04:02:27.415486 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.415451    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"]
Sep 11 04:02:27.415886 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.415746    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7498e24d-fff9-46ce-8b93-03f599963333" containerName="manager"
Sep 11 04:02:27.415886 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.415757    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7498e24d-fff9-46ce-8b93-03f599963333" containerName="manager"
Sep 11 04:02:27.415886 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.415776    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9457e3a4-11dd-4ad1-ad57-5be112b4d379" containerName="manager"
Sep 11 04:02:27.415886 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.415782    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9457e3a4-11dd-4ad1-ad57-5be112b4d379" containerName="manager"
Sep 11 04:02:27.415886 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.415843    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9457e3a4-11dd-4ad1-ad57-5be112b4d379" containerName="manager"
Sep 11 04:02:27.415886 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.415855    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7498e24d-fff9-46ce-8b93-03f599963333" containerName="manager"
Sep 11 04:02:27.419867 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.419847    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"
Sep 11 04:02:27.422675 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.422647    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-9mhnt\""
Sep 11 04:02:27.434932 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.434901    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"]
Sep 11 04:02:27.478880 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.478843    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whpjf\" (UniqueName: \"kubernetes.io/projected/f1d3b637-e83f-46fa-b4d3-de3eddd404b5-kube-api-access-whpjf\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t9t74\" (UID: \"f1d3b637-e83f-46fa-b4d3-de3eddd404b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"
Sep 11 04:02:27.479045 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.478888    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1d3b637-e83f-46fa-b4d3-de3eddd404b5-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t9t74\" (UID: \"f1d3b637-e83f-46fa-b4d3-de3eddd404b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"
Sep 11 04:02:27.479045 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.478948    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1d3b637-e83f-46fa-b4d3-de3eddd404b5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t9t74\" (UID: \"f1d3b637-e83f-46fa-b4d3-de3eddd404b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"
Sep 11 04:02:27.479045 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.478985    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1d3b637-e83f-46fa-b4d3-de3eddd404b5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t9t74\" (UID: \"f1d3b637-e83f-46fa-b4d3-de3eddd404b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"
Sep 11 04:02:27.479045 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.479018    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1d3b637-e83f-46fa-b4d3-de3eddd404b5-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t9t74\" (UID: \"f1d3b637-e83f-46fa-b4d3-de3eddd404b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"
Sep 11 04:02:27.479195 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.479046    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1d3b637-e83f-46fa-b4d3-de3eddd404b5-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t9t74\" (UID: \"f1d3b637-e83f-46fa-b4d3-de3eddd404b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"
Sep 11 04:02:27.479195 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.479066    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1d3b637-e83f-46fa-b4d3-de3eddd404b5-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t9t74\" (UID: \"f1d3b637-e83f-46fa-b4d3-de3eddd404b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"
Sep 11 04:02:27.479195 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.479085    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1d3b637-e83f-46fa-b4d3-de3eddd404b5-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t9t74\" (UID: \"f1d3b637-e83f-46fa-b4d3-de3eddd404b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"
Sep 11 04:02:27.479195 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.479129    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1d3b637-e83f-46fa-b4d3-de3eddd404b5-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t9t74\" (UID: \"f1d3b637-e83f-46fa-b4d3-de3eddd404b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"
Sep 11 04:02:27.580417 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.580355    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1d3b637-e83f-46fa-b4d3-de3eddd404b5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t9t74\" (UID: \"f1d3b637-e83f-46fa-b4d3-de3eddd404b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"
Sep 11 04:02:27.580417 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.580422    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1d3b637-e83f-46fa-b4d3-de3eddd404b5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t9t74\" (UID: \"f1d3b637-e83f-46fa-b4d3-de3eddd404b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"
Sep 11 04:02:27.580666 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.580443    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1d3b637-e83f-46fa-b4d3-de3eddd404b5-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t9t74\" (UID: \"f1d3b637-e83f-46fa-b4d3-de3eddd404b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"
Sep 11 04:02:27.580666 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.580462    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1d3b637-e83f-46fa-b4d3-de3eddd404b5-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t9t74\" (UID: \"f1d3b637-e83f-46fa-b4d3-de3eddd404b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"
Sep 11 04:02:27.580666 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.580478    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1d3b637-e83f-46fa-b4d3-de3eddd404b5-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t9t74\" (UID: \"f1d3b637-e83f-46fa-b4d3-de3eddd404b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"
Sep 11 04:02:27.580666 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.580496    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1d3b637-e83f-46fa-b4d3-de3eddd404b5-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t9t74\" (UID: \"f1d3b637-e83f-46fa-b4d3-de3eddd404b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"
Sep 11 04:02:27.580666 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.580645    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1d3b637-e83f-46fa-b4d3-de3eddd404b5-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t9t74\" (UID: \"f1d3b637-e83f-46fa-b4d3-de3eddd404b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"
Sep 11 04:02:27.580927 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.580910    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1d3b637-e83f-46fa-b4d3-de3eddd404b5-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t9t74\" (UID: \"f1d3b637-e83f-46fa-b4d3-de3eddd404b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"
Sep 11 04:02:27.580989 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.580918    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whpjf\" (UniqueName: \"kubernetes.io/projected/f1d3b637-e83f-46fa-b4d3-de3eddd404b5-kube-api-access-whpjf\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t9t74\" (UID: \"f1d3b637-e83f-46fa-b4d3-de3eddd404b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"
Sep 11 04:02:27.580989 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.580971    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1d3b637-e83f-46fa-b4d3-de3eddd404b5-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t9t74\" (UID: \"f1d3b637-e83f-46fa-b4d3-de3eddd404b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"
Sep 11 04:02:27.580989 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.580980    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1d3b637-e83f-46fa-b4d3-de3eddd404b5-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t9t74\" (UID: \"f1d3b637-e83f-46fa-b4d3-de3eddd404b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"
Sep 11 04:02:27.581148 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.581103    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1d3b637-e83f-46fa-b4d3-de3eddd404b5-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t9t74\" (UID: \"f1d3b637-e83f-46fa-b4d3-de3eddd404b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"
Sep 11 04:02:27.581258 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.581240    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1d3b637-e83f-46fa-b4d3-de3eddd404b5-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t9t74\" (UID: \"f1d3b637-e83f-46fa-b4d3-de3eddd404b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"
Sep 11 04:02:27.581530 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.581505    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1d3b637-e83f-46fa-b4d3-de3eddd404b5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t9t74\" (UID: \"f1d3b637-e83f-46fa-b4d3-de3eddd404b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"
Sep 11 04:02:27.582806 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.582780    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1d3b637-e83f-46fa-b4d3-de3eddd404b5-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t9t74\" (UID: \"f1d3b637-e83f-46fa-b4d3-de3eddd404b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"
Sep 11 04:02:27.583069 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.583053    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1d3b637-e83f-46fa-b4d3-de3eddd404b5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t9t74\" (UID: \"f1d3b637-e83f-46fa-b4d3-de3eddd404b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"
Sep 11 04:02:27.588949 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.588925    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1d3b637-e83f-46fa-b4d3-de3eddd404b5-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t9t74\" (UID: \"f1d3b637-e83f-46fa-b4d3-de3eddd404b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"
Sep 11 04:02:27.589146 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.589122    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whpjf\" (UniqueName: \"kubernetes.io/projected/f1d3b637-e83f-46fa-b4d3-de3eddd404b5-kube-api-access-whpjf\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t9t74\" (UID: \"f1d3b637-e83f-46fa-b4d3-de3eddd404b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"
Sep 11 04:02:27.730617 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:27.730522    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"
Sep 11 04:02:28.024707 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:28.024681    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"]
Sep 11 04:02:28.027216 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:02:28.027184    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1d3b637_e83f_46fa_b4d3_de3eddd404b5.slice/crio-23b2527711574c8e7be14cdba0bac8826bd8b7866b3dbf2e66acd433e8b4f3e5 WatchSource:0}: Error finding container 23b2527711574c8e7be14cdba0bac8826bd8b7866b3dbf2e66acd433e8b4f3e5: Status 404 returned error can't find the container with id 23b2527711574c8e7be14cdba0bac8826bd8b7866b3dbf2e66acd433e8b4f3e5
Sep 11 04:02:28.029413 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:28.029358    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:02:28.029497 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:28.029458    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:02:28.029542 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:28.029502    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:02:28.271457 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:28.271421    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74" event={"ID":"f1d3b637-e83f-46fa-b4d3-de3eddd404b5","Type":"ContainerStarted","Data":"17d2918812713385524ce316e8e0b9ce45cc7be82d1d28601bf0eb9605eea822"}
Sep 11 04:02:28.271619 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:28.271480    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74" event={"ID":"f1d3b637-e83f-46fa-b4d3-de3eddd404b5","Type":"ContainerStarted","Data":"23b2527711574c8e7be14cdba0bac8826bd8b7866b3dbf2e66acd433e8b4f3e5"}
Sep 11 04:02:28.294532 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:28.294425    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74" podStartSLOduration=1.294406036 podStartE2EDuration="1.294406036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:02:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:02:28.292772286 +0000 UTC m=+545.090862013" watchObservedRunningTime="2026-09-11 04:02:28.294406036 +0000 UTC m=+545.092495763"
Sep 11 04:02:28.731611 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:28.731582    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"
Sep 11 04:02:29.735938 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:29.735904    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"
Sep 11 04:02:30.282029 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:30.282001    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"
Sep 11 04:02:30.283120 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:30.283101    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"
Sep 11 04:02:41.165813 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:41.165785    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-jwc4b"]
Sep 11 04:02:41.168538 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:41.168520    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-jwc4b"
Sep 11 04:02:41.171088 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:41.171065    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 11 04:02:41.171169 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:41.171095    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-cpmw2\""
Sep 11 04:02:41.177311 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:41.177284    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-jwc4b"]
Sep 11 04:02:41.261923 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:41.261890    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-jwc4b"]
Sep 11 04:02:41.297629 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:41.297598    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/846ba073-2eee-46d0-aed8-d727fdf8ebea-config-file\") pod \"limitador-limitador-8588749977-jwc4b\" (UID: \"846ba073-2eee-46d0-aed8-d727fdf8ebea\") " pod="kuadrant-system/limitador-limitador-8588749977-jwc4b"
Sep 11 04:02:41.297782 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:41.297669    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84glr\" (UniqueName: \"kubernetes.io/projected/846ba073-2eee-46d0-aed8-d727fdf8ebea-kube-api-access-84glr\") pod \"limitador-limitador-8588749977-jwc4b\" (UID: \"846ba073-2eee-46d0-aed8-d727fdf8ebea\") " pod="kuadrant-system/limitador-limitador-8588749977-jwc4b"
Sep 11 04:02:41.399068 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:41.399034    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/846ba073-2eee-46d0-aed8-d727fdf8ebea-config-file\") pod \"limitador-limitador-8588749977-jwc4b\" (UID: \"846ba073-2eee-46d0-aed8-d727fdf8ebea\") " pod="kuadrant-system/limitador-limitador-8588749977-jwc4b"
Sep 11 04:02:41.399250 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:41.399104    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84glr\" (UniqueName: \"kubernetes.io/projected/846ba073-2eee-46d0-aed8-d727fdf8ebea-kube-api-access-84glr\") pod \"limitador-limitador-8588749977-jwc4b\" (UID: \"846ba073-2eee-46d0-aed8-d727fdf8ebea\") " pod="kuadrant-system/limitador-limitador-8588749977-jwc4b"
Sep 11 04:02:41.399699 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:41.399677    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/846ba073-2eee-46d0-aed8-d727fdf8ebea-config-file\") pod \"limitador-limitador-8588749977-jwc4b\" (UID: \"846ba073-2eee-46d0-aed8-d727fdf8ebea\") " pod="kuadrant-system/limitador-limitador-8588749977-jwc4b"
Sep 11 04:02:41.408251 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:41.408219    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84glr\" (UniqueName: \"kubernetes.io/projected/846ba073-2eee-46d0-aed8-d727fdf8ebea-kube-api-access-84glr\") pod \"limitador-limitador-8588749977-jwc4b\" (UID: \"846ba073-2eee-46d0-aed8-d727fdf8ebea\") " pod="kuadrant-system/limitador-limitador-8588749977-jwc4b"
Sep 11 04:02:41.479584 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:41.479489    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-jwc4b"
Sep 11 04:02:41.649367 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:41.649333    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:02:41.651727 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:41.651711    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"
Sep 11 04:02:41.659866 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:41.659839    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:02:41.673223 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:41.673200    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:02:41.748360 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:41.748341    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-jwc4b"]
Sep 11 04:02:41.750337 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:02:41.750310    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod846ba073_2eee_46d0_aed8_d727fdf8ebea.slice/crio-c9c8ef48c0a011a0208adfea215af725409fe5b58e0db1da9004e71fb4da93d8 WatchSource:0}: Error finding container c9c8ef48c0a011a0208adfea215af725409fe5b58e0db1da9004e71fb4da93d8: Status 404 returned error can't find the container with id c9c8ef48c0a011a0208adfea215af725409fe5b58e0db1da9004e71fb4da93d8
Sep 11 04:02:41.802378 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:41.802355    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bss6n\" (UniqueName: \"kubernetes.io/projected/9588c225-99f9-4f3c-9264-75ba6c21d6ac-kube-api-access-bss6n\") pod \"limitador-limitador-84994f7ffc-fm2rt\" (UID: \"9588c225-99f9-4f3c-9264-75ba6c21d6ac\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"
Sep 11 04:02:41.802485 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:41.802463    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9588c225-99f9-4f3c-9264-75ba6c21d6ac-config-file\") pod \"limitador-limitador-84994f7ffc-fm2rt\" (UID: \"9588c225-99f9-4f3c-9264-75ba6c21d6ac\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"
Sep 11 04:02:41.902851 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:41.902823    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9588c225-99f9-4f3c-9264-75ba6c21d6ac-config-file\") pod \"limitador-limitador-84994f7ffc-fm2rt\" (UID: \"9588c225-99f9-4f3c-9264-75ba6c21d6ac\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"
Sep 11 04:02:41.903045 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:41.902877    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bss6n\" (UniqueName: \"kubernetes.io/projected/9588c225-99f9-4f3c-9264-75ba6c21d6ac-kube-api-access-bss6n\") pod \"limitador-limitador-84994f7ffc-fm2rt\" (UID: \"9588c225-99f9-4f3c-9264-75ba6c21d6ac\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"
Sep 11 04:02:41.903616 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:41.903592    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9588c225-99f9-4f3c-9264-75ba6c21d6ac-config-file\") pod \"limitador-limitador-84994f7ffc-fm2rt\" (UID: \"9588c225-99f9-4f3c-9264-75ba6c21d6ac\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"
Sep 11 04:02:41.911311 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:41.911283    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bss6n\" (UniqueName: \"kubernetes.io/projected/9588c225-99f9-4f3c-9264-75ba6c21d6ac-kube-api-access-bss6n\") pod \"limitador-limitador-84994f7ffc-fm2rt\" (UID: \"9588c225-99f9-4f3c-9264-75ba6c21d6ac\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"
Sep 11 04:02:41.963101 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:41.963072    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"
Sep 11 04:02:42.237911 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:42.237884    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:02:42.240158 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:02:42.240132    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9588c225_99f9_4f3c_9264_75ba6c21d6ac.slice/crio-5232eb09208da6a3d4f636ce5a1af2d4d36c2d08afd8216f3050a72d850b2c5b WatchSource:0}: Error finding container 5232eb09208da6a3d4f636ce5a1af2d4d36c2d08afd8216f3050a72d850b2c5b: Status 404 returned error can't find the container with id 5232eb09208da6a3d4f636ce5a1af2d4d36c2d08afd8216f3050a72d850b2c5b
Sep 11 04:02:42.345175 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:42.345138    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-jwc4b" event={"ID":"846ba073-2eee-46d0-aed8-d727fdf8ebea","Type":"ContainerStarted","Data":"c9c8ef48c0a011a0208adfea215af725409fe5b58e0db1da9004e71fb4da93d8"}
Sep 11 04:02:42.346630 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:42.346597    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-fm2rt" event={"ID":"9588c225-99f9-4f3c-9264-75ba6c21d6ac","Type":"ContainerStarted","Data":"5232eb09208da6a3d4f636ce5a1af2d4d36c2d08afd8216f3050a72d850b2c5b"}
Sep 11 04:02:43.352838 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:43.352806    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-fm2rt" event={"ID":"9588c225-99f9-4f3c-9264-75ba6c21d6ac","Type":"ContainerStarted","Data":"80e1d396b11c5cf68e80094151025a34f35c2d55f155d21254367d0085faa471"}
Sep 11 04:02:43.353277 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:43.352959    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"
Sep 11 04:02:43.354305 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:43.354281    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-jwc4b" event={"ID":"846ba073-2eee-46d0-aed8-d727fdf8ebea","Type":"ContainerStarted","Data":"ee34125534235708b1c158992720cb5060255ad9d7f079ef0ab773aae7c0af49"}
Sep 11 04:02:43.354445 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:43.354421    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-jwc4b"
Sep 11 04:02:43.373631 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:43.373589    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-fm2rt" podStartSLOduration=1.84083946 podStartE2EDuration="2.373574894s" totalImagesPullingTime="532.735434ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:02:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:02:43.371512672 +0000 UTC m=+560.169602398" watchObservedRunningTime="2026-09-11 04:02:43.373574894 +0000 UTC m=+560.171664621"
Sep 11 04:02:43.394004 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:43.393966    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-jwc4b" podStartSLOduration=1.532901753 podStartE2EDuration="2.393952171s" totalImagesPullingTime="861.050418ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:02:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:02:43.392017949 +0000 UTC m=+560.190107675" watchObservedRunningTime="2026-09-11 04:02:43.393952171 +0000 UTC m=+560.192041931"
Sep 11 04:02:54.359972 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:54.359941    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"
Sep 11 04:02:54.360456 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:54.360010    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-jwc4b"
Sep 11 04:02:54.428604 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:54.428563    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-jwc4b"]
Sep 11 04:02:54.428798 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:54.428745    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-jwc4b" podUID="846ba073-2eee-46d0-aed8-d727fdf8ebea" containerName="limitador" containerID="cri-o://ee34125534235708b1c158992720cb5060255ad9d7f079ef0ab773aae7c0af49" gracePeriod=30
Sep 11 04:02:54.975421 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:54.975375    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-jwc4b"
Sep 11 04:02:55.108030 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:55.107994    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84glr\" (UniqueName: \"kubernetes.io/projected/846ba073-2eee-46d0-aed8-d727fdf8ebea-kube-api-access-84glr\") pod \"846ba073-2eee-46d0-aed8-d727fdf8ebea\" (UID: \"846ba073-2eee-46d0-aed8-d727fdf8ebea\") "
Sep 11 04:02:55.108221 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:55.108056    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/846ba073-2eee-46d0-aed8-d727fdf8ebea-config-file\") pod \"846ba073-2eee-46d0-aed8-d727fdf8ebea\" (UID: \"846ba073-2eee-46d0-aed8-d727fdf8ebea\") "
Sep 11 04:02:55.108461 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:55.108435    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/846ba073-2eee-46d0-aed8-d727fdf8ebea-config-file" (OuterVolumeSpecName: "config-file") pod "846ba073-2eee-46d0-aed8-d727fdf8ebea" (UID: "846ba073-2eee-46d0-aed8-d727fdf8ebea"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:02:55.110056 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:55.110035    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/846ba073-2eee-46d0-aed8-d727fdf8ebea-kube-api-access-84glr" (OuterVolumeSpecName: "kube-api-access-84glr") pod "846ba073-2eee-46d0-aed8-d727fdf8ebea" (UID: "846ba073-2eee-46d0-aed8-d727fdf8ebea"). InnerVolumeSpecName "kube-api-access-84glr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:02:55.209363 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:55.209315    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84glr\" (UniqueName: \"kubernetes.io/projected/846ba073-2eee-46d0-aed8-d727fdf8ebea-kube-api-access-84glr\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:02:55.209363 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:55.209357    2558 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/846ba073-2eee-46d0-aed8-d727fdf8ebea-config-file\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:02:55.414434 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:55.414338    2558 generic.go:356] "Generic (PLEG): container finished" podID="846ba073-2eee-46d0-aed8-d727fdf8ebea" containerID="ee34125534235708b1c158992720cb5060255ad9d7f079ef0ab773aae7c0af49" exitCode=0
Sep 11 04:02:55.414434 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:55.414401    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-jwc4b"
Sep 11 04:02:55.414434 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:55.414423    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-jwc4b" event={"ID":"846ba073-2eee-46d0-aed8-d727fdf8ebea","Type":"ContainerDied","Data":"ee34125534235708b1c158992720cb5060255ad9d7f079ef0ab773aae7c0af49"}
Sep 11 04:02:55.414888 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:55.414479    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-jwc4b" event={"ID":"846ba073-2eee-46d0-aed8-d727fdf8ebea","Type":"ContainerDied","Data":"c9c8ef48c0a011a0208adfea215af725409fe5b58e0db1da9004e71fb4da93d8"}
Sep 11 04:02:55.414888 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:55.414505    2558 scope.go:117] "RemoveContainer" containerID="ee34125534235708b1c158992720cb5060255ad9d7f079ef0ab773aae7c0af49"
Sep 11 04:02:55.423901 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:55.423883    2558 scope.go:117] "RemoveContainer" containerID="ee34125534235708b1c158992720cb5060255ad9d7f079ef0ab773aae7c0af49"
Sep 11 04:02:55.424202 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:02:55.424184    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee34125534235708b1c158992720cb5060255ad9d7f079ef0ab773aae7c0af49\": container with ID starting with ee34125534235708b1c158992720cb5060255ad9d7f079ef0ab773aae7c0af49 not found: ID does not exist" containerID="ee34125534235708b1c158992720cb5060255ad9d7f079ef0ab773aae7c0af49"
Sep 11 04:02:55.424250 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:55.424211    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee34125534235708b1c158992720cb5060255ad9d7f079ef0ab773aae7c0af49"} err="failed to get container status \"ee34125534235708b1c158992720cb5060255ad9d7f079ef0ab773aae7c0af49\": rpc error: code = NotFound desc = could not find container \"ee34125534235708b1c158992720cb5060255ad9d7f079ef0ab773aae7c0af49\": container with ID starting with ee34125534235708b1c158992720cb5060255ad9d7f079ef0ab773aae7c0af49 not found: ID does not exist"
Sep 11 04:02:55.436929 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:55.436903    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-jwc4b"]
Sep 11 04:02:55.445477 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:55.443316    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-jwc4b"]
Sep 11 04:02:55.809612 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:55.809535    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="846ba073-2eee-46d0-aed8-d727fdf8ebea" path="/var/lib/kubelet/pods/846ba073-2eee-46d0-aed8-d727fdf8ebea/volumes"
Sep 11 04:02:56.286927 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:56.286897    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-smtdw"]
Sep 11 04:02:56.287229 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:56.287216    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="846ba073-2eee-46d0-aed8-d727fdf8ebea" containerName="limitador"
Sep 11 04:02:56.287229 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:56.287229    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="846ba073-2eee-46d0-aed8-d727fdf8ebea" containerName="limitador"
Sep 11 04:02:56.287305 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:56.287286    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="846ba073-2eee-46d0-aed8-d727fdf8ebea" containerName="limitador"
Sep 11 04:02:56.291403 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:56.291374    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-smtdw"
Sep 11 04:02:56.294335 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:56.294313    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 11 04:02:56.294440 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:56.294313    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-whc5n\""
Sep 11 04:02:56.294630 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:56.294613    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 04:02:56.295407 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:56.295363    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 04:02:56.308108 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:56.308086    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-smtdw"]
Sep 11 04:02:56.420247 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:56.420206    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f96d36d2-5060-40db-9450-e2c6e9d66d68-data\") pod \"postgres-69fb4594cf-smtdw\" (UID: \"f96d36d2-5060-40db-9450-e2c6e9d66d68\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-smtdw"
Sep 11 04:02:56.420713 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:56.420263    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjj5h\" (UniqueName: \"kubernetes.io/projected/f96d36d2-5060-40db-9450-e2c6e9d66d68-kube-api-access-rjj5h\") pod \"postgres-69fb4594cf-smtdw\" (UID: \"f96d36d2-5060-40db-9450-e2c6e9d66d68\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-smtdw"
Sep 11 04:02:56.521798 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:56.521755    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f96d36d2-5060-40db-9450-e2c6e9d66d68-data\") pod \"postgres-69fb4594cf-smtdw\" (UID: \"f96d36d2-5060-40db-9450-e2c6e9d66d68\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-smtdw"
Sep 11 04:02:56.521942 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:56.521808    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjj5h\" (UniqueName: \"kubernetes.io/projected/f96d36d2-5060-40db-9450-e2c6e9d66d68-kube-api-access-rjj5h\") pod \"postgres-69fb4594cf-smtdw\" (UID: \"f96d36d2-5060-40db-9450-e2c6e9d66d68\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-smtdw"
Sep 11 04:02:56.522159 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:56.522139    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f96d36d2-5060-40db-9450-e2c6e9d66d68-data\") pod \"postgres-69fb4594cf-smtdw\" (UID: \"f96d36d2-5060-40db-9450-e2c6e9d66d68\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-smtdw"
Sep 11 04:02:56.530623 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:56.530593    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjj5h\" (UniqueName: \"kubernetes.io/projected/f96d36d2-5060-40db-9450-e2c6e9d66d68-kube-api-access-rjj5h\") pod \"postgres-69fb4594cf-smtdw\" (UID: \"f96d36d2-5060-40db-9450-e2c6e9d66d68\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-smtdw"
Sep 11 04:02:56.601041 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:56.600992    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-smtdw"
Sep 11 04:02:56.873961 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:56.872908    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-smtdw"]
Sep 11 04:02:56.875818 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:02:56.875781    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf96d36d2_5060_40db_9450_e2c6e9d66d68.slice/crio-047483333b1df7b95ee4b2c356ac63d02603463ec9037fb92a5841b5211dfe2a WatchSource:0}: Error finding container 047483333b1df7b95ee4b2c356ac63d02603463ec9037fb92a5841b5211dfe2a: Status 404 returned error can't find the container with id 047483333b1df7b95ee4b2c356ac63d02603463ec9037fb92a5841b5211dfe2a
Sep 11 04:02:57.427431 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:02:57.427375    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-smtdw" event={"ID":"f96d36d2-5060-40db-9450-e2c6e9d66d68","Type":"ContainerStarted","Data":"047483333b1df7b95ee4b2c356ac63d02603463ec9037fb92a5841b5211dfe2a"}
Sep 11 04:03:02.459070 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:02.459033    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-smtdw" event={"ID":"f96d36d2-5060-40db-9450-e2c6e9d66d68","Type":"ContainerStarted","Data":"05e4e63865f5d81967b5c9d86e17e8cb01f0159e0dddd203e9693da26e789ccc"}
Sep 11 04:03:02.459473 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:02.459100    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-smtdw"
Sep 11 04:03:02.476474 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:02.476424    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-smtdw" podStartSLOduration=1.6990190040000002 podStartE2EDuration="6.476410483s" totalImagesPullingTime="4.777391479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:03:02.474443325 +0000 UTC m=+579.272533044" watchObservedRunningTime="2026-09-11 04:03:02.476410483 +0000 UTC m=+579.274500210"
Sep 11 04:03:08.493526 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:08.493486    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-smtdw"
Sep 11 04:03:16.199850 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:16.199816    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-645ff58b69-sb66g"]
Sep 11 04:03:16.226642 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:16.226604    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-645ff58b69-sb66g"]
Sep 11 04:03:16.226791 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:16.226735    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-645ff58b69-sb66g"
Sep 11 04:03:16.230558 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:16.230529    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qwhqf\""
Sep 11 04:03:16.230712 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:16.230581    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 04:03:16.230712 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:16.230585    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 04:03:16.230712 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:16.230626    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 04:03:16.281426 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:16.281402    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcpcf\" (UniqueName: \"kubernetes.io/projected/e002994b-a1b3-43cb-82d5-709df14bd3b1-kube-api-access-dcpcf\") pod \"maas-controller-645ff58b69-sb66g\" (UID: \"e002994b-a1b3-43cb-82d5-709df14bd3b1\") " pod="opendatahub/maas-controller-645ff58b69-sb66g"
Sep 11 04:03:16.281551 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:16.281462    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e002994b-a1b3-43cb-82d5-709df14bd3b1-metrics-certs\") pod \"maas-controller-645ff58b69-sb66g\" (UID: \"e002994b-a1b3-43cb-82d5-709df14bd3b1\") " pod="opendatahub/maas-controller-645ff58b69-sb66g"
Sep 11 04:03:16.281551 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:16.281545    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e002994b-a1b3-43cb-82d5-709df14bd3b1-webhook-cert\") pod \"maas-controller-645ff58b69-sb66g\" (UID: \"e002994b-a1b3-43cb-82d5-709df14bd3b1\") " pod="opendatahub/maas-controller-645ff58b69-sb66g"
Sep 11 04:03:16.382437 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:16.382379    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e002994b-a1b3-43cb-82d5-709df14bd3b1-webhook-cert\") pod \"maas-controller-645ff58b69-sb66g\" (UID: \"e002994b-a1b3-43cb-82d5-709df14bd3b1\") " pod="opendatahub/maas-controller-645ff58b69-sb66g"
Sep 11 04:03:16.382585 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:16.382500    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcpcf\" (UniqueName: \"kubernetes.io/projected/e002994b-a1b3-43cb-82d5-709df14bd3b1-kube-api-access-dcpcf\") pod \"maas-controller-645ff58b69-sb66g\" (UID: \"e002994b-a1b3-43cb-82d5-709df14bd3b1\") " pod="opendatahub/maas-controller-645ff58b69-sb66g"
Sep 11 04:03:16.382585 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:16.382533    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e002994b-a1b3-43cb-82d5-709df14bd3b1-metrics-certs\") pod \"maas-controller-645ff58b69-sb66g\" (UID: \"e002994b-a1b3-43cb-82d5-709df14bd3b1\") " pod="opendatahub/maas-controller-645ff58b69-sb66g"
Sep 11 04:03:16.384997 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:16.384968    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e002994b-a1b3-43cb-82d5-709df14bd3b1-webhook-cert\") pod \"maas-controller-645ff58b69-sb66g\" (UID: \"e002994b-a1b3-43cb-82d5-709df14bd3b1\") " pod="opendatahub/maas-controller-645ff58b69-sb66g"
Sep 11 04:03:16.385133 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:16.385109    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e002994b-a1b3-43cb-82d5-709df14bd3b1-metrics-certs\") pod \"maas-controller-645ff58b69-sb66g\" (UID: \"e002994b-a1b3-43cb-82d5-709df14bd3b1\") " pod="opendatahub/maas-controller-645ff58b69-sb66g"
Sep 11 04:03:16.390312 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:16.390281    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcpcf\" (UniqueName: \"kubernetes.io/projected/e002994b-a1b3-43cb-82d5-709df14bd3b1-kube-api-access-dcpcf\") pod \"maas-controller-645ff58b69-sb66g\" (UID: \"e002994b-a1b3-43cb-82d5-709df14bd3b1\") " pod="opendatahub/maas-controller-645ff58b69-sb66g"
Sep 11 04:03:16.540135 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:16.540053    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-645ff58b69-sb66g"
Sep 11 04:03:16.811737 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:16.811712    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-645ff58b69-sb66g"]
Sep 11 04:03:16.813268 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:03:16.813241    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode002994b_a1b3_43cb_82d5_709df14bd3b1.slice/crio-a551b9d7b4ce3399944b16c32d9af5813ddf3c12623a374ef261e221c20394db WatchSource:0}: Error finding container a551b9d7b4ce3399944b16c32d9af5813ddf3c12623a374ef261e221c20394db: Status 404 returned error can't find the container with id a551b9d7b4ce3399944b16c32d9af5813ddf3c12623a374ef261e221c20394db
Sep 11 04:03:17.540771 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:17.540694    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-645ff58b69-sb66g" event={"ID":"e002994b-a1b3-43cb-82d5-709df14bd3b1","Type":"ContainerStarted","Data":"a551b9d7b4ce3399944b16c32d9af5813ddf3c12623a374ef261e221c20394db"}
Sep 11 04:03:19.554937 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:19.554839    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-645ff58b69-sb66g" event={"ID":"e002994b-a1b3-43cb-82d5-709df14bd3b1","Type":"ContainerStarted","Data":"b81f281a38ff847e6426ad66e0b1a0a8fcfdd0c0efd7bfd8bfd1ae81a2c66384"}
Sep 11 04:03:19.555304 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:19.554954    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-645ff58b69-sb66g"
Sep 11 04:03:19.576513 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:19.576453    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-645ff58b69-sb66g" podStartSLOduration=1.228996044 podStartE2EDuration="3.576436895s" totalImagesPullingTime="2.347440851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:03:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:03:19.573926762 +0000 UTC m=+596.372016488" watchObservedRunningTime="2026-09-11 04:03:19.576436895 +0000 UTC m=+596.374526622"
Sep 11 04:03:23.725984 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:23.725954    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nfssn_c9add74a-5c51-4ccf-9edd-3b90a66b9ef9/ovn-acl-logging/0.log"
Sep 11 04:03:23.727210 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:23.727187    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nfssn_c9add74a-5c51-4ccf-9edd-3b90a66b9ef9/ovn-acl-logging/0.log"
Sep 11 04:03:30.562957 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:30.562922    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-645ff58b69-sb66g"
Sep 11 04:03:52.656022 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:52.655987    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kxwqb"]
Sep 11 04:03:52.666531 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:52.666501    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kxwqb"
Sep 11 04:03:52.670296 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:52.670261    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 04:03:52.670450 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:52.670317    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 11 04:03:52.670670 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:52.670652    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-b8w8q\""
Sep 11 04:03:52.671182 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:52.671159    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kxwqb"]
Sep 11 04:03:52.779928 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:52.779890    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbf4n\" (UniqueName: \"kubernetes.io/projected/db8feed7-508a-411e-874e-fd8247ae7d30-kube-api-access-wbf4n\") pod \"maas-api-7ff8fbcd4f-kxwqb\" (UID: \"db8feed7-508a-411e-874e-fd8247ae7d30\") " pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kxwqb"
Sep 11 04:03:52.780081 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:52.779953    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db8feed7-508a-411e-874e-fd8247ae7d30-maas-api-tls\") pod \"maas-api-7ff8fbcd4f-kxwqb\" (UID: \"db8feed7-508a-411e-874e-fd8247ae7d30\") " pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kxwqb"
Sep 11 04:03:52.780081 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:52.780004    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db8feed7-508a-411e-874e-fd8247ae7d30-openshift-service-ca\") pod \"maas-api-7ff8fbcd4f-kxwqb\" (UID: \"db8feed7-508a-411e-874e-fd8247ae7d30\") " pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kxwqb"
Sep 11 04:03:52.780081 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:52.780071    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db8feed7-508a-411e-874e-fd8247ae7d30-metrics-certs\") pod \"maas-api-7ff8fbcd4f-kxwqb\" (UID: \"db8feed7-508a-411e-874e-fd8247ae7d30\") " pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kxwqb"
Sep 11 04:03:52.881145 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:52.881104    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db8feed7-508a-411e-874e-fd8247ae7d30-maas-api-tls\") pod \"maas-api-7ff8fbcd4f-kxwqb\" (UID: \"db8feed7-508a-411e-874e-fd8247ae7d30\") " pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kxwqb"
Sep 11 04:03:52.881324 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:52.881149    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db8feed7-508a-411e-874e-fd8247ae7d30-openshift-service-ca\") pod \"maas-api-7ff8fbcd4f-kxwqb\" (UID: \"db8feed7-508a-411e-874e-fd8247ae7d30\") " pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kxwqb"
Sep 11 04:03:52.881324 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:52.881208    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db8feed7-508a-411e-874e-fd8247ae7d30-metrics-certs\") pod \"maas-api-7ff8fbcd4f-kxwqb\" (UID: \"db8feed7-508a-411e-874e-fd8247ae7d30\") " pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kxwqb"
Sep 11 04:03:52.881482 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:52.881352    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbf4n\" (UniqueName: \"kubernetes.io/projected/db8feed7-508a-411e-874e-fd8247ae7d30-kube-api-access-wbf4n\") pod \"maas-api-7ff8fbcd4f-kxwqb\" (UID: \"db8feed7-508a-411e-874e-fd8247ae7d30\") " pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kxwqb"
Sep 11 04:03:52.882089 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:52.882055    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db8feed7-508a-411e-874e-fd8247ae7d30-openshift-service-ca\") pod \"maas-api-7ff8fbcd4f-kxwqb\" (UID: \"db8feed7-508a-411e-874e-fd8247ae7d30\") " pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kxwqb"
Sep 11 04:03:52.883668 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:52.883639    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db8feed7-508a-411e-874e-fd8247ae7d30-maas-api-tls\") pod \"maas-api-7ff8fbcd4f-kxwqb\" (UID: \"db8feed7-508a-411e-874e-fd8247ae7d30\") " pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kxwqb"
Sep 11 04:03:52.883796 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:52.883724    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db8feed7-508a-411e-874e-fd8247ae7d30-metrics-certs\") pod \"maas-api-7ff8fbcd4f-kxwqb\" (UID: \"db8feed7-508a-411e-874e-fd8247ae7d30\") " pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kxwqb"
Sep 11 04:03:52.888966 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:52.888945    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbf4n\" (UniqueName: \"kubernetes.io/projected/db8feed7-508a-411e-874e-fd8247ae7d30-kube-api-access-wbf4n\") pod \"maas-api-7ff8fbcd4f-kxwqb\" (UID: \"db8feed7-508a-411e-874e-fd8247ae7d30\") " pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kxwqb"
Sep 11 04:03:52.979442 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:52.979346    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kxwqb"
Sep 11 04:03:53.213752 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:53.213715    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:03:53.276634 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:53.276600    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kxwqb"]
Sep 11 04:03:53.278026 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:03:53.277988    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb8feed7_508a_411e_874e_fd8247ae7d30.slice/crio-666d2f2f8c9263a5a14733e9c9ef713c35fd4ef07b42d911b3d37b07cd43b1a2 WatchSource:0}: Error finding container 666d2f2f8c9263a5a14733e9c9ef713c35fd4ef07b42d911b3d37b07cd43b1a2: Status 404 returned error can't find the container with id 666d2f2f8c9263a5a14733e9c9ef713c35fd4ef07b42d911b3d37b07cd43b1a2
Sep 11 04:03:53.279569 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:53.279548    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 04:03:53.730122 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:53.730086    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kxwqb" event={"ID":"db8feed7-508a-411e-874e-fd8247ae7d30","Type":"ContainerStarted","Data":"666d2f2f8c9263a5a14733e9c9ef713c35fd4ef07b42d911b3d37b07cd43b1a2"}
Sep 11 04:03:55.755726 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:55.755683    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kxwqb" event={"ID":"db8feed7-508a-411e-874e-fd8247ae7d30","Type":"ContainerStarted","Data":"6cf17a805a67f3cad13bf44d98d7faebe3a13aca5eda097b25a2d17e614738a7"}
Sep 11 04:03:55.756125 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:55.755783    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kxwqb"
Sep 11 04:03:55.774694 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:03:55.774642    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kxwqb" podStartSLOduration=2.068072856 podStartE2EDuration="3.774626239s" totalImagesPullingTime="1.706553383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:03:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:03:55.773346788 +0000 UTC m=+632.571436516" watchObservedRunningTime="2026-09-11 04:03:55.774626239 +0000 UTC m=+632.572715965"
Sep 11 04:04:01.324582 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:01.324540    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-t9t74 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 04:04:01.324965 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:01.324609    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74" podUID="f1d3b637-e83f-46fa-b4d3-de3eddd404b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 04:04:01.767477 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:01.767381    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kxwqb"
Sep 11 04:04:02.796446 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:02.796324    2558 generic.go:356] "Generic (PLEG): container finished" podID="f1d3b637-e83f-46fa-b4d3-de3eddd404b5" containerID="17d2918812713385524ce316e8e0b9ce45cc7be82d1d28601bf0eb9605eea822" exitCode=0
Sep 11 04:04:02.796446 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:02.796427    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74" event={"ID":"f1d3b637-e83f-46fa-b4d3-de3eddd404b5","Type":"ContainerDied","Data":"17d2918812713385524ce316e8e0b9ce45cc7be82d1d28601bf0eb9605eea822"}
Sep 11 04:04:02.796951 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:02.796933    2558 scope.go:117] "RemoveContainer" containerID="17d2918812713385524ce316e8e0b9ce45cc7be82d1d28601bf0eb9605eea822"
Sep 11 04:04:02.798269 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:02.798230    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:04:02.798479 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:02.798432    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:04:02.798616 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:02.798595    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:04:03.808600 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:03.808568    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74" event={"ID":"f1d3b637-e83f-46fa-b4d3-de3eddd404b5","Type":"ContainerStarted","Data":"88619cedf54d09a4977da3a1510d6b7a35bc456e19a9ae6ae2d25fab1570fad5"}
Sep 11 04:04:04.730886 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:04.730841    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"
Sep 11 04:04:04.731201 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:04.730952    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-t9t74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 11 04:04:04.731413 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:04.731368    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74" podUID="f1d3b637-e83f-46fa-b4d3-de3eddd404b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 11 04:04:05.731564 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:05.731515    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-t9t74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 11 04:04:05.732076 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:05.731590    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74" podUID="f1d3b637-e83f-46fa-b4d3-de3eddd404b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 11 04:04:06.731618 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:06.731566    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-t9t74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 11 04:04:06.732134 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:06.731643    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74" podUID="f1d3b637-e83f-46fa-b4d3-de3eddd404b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 11 04:04:07.731872 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:07.731826    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-t9t74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 11 04:04:07.732367 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:07.731897    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74" podUID="f1d3b637-e83f-46fa-b4d3-de3eddd404b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 11 04:04:08.731193 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:08.731143    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-t9t74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 11 04:04:08.731369 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:08.731234    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74" podUID="f1d3b637-e83f-46fa-b4d3-de3eddd404b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 11 04:04:09.734602 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:09.734570    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"
Sep 11 04:04:09.734995 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:09.734852    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"
Sep 11 04:04:09.735483 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:09.735458    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74"
Sep 11 04:04:16.699821 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:16.699776    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x"]
Sep 11 04:04:16.702709 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:16.702690    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x"
Sep 11 04:04:16.706494 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:16.706473    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 11 04:04:16.706612 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:16.706553    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 04:04:16.706612 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:16.706587    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 04:04:16.706612 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:16.706597    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-97jpl\""
Sep 11 04:04:16.713055 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:16.713036    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x"]
Sep 11 04:04:16.809085 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:16.809053    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/655c39e7-ec39-4712-a0cf-ebcc35ff46e6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x\" (UID: \"655c39e7-ec39-4712-a0cf-ebcc35ff46e6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x"
Sep 11 04:04:16.809241 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:16.809111    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/655c39e7-ec39-4712-a0cf-ebcc35ff46e6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x\" (UID: \"655c39e7-ec39-4712-a0cf-ebcc35ff46e6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x"
Sep 11 04:04:16.809241 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:16.809166    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/655c39e7-ec39-4712-a0cf-ebcc35ff46e6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x\" (UID: \"655c39e7-ec39-4712-a0cf-ebcc35ff46e6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x"
Sep 11 04:04:16.809241 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:16.809209    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/655c39e7-ec39-4712-a0cf-ebcc35ff46e6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x\" (UID: \"655c39e7-ec39-4712-a0cf-ebcc35ff46e6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x"
Sep 11 04:04:16.809241 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:16.809235    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/655c39e7-ec39-4712-a0cf-ebcc35ff46e6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x\" (UID: \"655c39e7-ec39-4712-a0cf-ebcc35ff46e6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x"
Sep 11 04:04:16.809372 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:16.809287    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm7qz\" (UniqueName: \"kubernetes.io/projected/655c39e7-ec39-4712-a0cf-ebcc35ff46e6-kube-api-access-rm7qz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x\" (UID: \"655c39e7-ec39-4712-a0cf-ebcc35ff46e6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x"
Sep 11 04:04:16.910140 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:16.910106    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/655c39e7-ec39-4712-a0cf-ebcc35ff46e6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x\" (UID: \"655c39e7-ec39-4712-a0cf-ebcc35ff46e6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x"
Sep 11 04:04:16.910140 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:16.910141    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/655c39e7-ec39-4712-a0cf-ebcc35ff46e6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x\" (UID: \"655c39e7-ec39-4712-a0cf-ebcc35ff46e6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x"
Sep 11 04:04:16.910419 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:16.910171    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/655c39e7-ec39-4712-a0cf-ebcc35ff46e6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x\" (UID: \"655c39e7-ec39-4712-a0cf-ebcc35ff46e6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x"
Sep 11 04:04:16.910419 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:16.910201    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/655c39e7-ec39-4712-a0cf-ebcc35ff46e6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x\" (UID: \"655c39e7-ec39-4712-a0cf-ebcc35ff46e6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x"
Sep 11 04:04:16.910419 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:16.910242    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm7qz\" (UniqueName: \"kubernetes.io/projected/655c39e7-ec39-4712-a0cf-ebcc35ff46e6-kube-api-access-rm7qz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x\" (UID: \"655c39e7-ec39-4712-a0cf-ebcc35ff46e6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x"
Sep 11 04:04:16.910419 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:16.910287    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/655c39e7-ec39-4712-a0cf-ebcc35ff46e6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x\" (UID: \"655c39e7-ec39-4712-a0cf-ebcc35ff46e6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x"
Sep 11 04:04:16.910745 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:16.910722    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/655c39e7-ec39-4712-a0cf-ebcc35ff46e6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x\" (UID: \"655c39e7-ec39-4712-a0cf-ebcc35ff46e6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x"
Sep 11 04:04:16.910881 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:16.910802    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/655c39e7-ec39-4712-a0cf-ebcc35ff46e6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x\" (UID: \"655c39e7-ec39-4712-a0cf-ebcc35ff46e6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x"
Sep 11 04:04:16.910881 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:16.910805    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/655c39e7-ec39-4712-a0cf-ebcc35ff46e6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x\" (UID: \"655c39e7-ec39-4712-a0cf-ebcc35ff46e6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x"
Sep 11 04:04:16.912585 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:16.912557    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/655c39e7-ec39-4712-a0cf-ebcc35ff46e6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x\" (UID: \"655c39e7-ec39-4712-a0cf-ebcc35ff46e6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x"
Sep 11 04:04:16.912733 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:16.912715    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/655c39e7-ec39-4712-a0cf-ebcc35ff46e6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x\" (UID: \"655c39e7-ec39-4712-a0cf-ebcc35ff46e6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x"
Sep 11 04:04:16.918236 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:16.918214    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm7qz\" (UniqueName: \"kubernetes.io/projected/655c39e7-ec39-4712-a0cf-ebcc35ff46e6-kube-api-access-rm7qz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x\" (UID: \"655c39e7-ec39-4712-a0cf-ebcc35ff46e6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x"
Sep 11 04:04:17.017646 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:17.017522    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x"
Sep 11 04:04:17.195311 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:17.195278    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:04:17.311606 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:17.311579    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x"]
Sep 11 04:04:17.313518 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:04:17.313492    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod655c39e7_ec39_4712_a0cf_ebcc35ff46e6.slice/crio-05db2cb1d78e0e9ff8a338dec8e4f11341595bdbeaa5a9b7374596bb8e8c171e WatchSource:0}: Error finding container 05db2cb1d78e0e9ff8a338dec8e4f11341595bdbeaa5a9b7374596bb8e8c171e: Status 404 returned error can't find the container with id 05db2cb1d78e0e9ff8a338dec8e4f11341595bdbeaa5a9b7374596bb8e8c171e
Sep 11 04:04:17.894462 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:17.894424    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x" event={"ID":"655c39e7-ec39-4712-a0cf-ebcc35ff46e6","Type":"ContainerStarted","Data":"05db2cb1d78e0e9ff8a338dec8e4f11341595bdbeaa5a9b7374596bb8e8c171e"}
Sep 11 04:04:18.901101 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:18.901063    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x" event={"ID":"655c39e7-ec39-4712-a0cf-ebcc35ff46e6","Type":"ContainerStarted","Data":"559ab2f88281c880d53c8a419dc6e601abba8eecdc48031749ec7d84d083ea9d"}
Sep 11 04:04:18.919106 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:18.919059    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x" podStartSLOduration=1.954447364 podStartE2EDuration="2.919043367s" totalImagesPullingTime="964.596003ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:04:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:04:18.917718386 +0000 UTC m=+655.715808113" watchObservedRunningTime="2026-09-11 04:04:18.919043367 +0000 UTC m=+655.717133133"
Sep 11 04:04:27.018203 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:27.018170    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x"
Sep 11 04:04:27.018845 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:27.018243    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x"
Sep 11 04:04:27.031060 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:27.031035    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x"
Sep 11 04:04:27.960481 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:27.960454    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x"
Sep 11 04:04:35.646828 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:35.646793    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:04:59.691138 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:04:59.691105    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:05:05.888506 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:05.888473    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-bhhd9"]
Sep 11 04:05:05.893163 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:05.893141    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bhhd9"
Sep 11 04:05:05.895693 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:05.895670    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 11 04:05:05.902579 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:05.902554    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-bhhd9"]
Sep 11 04:05:06.030155 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:06.030108    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/802671e4-0c09-41a9-b8ff-e29745496e25-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bhhd9\" (UID: \"802671e4-0c09-41a9-b8ff-e29745496e25\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bhhd9"
Sep 11 04:05:06.030338 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:06.030169    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/802671e4-0c09-41a9-b8ff-e29745496e25-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bhhd9\" (UID: \"802671e4-0c09-41a9-b8ff-e29745496e25\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bhhd9"
Sep 11 04:05:06.030338 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:06.030193    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/802671e4-0c09-41a9-b8ff-e29745496e25-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bhhd9\" (UID: \"802671e4-0c09-41a9-b8ff-e29745496e25\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bhhd9"
Sep 11 04:05:06.030338 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:06.030210    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/802671e4-0c09-41a9-b8ff-e29745496e25-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bhhd9\" (UID: \"802671e4-0c09-41a9-b8ff-e29745496e25\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bhhd9"
Sep 11 04:05:06.030338 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:06.030267    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/802671e4-0c09-41a9-b8ff-e29745496e25-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bhhd9\" (UID: \"802671e4-0c09-41a9-b8ff-e29745496e25\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bhhd9"
Sep 11 04:05:06.030338 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:06.030304    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9l2k\" (UniqueName: \"kubernetes.io/projected/802671e4-0c09-41a9-b8ff-e29745496e25-kube-api-access-j9l2k\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bhhd9\" (UID: \"802671e4-0c09-41a9-b8ff-e29745496e25\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bhhd9"
Sep 11 04:05:06.130978 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:06.130932    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/802671e4-0c09-41a9-b8ff-e29745496e25-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bhhd9\" (UID: \"802671e4-0c09-41a9-b8ff-e29745496e25\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bhhd9"
Sep 11 04:05:06.130978 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:06.130980    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/802671e4-0c09-41a9-b8ff-e29745496e25-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bhhd9\" (UID: \"802671e4-0c09-41a9-b8ff-e29745496e25\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bhhd9"
Sep 11 04:05:06.131222 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:06.130997    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/802671e4-0c09-41a9-b8ff-e29745496e25-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bhhd9\" (UID: \"802671e4-0c09-41a9-b8ff-e29745496e25\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bhhd9"
Sep 11 04:05:06.131222 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:06.131024    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/802671e4-0c09-41a9-b8ff-e29745496e25-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bhhd9\" (UID: \"802671e4-0c09-41a9-b8ff-e29745496e25\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bhhd9"
Sep 11 04:05:06.131222 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:06.131047    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/802671e4-0c09-41a9-b8ff-e29745496e25-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bhhd9\" (UID: \"802671e4-0c09-41a9-b8ff-e29745496e25\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bhhd9"
Sep 11 04:05:06.131222 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:06.131109    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9l2k\" (UniqueName: \"kubernetes.io/projected/802671e4-0c09-41a9-b8ff-e29745496e25-kube-api-access-j9l2k\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bhhd9\" (UID: \"802671e4-0c09-41a9-b8ff-e29745496e25\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bhhd9"
Sep 11 04:05:06.131493 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:06.131470    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/802671e4-0c09-41a9-b8ff-e29745496e25-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bhhd9\" (UID: \"802671e4-0c09-41a9-b8ff-e29745496e25\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bhhd9"
Sep 11 04:05:06.131493 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:06.131483    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/802671e4-0c09-41a9-b8ff-e29745496e25-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bhhd9\" (UID: \"802671e4-0c09-41a9-b8ff-e29745496e25\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bhhd9"
Sep 11 04:05:06.131613 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:06.131525    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/802671e4-0c09-41a9-b8ff-e29745496e25-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bhhd9\" (UID: \"802671e4-0c09-41a9-b8ff-e29745496e25\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bhhd9"
Sep 11 04:05:06.133299 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:06.133278    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/802671e4-0c09-41a9-b8ff-e29745496e25-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bhhd9\" (UID: \"802671e4-0c09-41a9-b8ff-e29745496e25\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bhhd9"
Sep 11 04:05:06.133606 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:06.133587    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/802671e4-0c09-41a9-b8ff-e29745496e25-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bhhd9\" (UID: \"802671e4-0c09-41a9-b8ff-e29745496e25\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bhhd9"
Sep 11 04:05:06.139333 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:06.139274    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9l2k\" (UniqueName: \"kubernetes.io/projected/802671e4-0c09-41a9-b8ff-e29745496e25-kube-api-access-j9l2k\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bhhd9\" (UID: \"802671e4-0c09-41a9-b8ff-e29745496e25\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bhhd9"
Sep 11 04:05:06.204440 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:06.204375    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bhhd9"
Sep 11 04:05:06.476644 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:06.476614    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-bhhd9"]
Sep 11 04:05:06.477858 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:05:06.477830    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod802671e4_0c09_41a9_b8ff_e29745496e25.slice/crio-e5c7ec799f4aa38034984a95da9d18538ceb5163417b32f19786c0a47de317bb WatchSource:0}: Error finding container e5c7ec799f4aa38034984a95da9d18538ceb5163417b32f19786c0a47de317bb: Status 404 returned error can't find the container with id e5c7ec799f4aa38034984a95da9d18538ceb5163417b32f19786c0a47de317bb
Sep 11 04:05:06.792729 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:06.792693    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:05:07.151803 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:07.151757    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bhhd9" event={"ID":"802671e4-0c09-41a9-b8ff-e29745496e25","Type":"ContainerStarted","Data":"4deff5e194ae3b1dc000ccae5e875539a7082bcd58c41018053e338ec5f9eae6"}
Sep 11 04:05:07.152173 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:07.151829    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bhhd9" event={"ID":"802671e4-0c09-41a9-b8ff-e29745496e25","Type":"ContainerStarted","Data":"e5c7ec799f4aa38034984a95da9d18538ceb5163417b32f19786c0a47de317bb"}
Sep 11 04:05:07.173659 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:07.173608    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bhhd9" podStartSLOduration=1.943353476 podStartE2EDuration="2.173591866s" totalImagesPullingTime="230.23839ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:05:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:05:07.171871575 +0000 UTC m=+703.969961303" watchObservedRunningTime="2026-09-11 04:05:07.173591866 +0000 UTC m=+703.971681597"
Sep 11 04:05:16.205114 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:16.205026    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bhhd9"
Sep 11 04:05:16.205114 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:16.205096    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bhhd9"
Sep 11 04:05:16.217364 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:16.217335    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bhhd9"
Sep 11 04:05:17.215748 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:17.215722    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bhhd9"
Sep 11 04:05:18.798497 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:18.798462    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:05:24.192716 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:24.192678    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-vzrlw"]
Sep 11 04:05:24.196098 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:24.196070    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vzrlw"
Sep 11 04:05:24.198652 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:24.198632    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 11 04:05:24.208674 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:24.208652    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-vzrlw"]
Sep 11 04:05:24.278047 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:24.278013    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9e8f836-3e15-401f-8c2c-b593009405f2-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vzrlw\" (UID: \"d9e8f836-3e15-401f-8c2c-b593009405f2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vzrlw"
Sep 11 04:05:24.278221 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:24.278051    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9e8f836-3e15-401f-8c2c-b593009405f2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vzrlw\" (UID: \"d9e8f836-3e15-401f-8c2c-b593009405f2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vzrlw"
Sep 11 04:05:24.278221 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:24.278112    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9e8f836-3e15-401f-8c2c-b593009405f2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vzrlw\" (UID: \"d9e8f836-3e15-401f-8c2c-b593009405f2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vzrlw"
Sep 11 04:05:24.278221 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:24.278205    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9e8f836-3e15-401f-8c2c-b593009405f2-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vzrlw\" (UID: \"d9e8f836-3e15-401f-8c2c-b593009405f2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vzrlw"
Sep 11 04:05:24.278356 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:24.278236    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9e8f836-3e15-401f-8c2c-b593009405f2-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vzrlw\" (UID: \"d9e8f836-3e15-401f-8c2c-b593009405f2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vzrlw"
Sep 11 04:05:24.278356 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:24.278274    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cm58\" (UniqueName: \"kubernetes.io/projected/d9e8f836-3e15-401f-8c2c-b593009405f2-kube-api-access-4cm58\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vzrlw\" (UID: \"d9e8f836-3e15-401f-8c2c-b593009405f2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vzrlw"
Sep 11 04:05:24.379860 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:24.379820    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9e8f836-3e15-401f-8c2c-b593009405f2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vzrlw\" (UID: \"d9e8f836-3e15-401f-8c2c-b593009405f2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vzrlw"
Sep 11 04:05:24.380029 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:24.379984    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9e8f836-3e15-401f-8c2c-b593009405f2-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vzrlw\" (UID: \"d9e8f836-3e15-401f-8c2c-b593009405f2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vzrlw"
Sep 11 04:05:24.380029 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:24.380028    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9e8f836-3e15-401f-8c2c-b593009405f2-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vzrlw\" (UID: \"d9e8f836-3e15-401f-8c2c-b593009405f2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vzrlw"
Sep 11 04:05:24.380162 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:24.380071    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cm58\" (UniqueName: \"kubernetes.io/projected/d9e8f836-3e15-401f-8c2c-b593009405f2-kube-api-access-4cm58\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vzrlw\" (UID: \"d9e8f836-3e15-401f-8c2c-b593009405f2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vzrlw"
Sep 11 04:05:24.380162 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:24.380123    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9e8f836-3e15-401f-8c2c-b593009405f2-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vzrlw\" (UID: \"d9e8f836-3e15-401f-8c2c-b593009405f2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vzrlw"
Sep 11 04:05:24.380162 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:24.380151    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9e8f836-3e15-401f-8c2c-b593009405f2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vzrlw\" (UID: \"d9e8f836-3e15-401f-8c2c-b593009405f2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vzrlw"
Sep 11 04:05:24.380510 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:24.380486    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9e8f836-3e15-401f-8c2c-b593009405f2-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vzrlw\" (UID: \"d9e8f836-3e15-401f-8c2c-b593009405f2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vzrlw"
Sep 11 04:05:24.380652 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:24.380592    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9e8f836-3e15-401f-8c2c-b593009405f2-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vzrlw\" (UID: \"d9e8f836-3e15-401f-8c2c-b593009405f2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vzrlw"
Sep 11 04:05:24.380744 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:24.380542    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9e8f836-3e15-401f-8c2c-b593009405f2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vzrlw\" (UID: \"d9e8f836-3e15-401f-8c2c-b593009405f2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vzrlw"
Sep 11 04:05:24.382596 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:24.382570    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9e8f836-3e15-401f-8c2c-b593009405f2-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vzrlw\" (UID: \"d9e8f836-3e15-401f-8c2c-b593009405f2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vzrlw"
Sep 11 04:05:24.382685 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:24.382650    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9e8f836-3e15-401f-8c2c-b593009405f2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vzrlw\" (UID: \"d9e8f836-3e15-401f-8c2c-b593009405f2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vzrlw"
Sep 11 04:05:24.388444 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:24.388424    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cm58\" (UniqueName: \"kubernetes.io/projected/d9e8f836-3e15-401f-8c2c-b593009405f2-kube-api-access-4cm58\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vzrlw\" (UID: \"d9e8f836-3e15-401f-8c2c-b593009405f2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vzrlw"
Sep 11 04:05:24.508977 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:24.508901    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vzrlw"
Sep 11 04:05:24.779227 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:24.779204    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-vzrlw"]
Sep 11 04:05:24.781004 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:05:24.780968    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9e8f836_3e15_401f_8c2c_b593009405f2.slice/crio-32b6c71ec92f4f5a2736536051aa61be9fd8f1f62a6f7e76c0da106565a7f02c WatchSource:0}: Error finding container 32b6c71ec92f4f5a2736536051aa61be9fd8f1f62a6f7e76c0da106565a7f02c: Status 404 returned error can't find the container with id 32b6c71ec92f4f5a2736536051aa61be9fd8f1f62a6f7e76c0da106565a7f02c
Sep 11 04:05:25.251561 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:25.251525    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vzrlw" event={"ID":"d9e8f836-3e15-401f-8c2c-b593009405f2","Type":"ContainerStarted","Data":"6123f15320ef61e2ebbc747ac9b566150bd7237a338433d7f2bfbff217d27772"}
Sep 11 04:05:25.251954 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:25.251613    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vzrlw" event={"ID":"d9e8f836-3e15-401f-8c2c-b593009405f2","Type":"ContainerStarted","Data":"32b6c71ec92f4f5a2736536051aa61be9fd8f1f62a6f7e76c0da106565a7f02c"}
Sep 11 04:05:25.273133 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:25.273072    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vzrlw" podStartSLOduration=1.063611325 podStartE2EDuration="1.273054234s" totalImagesPullingTime="209.442909ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:05:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:05:25.271900134 +0000 UTC m=+722.069989860" watchObservedRunningTime="2026-09-11 04:05:25.273054234 +0000 UTC m=+722.071143962"
Sep 11 04:05:25.995208 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:25.995171    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:05:34.509012 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:34.508973    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vzrlw"
Sep 11 04:05:34.509557 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:34.509039    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vzrlw"
Sep 11 04:05:34.521509 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:34.521486    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vzrlw"
Sep 11 04:05:35.319316 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:35.319289    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vzrlw"
Sep 11 04:05:41.099291 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:05:41.099254    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:07:23.708598 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:23.708568    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:07:24.582461 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:24.582415    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv"]
Sep 11 04:07:24.586170 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:24.586149    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv"
Sep 11 04:07:24.588700 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:24.588676    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-a28c9f-serving-cert\""
Sep 11 04:07:24.597777 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:24.597751    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv"]
Sep 11 04:07:24.629159 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:24.629135    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/415bcf79-d9fc-447a-8b35-5596c284a7fd-metrics-certs\") pod \"maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv\" (UID: \"415bcf79-d9fc-447a-8b35-5596c284a7fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv"
Sep 11 04:07:24.629282 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:24.629185    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/415bcf79-d9fc-447a-8b35-5596c284a7fd-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv\" (UID: \"415bcf79-d9fc-447a-8b35-5596c284a7fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv"
Sep 11 04:07:24.629282 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:24.629202    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/415bcf79-d9fc-447a-8b35-5596c284a7fd-maas-api-tls\") pod \"maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv\" (UID: \"415bcf79-d9fc-447a-8b35-5596c284a7fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv"
Sep 11 04:07:24.629282 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:24.629271    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcjk2\" (UniqueName: \"kubernetes.io/projected/415bcf79-d9fc-447a-8b35-5596c284a7fd-kube-api-access-wcjk2\") pod \"maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv\" (UID: \"415bcf79-d9fc-447a-8b35-5596c284a7fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv"
Sep 11 04:07:24.730503 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:24.730469    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/415bcf79-d9fc-447a-8b35-5596c284a7fd-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv\" (UID: \"415bcf79-d9fc-447a-8b35-5596c284a7fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv"
Sep 11 04:07:24.730503 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:24.730507    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/415bcf79-d9fc-447a-8b35-5596c284a7fd-maas-api-tls\") pod \"maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv\" (UID: \"415bcf79-d9fc-447a-8b35-5596c284a7fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv"
Sep 11 04:07:24.730981 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:24.730534    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcjk2\" (UniqueName: \"kubernetes.io/projected/415bcf79-d9fc-447a-8b35-5596c284a7fd-kube-api-access-wcjk2\") pod \"maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv\" (UID: \"415bcf79-d9fc-447a-8b35-5596c284a7fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv"
Sep 11 04:07:24.730981 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:24.730628    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/415bcf79-d9fc-447a-8b35-5596c284a7fd-metrics-certs\") pod \"maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv\" (UID: \"415bcf79-d9fc-447a-8b35-5596c284a7fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv"
Sep 11 04:07:24.730981 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:07:24.730667    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-a28c9f-serving-cert: secret "maas-api-e2e-inf-a-a28c9f-serving-cert" not found
Sep 11 04:07:24.730981 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:07:24.730741    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/415bcf79-d9fc-447a-8b35-5596c284a7fd-maas-api-tls podName:415bcf79-d9fc-447a-8b35-5596c284a7fd nodeName:}" failed. No retries permitted until 2026-09-11 04:07:25.230720144 +0000 UTC m=+842.028809879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/415bcf79-d9fc-447a-8b35-5596c284a7fd-maas-api-tls") pod "maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv" (UID: "415bcf79-d9fc-447a-8b35-5596c284a7fd") : secret "maas-api-e2e-inf-a-a28c9f-serving-cert" not found
Sep 11 04:07:24.731244 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:24.731207    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/415bcf79-d9fc-447a-8b35-5596c284a7fd-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv\" (UID: \"415bcf79-d9fc-447a-8b35-5596c284a7fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv"
Sep 11 04:07:24.733152 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:24.733132    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/415bcf79-d9fc-447a-8b35-5596c284a7fd-metrics-certs\") pod \"maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv\" (UID: \"415bcf79-d9fc-447a-8b35-5596c284a7fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv"
Sep 11 04:07:24.746743 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:24.746713    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcjk2\" (UniqueName: \"kubernetes.io/projected/415bcf79-d9fc-447a-8b35-5596c284a7fd-kube-api-access-wcjk2\") pod \"maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv\" (UID: \"415bcf79-d9fc-447a-8b35-5596c284a7fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv"
Sep 11 04:07:25.235857 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:25.235825    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/415bcf79-d9fc-447a-8b35-5596c284a7fd-maas-api-tls\") pod \"maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv\" (UID: \"415bcf79-d9fc-447a-8b35-5596c284a7fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv"
Sep 11 04:07:25.238232 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:25.238204    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/415bcf79-d9fc-447a-8b35-5596c284a7fd-maas-api-tls\") pod \"maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv\" (UID: \"415bcf79-d9fc-447a-8b35-5596c284a7fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv"
Sep 11 04:07:25.499258 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:25.499165    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv"
Sep 11 04:07:25.773818 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:25.773792    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv"]
Sep 11 04:07:25.775463 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:07:25.775438    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod415bcf79_d9fc_447a_8b35_5596c284a7fd.slice/crio-f606299ca5a9bb34cba9b3f7727e8042b023af5e25506f392971da58e2765437 WatchSource:0}: Error finding container f606299ca5a9bb34cba9b3f7727e8042b023af5e25506f392971da58e2765437: Status 404 returned error can't find the container with id f606299ca5a9bb34cba9b3f7727e8042b023af5e25506f392971da58e2765437
Sep 11 04:07:25.887624 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:25.887586    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv" event={"ID":"415bcf79-d9fc-447a-8b35-5596c284a7fd","Type":"ContainerStarted","Data":"f606299ca5a9bb34cba9b3f7727e8042b023af5e25506f392971da58e2765437"}
Sep 11 04:07:26.894061 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:26.894026    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv" event={"ID":"415bcf79-d9fc-447a-8b35-5596c284a7fd","Type":"ContainerStarted","Data":"0f2656d71e6204a634869412e9dfa811fdd242d68e477b6df7c3379afbfde284"}
Sep 11 04:07:26.894437 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:26.894087    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv"
Sep 11 04:07:26.914605 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:26.914562    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv" podStartSLOduration=2.3236185369999998 podStartE2EDuration="2.914546531s" totalImagesPullingTime="590.927994ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:07:26.913423319 +0000 UTC m=+843.711513045" watchObservedRunningTime="2026-09-11 04:07:26.914546531 +0000 UTC m=+843.712636254"
Sep 11 04:07:28.557672 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:28.557634    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"]
Sep 11 04:07:28.561476 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:28.561453    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:07:28.563895 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:28.563874    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-d6904f79-openshift-default-dockercfg-9mtqj\""
Sep 11 04:07:28.576736 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:28.576709    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"]
Sep 11 04:07:28.672234 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:28.672199    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-credential-socket\") pod \"e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br\" (UID: \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\") " pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:07:28.672234 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:28.672238    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-istio-data\") pod \"e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br\" (UID: \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\") " pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:07:28.672535 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:28.672363    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmts9\" (UniqueName: \"kubernetes.io/projected/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-kube-api-access-nmts9\") pod \"e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br\" (UID: \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\") " pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:07:28.672535 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:28.672457    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-istio-token\") pod \"e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br\" (UID: \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\") " pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:07:28.672535 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:28.672530    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-istio-envoy\") pod \"e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br\" (UID: \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\") " pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:07:28.672704 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:28.672561    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-istiod-ca-cert\") pod \"e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br\" (UID: \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\") " pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:07:28.672704 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:28.672651    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-workload-socket\") pod \"e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br\" (UID: \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\") " pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:07:28.672704 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:28.672683    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-istio-podinfo\") pod \"e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br\" (UID: \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\") " pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:07:28.672865 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:28.672704    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-workload-certs\") pod \"e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br\" (UID: \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\") " pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:07:28.773367 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:28.773333    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-workload-socket\") pod \"e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br\" (UID: \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\") " pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:07:28.773367 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:28.773370    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-istio-podinfo\") pod \"e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br\" (UID: \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\") " pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:07:28.773571 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:28.773398    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-workload-certs\") pod \"e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br\" (UID: \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\") " pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:07:28.773571 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:28.773425    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-credential-socket\") pod \"e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br\" (UID: \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\") " pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:07:28.773571 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:28.773449    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-istio-data\") pod \"e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br\" (UID: \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\") " pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:07:28.773571 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:28.773498    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmts9\" (UniqueName: \"kubernetes.io/projected/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-kube-api-access-nmts9\") pod \"e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br\" (UID: \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\") " pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:07:28.773571 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:28.773543    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-istio-token\") pod \"e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br\" (UID: \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\") " pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:07:28.773813 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:28.773588    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-istio-envoy\") pod \"e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br\" (UID: \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\") " pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:07:28.773813 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:28.773610    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-istiod-ca-cert\") pod \"e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br\" (UID: \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\") " pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:07:28.773914 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:28.773809    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-workload-socket\") pod \"e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br\" (UID: \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\") " pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:07:28.773914 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:28.773903    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-istio-data\") pod \"e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br\" (UID: \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\") " pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:07:28.774018 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:28.773923    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-credential-socket\") pod \"e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br\" (UID: \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\") " pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:07:28.774063 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:28.774020    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-workload-certs\") pod \"e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br\" (UID: \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\") " pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:07:28.774248 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:28.774233    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-istiod-ca-cert\") pod \"e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br\" (UID: \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\") " pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:07:28.775709 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:28.775692    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-istio-envoy\") pod \"e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br\" (UID: \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\") " pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:07:28.775779 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:28.775710    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-istio-podinfo\") pod \"e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br\" (UID: \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\") " pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:07:28.786552 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:28.786528    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-istio-token\") pod \"e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br\" (UID: \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\") " pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:07:28.791984 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:28.791962    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmts9\" (UniqueName: \"kubernetes.io/projected/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-kube-api-access-nmts9\") pod \"e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br\" (UID: \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\") " pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:07:28.871338 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:28.871300    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:07:29.150865 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:29.150837    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"]
Sep 11 04:07:29.151534 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:07:29.151499    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00001a2c_a0d6_44e2_b2f2_a46b667c5a26.slice/crio-c4b745f5d550606608f8d5c9243533610bcc2bdb4c111b430389db153ea753f2 WatchSource:0}: Error finding container c4b745f5d550606608f8d5c9243533610bcc2bdb4c111b430389db153ea753f2: Status 404 returned error can't find the container with id c4b745f5d550606608f8d5c9243533610bcc2bdb4c111b430389db153ea753f2
Sep 11 04:07:29.153857 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:29.153825    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:07:29.153961 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:29.153894    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:07:29.153961 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:29.153922    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:07:29.914930 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:29.914894    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br" event={"ID":"00001a2c-a0d6-44e2-b2f2-a46b667c5a26","Type":"ContainerStarted","Data":"ebce45bb5eacdfe7c91b1e12a0d86e3214681f23a4d2e4e3dd67e0138a7ccf27"}
Sep 11 04:07:29.915421 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:29.914963    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br" event={"ID":"00001a2c-a0d6-44e2-b2f2-a46b667c5a26","Type":"ContainerStarted","Data":"c4b745f5d550606608f8d5c9243533610bcc2bdb4c111b430389db153ea753f2"}
Sep 11 04:07:29.936848 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:29.936799    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br" podStartSLOduration=1.936779017 podStartE2EDuration="1.936779017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:07:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:07:29.935530613 +0000 UTC m=+846.733620333" watchObservedRunningTime="2026-09-11 04:07:29.936779017 +0000 UTC m=+846.734868744"
Sep 11 04:07:30.871816 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:30.871776    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:07:30.876686 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:30.876660    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:07:30.920491 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:30.920467    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:07:30.921331 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:30.921313    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:07:31.648167 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:31.648131    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87"]
Sep 11 04:07:31.651843 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:31.651824    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87"
Sep 11 04:07:31.654693 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:31.654672    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-eda9e4-serving-cert\""
Sep 11 04:07:31.670227 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:31.670192    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87"]
Sep 11 04:07:31.802787 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:31.802753    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f834672-6736-4226-93d4-659a31a9f766-openshift-service-ca\") pod \"maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87\" (UID: \"3f834672-6736-4226-93d4-659a31a9f766\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87"
Sep 11 04:07:31.802957 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:31.802793    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2884\" (UniqueName: \"kubernetes.io/projected/3f834672-6736-4226-93d4-659a31a9f766-kube-api-access-k2884\") pod \"maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87\" (UID: \"3f834672-6736-4226-93d4-659a31a9f766\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87"
Sep 11 04:07:31.802957 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:31.802813    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f834672-6736-4226-93d4-659a31a9f766-maas-api-tls\") pod \"maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87\" (UID: \"3f834672-6736-4226-93d4-659a31a9f766\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87"
Sep 11 04:07:31.802957 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:31.802887    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f834672-6736-4226-93d4-659a31a9f766-metrics-certs\") pod \"maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87\" (UID: \"3f834672-6736-4226-93d4-659a31a9f766\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87"
Sep 11 04:07:31.903969 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:31.903888    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f834672-6736-4226-93d4-659a31a9f766-openshift-service-ca\") pod \"maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87\" (UID: \"3f834672-6736-4226-93d4-659a31a9f766\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87"
Sep 11 04:07:31.903969 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:31.903934    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2884\" (UniqueName: \"kubernetes.io/projected/3f834672-6736-4226-93d4-659a31a9f766-kube-api-access-k2884\") pod \"maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87\" (UID: \"3f834672-6736-4226-93d4-659a31a9f766\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87"
Sep 11 04:07:31.903969 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:31.903952    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f834672-6736-4226-93d4-659a31a9f766-maas-api-tls\") pod \"maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87\" (UID: \"3f834672-6736-4226-93d4-659a31a9f766\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87"
Sep 11 04:07:31.904206 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:07:31.904048    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-eda9e4-serving-cert: secret "maas-api-e2e-autores-eda9e4-serving-cert" not found
Sep 11 04:07:31.904206 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:07:31.904093    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f834672-6736-4226-93d4-659a31a9f766-maas-api-tls podName:3f834672-6736-4226-93d4-659a31a9f766 nodeName:}" failed. No retries permitted until 2026-09-11 04:07:32.404080174 +0000 UTC m=+849.202169878 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3f834672-6736-4226-93d4-659a31a9f766-maas-api-tls") pod "maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87" (UID: "3f834672-6736-4226-93d4-659a31a9f766") : secret "maas-api-e2e-autores-eda9e4-serving-cert" not found
Sep 11 04:07:31.904206 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:31.904137    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f834672-6736-4226-93d4-659a31a9f766-metrics-certs\") pod \"maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87\" (UID: \"3f834672-6736-4226-93d4-659a31a9f766\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87"
Sep 11 04:07:31.904639 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:31.904614    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f834672-6736-4226-93d4-659a31a9f766-openshift-service-ca\") pod \"maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87\" (UID: \"3f834672-6736-4226-93d4-659a31a9f766\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87"
Sep 11 04:07:31.906566 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:31.906545    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f834672-6736-4226-93d4-659a31a9f766-metrics-certs\") pod \"maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87\" (UID: \"3f834672-6736-4226-93d4-659a31a9f766\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87"
Sep 11 04:07:31.921572 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:31.921548    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2884\" (UniqueName: \"kubernetes.io/projected/3f834672-6736-4226-93d4-659a31a9f766-kube-api-access-k2884\") pod \"maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87\" (UID: \"3f834672-6736-4226-93d4-659a31a9f766\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87"
Sep 11 04:07:32.409911 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:32.409878    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f834672-6736-4226-93d4-659a31a9f766-maas-api-tls\") pod \"maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87\" (UID: \"3f834672-6736-4226-93d4-659a31a9f766\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87"
Sep 11 04:07:32.410187 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:07:32.410052    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-eda9e4-serving-cert: secret "maas-api-e2e-autores-eda9e4-serving-cert" not found
Sep 11 04:07:32.410187 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:07:32.410148    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f834672-6736-4226-93d4-659a31a9f766-maas-api-tls podName:3f834672-6736-4226-93d4-659a31a9f766 nodeName:}" failed. No retries permitted until 2026-09-11 04:07:33.410127361 +0000 UTC m=+850.208217078 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3f834672-6736-4226-93d4-659a31a9f766-maas-api-tls") pod "maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87" (UID: "3f834672-6736-4226-93d4-659a31a9f766") : secret "maas-api-e2e-autores-eda9e4-serving-cert" not found
Sep 11 04:07:32.721277 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:32.721187    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d6904f79-6697bf4887-s62h5"]
Sep 11 04:07:32.725571 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:32.725413    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6904f79-6697bf4887-s62h5"
Sep 11 04:07:32.727808 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:32.727778    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-d6904f79-serving-cert\""
Sep 11 04:07:32.736863 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:32.736841    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d6904f79-6697bf4887-s62h5"]
Sep 11 04:07:32.813674 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:32.813645    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c748a01f-ee34-45e3-afca-8d23d8b9d602-maas-api-tls\") pod \"maas-api-e2e-ait-d6904f79-6697bf4887-s62h5\" (UID: \"c748a01f-ee34-45e3-afca-8d23d8b9d602\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6904f79-6697bf4887-s62h5"
Sep 11 04:07:32.813775 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:32.813690    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c748a01f-ee34-45e3-afca-8d23d8b9d602-openshift-service-ca\") pod \"maas-api-e2e-ait-d6904f79-6697bf4887-s62h5\" (UID: \"c748a01f-ee34-45e3-afca-8d23d8b9d602\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6904f79-6697bf4887-s62h5"
Sep 11 04:07:32.813775 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:32.813706    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c748a01f-ee34-45e3-afca-8d23d8b9d602-metrics-certs\") pod \"maas-api-e2e-ait-d6904f79-6697bf4887-s62h5\" (UID: \"c748a01f-ee34-45e3-afca-8d23d8b9d602\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6904f79-6697bf4887-s62h5"
Sep 11 04:07:32.813847 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:32.813797    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5j65\" (UniqueName: \"kubernetes.io/projected/c748a01f-ee34-45e3-afca-8d23d8b9d602-kube-api-access-m5j65\") pod \"maas-api-e2e-ait-d6904f79-6697bf4887-s62h5\" (UID: \"c748a01f-ee34-45e3-afca-8d23d8b9d602\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6904f79-6697bf4887-s62h5"
Sep 11 04:07:32.905829 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:32.905804    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv"
Sep 11 04:07:32.914633 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:32.914609    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5j65\" (UniqueName: \"kubernetes.io/projected/c748a01f-ee34-45e3-afca-8d23d8b9d602-kube-api-access-m5j65\") pod \"maas-api-e2e-ait-d6904f79-6697bf4887-s62h5\" (UID: \"c748a01f-ee34-45e3-afca-8d23d8b9d602\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6904f79-6697bf4887-s62h5"
Sep 11 04:07:32.914717 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:32.914700    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c748a01f-ee34-45e3-afca-8d23d8b9d602-maas-api-tls\") pod \"maas-api-e2e-ait-d6904f79-6697bf4887-s62h5\" (UID: \"c748a01f-ee34-45e3-afca-8d23d8b9d602\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6904f79-6697bf4887-s62h5"
Sep 11 04:07:32.914756 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:32.914745    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c748a01f-ee34-45e3-afca-8d23d8b9d602-openshift-service-ca\") pod \"maas-api-e2e-ait-d6904f79-6697bf4887-s62h5\" (UID: \"c748a01f-ee34-45e3-afca-8d23d8b9d602\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6904f79-6697bf4887-s62h5"
Sep 11 04:07:32.914788 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:32.914768    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c748a01f-ee34-45e3-afca-8d23d8b9d602-metrics-certs\") pod \"maas-api-e2e-ait-d6904f79-6697bf4887-s62h5\" (UID: \"c748a01f-ee34-45e3-afca-8d23d8b9d602\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6904f79-6697bf4887-s62h5"
Sep 11 04:07:32.914919 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:07:32.914901    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-d6904f79-serving-cert: secret "maas-api-e2e-ait-d6904f79-serving-cert" not found
Sep 11 04:07:32.914968 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:07:32.914960    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c748a01f-ee34-45e3-afca-8d23d8b9d602-maas-api-tls podName:c748a01f-ee34-45e3-afca-8d23d8b9d602 nodeName:}" failed. No retries permitted until 2026-09-11 04:07:33.414947095 +0000 UTC m=+850.213036799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c748a01f-ee34-45e3-afca-8d23d8b9d602-maas-api-tls") pod "maas-api-e2e-ait-d6904f79-6697bf4887-s62h5" (UID: "c748a01f-ee34-45e3-afca-8d23d8b9d602") : secret "maas-api-e2e-ait-d6904f79-serving-cert" not found
Sep 11 04:07:32.915327 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:32.915309    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c748a01f-ee34-45e3-afca-8d23d8b9d602-openshift-service-ca\") pod \"maas-api-e2e-ait-d6904f79-6697bf4887-s62h5\" (UID: \"c748a01f-ee34-45e3-afca-8d23d8b9d602\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6904f79-6697bf4887-s62h5"
Sep 11 04:07:32.917187 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:32.917165    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c748a01f-ee34-45e3-afca-8d23d8b9d602-metrics-certs\") pod \"maas-api-e2e-ait-d6904f79-6697bf4887-s62h5\" (UID: \"c748a01f-ee34-45e3-afca-8d23d8b9d602\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6904f79-6697bf4887-s62h5"
Sep 11 04:07:32.928626 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:32.928591    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5j65\" (UniqueName: \"kubernetes.io/projected/c748a01f-ee34-45e3-afca-8d23d8b9d602-kube-api-access-m5j65\") pod \"maas-api-e2e-ait-d6904f79-6697bf4887-s62h5\" (UID: \"c748a01f-ee34-45e3-afca-8d23d8b9d602\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6904f79-6697bf4887-s62h5"
Sep 11 04:07:33.418318 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:33.418281    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c748a01f-ee34-45e3-afca-8d23d8b9d602-maas-api-tls\") pod \"maas-api-e2e-ait-d6904f79-6697bf4887-s62h5\" (UID: \"c748a01f-ee34-45e3-afca-8d23d8b9d602\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6904f79-6697bf4887-s62h5"
Sep 11 04:07:33.418514 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:33.418325    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f834672-6736-4226-93d4-659a31a9f766-maas-api-tls\") pod \"maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87\" (UID: \"3f834672-6736-4226-93d4-659a31a9f766\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87"
Sep 11 04:07:33.420551 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:33.420525    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c748a01f-ee34-45e3-afca-8d23d8b9d602-maas-api-tls\") pod \"maas-api-e2e-ait-d6904f79-6697bf4887-s62h5\" (UID: \"c748a01f-ee34-45e3-afca-8d23d8b9d602\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6904f79-6697bf4887-s62h5"
Sep 11 04:07:33.420673 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:33.420652    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f834672-6736-4226-93d4-659a31a9f766-maas-api-tls\") pod \"maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87\" (UID: \"3f834672-6736-4226-93d4-659a31a9f766\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87"
Sep 11 04:07:33.464151 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:33.464124    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87"
Sep 11 04:07:33.640352 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:33.640315    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6904f79-6697bf4887-s62h5"
Sep 11 04:07:33.738520 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:33.738493    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87"]
Sep 11 04:07:33.740240 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:07:33.740209    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f834672_6736_4226_93d4_659a31a9f766.slice/crio-b6d4074d547b992a2b5e3de4e33399ed90f98e65fb1ed00a59aff16ac6cb72f0 WatchSource:0}: Error finding container b6d4074d547b992a2b5e3de4e33399ed90f98e65fb1ed00a59aff16ac6cb72f0: Status 404 returned error can't find the container with id b6d4074d547b992a2b5e3de4e33399ed90f98e65fb1ed00a59aff16ac6cb72f0
Sep 11 04:07:33.910093 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:33.910070    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d6904f79-6697bf4887-s62h5"]
Sep 11 04:07:33.911173 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:07:33.911150    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc748a01f_ee34_45e3_afca_8d23d8b9d602.slice/crio-61cdce50fef9c8672c1411014aa4840eebe95aeab032d163730a73123f49d347 WatchSource:0}: Error finding container 61cdce50fef9c8672c1411014aa4840eebe95aeab032d163730a73123f49d347: Status 404 returned error can't find the container with id 61cdce50fef9c8672c1411014aa4840eebe95aeab032d163730a73123f49d347
Sep 11 04:07:33.947589 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:33.947514    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87" event={"ID":"3f834672-6736-4226-93d4-659a31a9f766","Type":"ContainerStarted","Data":"b6d4074d547b992a2b5e3de4e33399ed90f98e65fb1ed00a59aff16ac6cb72f0"}
Sep 11 04:07:33.948840 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:33.948813    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6904f79-6697bf4887-s62h5" event={"ID":"c748a01f-ee34-45e3-afca-8d23d8b9d602","Type":"ContainerStarted","Data":"61cdce50fef9c8672c1411014aa4840eebe95aeab032d163730a73123f49d347"}
Sep 11 04:07:34.955310 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:34.955278    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87" event={"ID":"3f834672-6736-4226-93d4-659a31a9f766","Type":"ContainerStarted","Data":"b5bc7270a04fe8ea0b73b34618a2e376844295ea18d453dfa8eb9ba76d7b07e3"}
Sep 11 04:07:34.955734 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:34.955332    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87"
Sep 11 04:07:34.956822 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:34.956799    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6904f79-6697bf4887-s62h5" event={"ID":"c748a01f-ee34-45e3-afca-8d23d8b9d602","Type":"ContainerStarted","Data":"c146434a2c82901384eeb03f5ba034faebbd86792d77d836842eeefec6e40fb0"}
Sep 11 04:07:34.956933 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:34.956882    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6904f79-6697bf4887-s62h5"
Sep 11 04:07:34.975308 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:34.975263    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87" podStartSLOduration=3.572589835 podStartE2EDuration="3.975249728s" totalImagesPullingTime="402.659893ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:07:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:07:34.972955697 +0000 UTC m=+851.771045423" watchObservedRunningTime="2026-09-11 04:07:34.975249728 +0000 UTC m=+851.773339453"
Sep 11 04:07:34.991612 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:34.991570    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6904f79-6697bf4887-s62h5" podStartSLOduration=2.691112286 podStartE2EDuration="2.991558998s" totalImagesPullingTime="300.446712ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:07:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:07:34.990514394 +0000 UTC m=+851.788604120" watchObservedRunningTime="2026-09-11 04:07:34.991558998 +0000 UTC m=+851.789648724"
Sep 11 04:07:39.503060 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:39.503025    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:07:40.968557 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:40.968519    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6904f79-6697bf4887-s62h5"
Sep 11 04:07:40.968927 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:40.968884    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87"
Sep 11 04:07:51.054601 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:51.054570    2558 generic.go:356] "Generic (PLEG): container finished" podID="00001a2c-a0d6-44e2-b2f2-a46b667c5a26" containerID="ebce45bb5eacdfe7c91b1e12a0d86e3214681f23a4d2e4e3dd67e0138a7ccf27" exitCode=0
Sep 11 04:07:51.055023 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:51.054655    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br" event={"ID":"00001a2c-a0d6-44e2-b2f2-a46b667c5a26","Type":"ContainerDied","Data":"ebce45bb5eacdfe7c91b1e12a0d86e3214681f23a4d2e4e3dd67e0138a7ccf27"}
Sep 11 04:07:51.055201 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:51.055182    2558 scope.go:117] "RemoveContainer" containerID="ebce45bb5eacdfe7c91b1e12a0d86e3214681f23a4d2e4e3dd67e0138a7ccf27"
Sep 11 04:07:51.056290 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:51.056262    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:07:51.056409 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:51.056345    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:07:51.056498 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:51.056416    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:07:52.070140 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:52.070077    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br" event={"ID":"00001a2c-a0d6-44e2-b2f2-a46b667c5a26","Type":"ContainerStarted","Data":"bbd51c6dc0f56ca73b40736fc422ba34dc0eb1bb120a64365ddea4180ad85cb0"}
Sep 11 04:07:52.872458 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:52.872424    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:07:52.872628 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:52.872604    2558 patch_prober.go:28] interesting pod/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 11 04:07:52.872674 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:52.872652    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br" podUID="00001a2c-a0d6-44e2-b2f2-a46b667c5a26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 11 04:07:53.755128 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:53.755094    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j"]
Sep 11 04:07:53.758223 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:53.758203    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j"
Sep 11 04:07:53.761197 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:53.761171    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-fca08f-serving-cert\""
Sep 11 04:07:53.765625 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:53.765598    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j"]
Sep 11 04:07:53.840411 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:53.819505    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r79g\" (UniqueName: \"kubernetes.io/projected/af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3-kube-api-access-7r79g\") pod \"maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j\" (UID: \"af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j"
Sep 11 04:07:53.840763 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:53.840734    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3-maas-api-tls\") pod \"maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j\" (UID: \"af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j"
Sep 11 04:07:53.840932 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:53.840916    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3-metrics-certs\") pod \"maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j\" (UID: \"af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j"
Sep 11 04:07:53.841120 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:53.841103    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3-openshift-service-ca\") pod \"maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j\" (UID: \"af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j"
Sep 11 04:07:53.871990 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:53.871955    2558 patch_prober.go:28] interesting pod/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 11 04:07:53.872141 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:53.872020    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br" podUID="00001a2c-a0d6-44e2-b2f2-a46b667c5a26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 11 04:07:53.942436 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:53.942380    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3-maas-api-tls\") pod \"maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j\" (UID: \"af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j"
Sep 11 04:07:53.942837 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:53.942815    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3-metrics-certs\") pod \"maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j\" (UID: \"af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j"
Sep 11 04:07:53.943049 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:53.943029    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3-openshift-service-ca\") pod \"maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j\" (UID: \"af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j"
Sep 11 04:07:53.943312 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:53.943292    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7r79g\" (UniqueName: \"kubernetes.io/projected/af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3-kube-api-access-7r79g\") pod \"maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j\" (UID: \"af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j"
Sep 11 04:07:53.943814 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:07:53.942767    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-fca08f-serving-cert: secret "maas-api-e2e-inf-b-fca08f-serving-cert" not found
Sep 11 04:07:53.943996 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:07:53.943983    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3-maas-api-tls podName:af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3 nodeName:}" failed. No retries permitted until 2026-09-11 04:07:54.443962443 +0000 UTC m=+871.242052149 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3-maas-api-tls") pod "maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j" (UID: "af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3") : secret "maas-api-e2e-inf-b-fca08f-serving-cert" not found
Sep 11 04:07:53.946900 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:53.944442    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3-openshift-service-ca\") pod \"maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j\" (UID: \"af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j"
Sep 11 04:07:53.946900 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:53.946339    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3-metrics-certs\") pod \"maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j\" (UID: \"af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j"
Sep 11 04:07:53.956119 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:53.956091    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r79g\" (UniqueName: \"kubernetes.io/projected/af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3-kube-api-access-7r79g\") pod \"maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j\" (UID: \"af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j"
Sep 11 04:07:54.449677 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:54.449644    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3-maas-api-tls\") pod \"maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j\" (UID: \"af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j"
Sep 11 04:07:54.452277 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:54.452252    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3-maas-api-tls\") pod \"maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j\" (UID: \"af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j"
Sep 11 04:07:54.671971 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:54.671872    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j"
Sep 11 04:07:54.872381 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:54.872347    2558 patch_prober.go:28] interesting pod/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 11 04:07:54.872911 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:54.872437    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br" podUID="00001a2c-a0d6-44e2-b2f2-a46b667c5a26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 11 04:07:54.973727 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:54.973697    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j"]
Sep 11 04:07:54.974808 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:07:54.974782    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf97cb7d_8c7d_4f37_9e05_aade7ba8f5a3.slice/crio-8eb549cd723de459d975e66de859240fda2372159c71e74abf2718c4df07f11e WatchSource:0}: Error finding container 8eb549cd723de459d975e66de859240fda2372159c71e74abf2718c4df07f11e: Status 404 returned error can't find the container with id 8eb549cd723de459d975e66de859240fda2372159c71e74abf2718c4df07f11e
Sep 11 04:07:55.089319 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:55.089277    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j" event={"ID":"af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3","Type":"ContainerStarted","Data":"8eb549cd723de459d975e66de859240fda2372159c71e74abf2718c4df07f11e"}
Sep 11 04:07:55.872601 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:55.872567    2558 patch_prober.go:28] interesting pod/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 11 04:07:55.872979 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:55.872619    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br" podUID="00001a2c-a0d6-44e2-b2f2-a46b667c5a26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 11 04:07:56.096501 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:56.096458    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j" event={"ID":"af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3","Type":"ContainerStarted","Data":"273ca12339a228591600faa60e81585616f4ec91ec23dbe7e212c17ec0d910bb"}
Sep 11 04:07:56.096706 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:56.096535    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j"
Sep 11 04:07:56.119201 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:56.119155    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j" podStartSLOduration=2.803412285 podStartE2EDuration="3.119137571s" totalImagesPullingTime="315.725286ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:07:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:07:56.115606134 +0000 UTC m=+872.913695876" watchObservedRunningTime="2026-09-11 04:07:56.119137571 +0000 UTC m=+872.917227298"
Sep 11 04:07:56.872714 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:56.872674    2558 patch_prober.go:28] interesting pod/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 11 04:07:56.873113 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:56.872747    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br" podUID="00001a2c-a0d6-44e2-b2f2-a46b667c5a26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 11 04:07:57.872686 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:57.872647    2558 patch_prober.go:28] interesting pod/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 11 04:07:57.872888 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:57.872717    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br" podUID="00001a2c-a0d6-44e2-b2f2-a46b667c5a26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 11 04:07:58.519991 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:58.519951    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:07:58.875739 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:58.875708    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:07:58.876168 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:58.876068    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:07:58.876836 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:07:58.876816    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:08:02.107157 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:02.107133    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j"
Sep 11 04:08:13.138442 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:13.138408    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d6904f79-6697bf4887-s62h5"]
Sep 11 04:08:13.141281 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:13.141222    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6904f79-6697bf4887-s62h5" podUID="c748a01f-ee34-45e3-afca-8d23d8b9d602" containerName="maas-api" containerID="cri-o://c146434a2c82901384eeb03f5ba034faebbd86792d77d836842eeefec6e40fb0" gracePeriod=30
Sep 11 04:08:13.405036 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:13.405013    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6904f79-6697bf4887-s62h5"
Sep 11 04:08:13.516436 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:13.516405    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"]
Sep 11 04:08:13.516626 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:13.516604    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br" podUID="00001a2c-a0d6-44e2-b2f2-a46b667c5a26" containerName="istio-proxy" containerID="cri-o://bbd51c6dc0f56ca73b40736fc422ba34dc0eb1bb120a64365ddea4180ad85cb0" gracePeriod=30
Sep 11 04:08:13.529636 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:13.529611    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c748a01f-ee34-45e3-afca-8d23d8b9d602-maas-api-tls\") pod \"c748a01f-ee34-45e3-afca-8d23d8b9d602\" (UID: \"c748a01f-ee34-45e3-afca-8d23d8b9d602\") "
Sep 11 04:08:13.529759 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:13.529692    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c748a01f-ee34-45e3-afca-8d23d8b9d602-openshift-service-ca\") pod \"c748a01f-ee34-45e3-afca-8d23d8b9d602\" (UID: \"c748a01f-ee34-45e3-afca-8d23d8b9d602\") "
Sep 11 04:08:13.529759 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:13.529728    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c748a01f-ee34-45e3-afca-8d23d8b9d602-metrics-certs\") pod \"c748a01f-ee34-45e3-afca-8d23d8b9d602\" (UID: \"c748a01f-ee34-45e3-afca-8d23d8b9d602\") "
Sep 11 04:08:13.529881 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:13.529757    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5j65\" (UniqueName: \"kubernetes.io/projected/c748a01f-ee34-45e3-afca-8d23d8b9d602-kube-api-access-m5j65\") pod \"c748a01f-ee34-45e3-afca-8d23d8b9d602\" (UID: \"c748a01f-ee34-45e3-afca-8d23d8b9d602\") "
Sep 11 04:08:13.530105 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:13.530071    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c748a01f-ee34-45e3-afca-8d23d8b9d602-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c748a01f-ee34-45e3-afca-8d23d8b9d602" (UID: "c748a01f-ee34-45e3-afca-8d23d8b9d602"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:08:13.531769 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:13.531742    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c748a01f-ee34-45e3-afca-8d23d8b9d602-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c748a01f-ee34-45e3-afca-8d23d8b9d602" (UID: "c748a01f-ee34-45e3-afca-8d23d8b9d602"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:08:13.531939 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:13.531915    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c748a01f-ee34-45e3-afca-8d23d8b9d602-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c748a01f-ee34-45e3-afca-8d23d8b9d602" (UID: "c748a01f-ee34-45e3-afca-8d23d8b9d602"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:08:13.532040 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:13.531933    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c748a01f-ee34-45e3-afca-8d23d8b9d602-kube-api-access-m5j65" (OuterVolumeSpecName: "kube-api-access-m5j65") pod "c748a01f-ee34-45e3-afca-8d23d8b9d602" (UID: "c748a01f-ee34-45e3-afca-8d23d8b9d602"). InnerVolumeSpecName "kube-api-access-m5j65". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:08:13.631133 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:13.631103    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c748a01f-ee34-45e3-afca-8d23d8b9d602-openshift-service-ca\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:08:13.631133 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:13.631132    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c748a01f-ee34-45e3-afca-8d23d8b9d602-metrics-certs\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:08:13.631337 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:13.631142    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5j65\" (UniqueName: \"kubernetes.io/projected/c748a01f-ee34-45e3-afca-8d23d8b9d602-kube-api-access-m5j65\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:08:13.631337 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:13.631151    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c748a01f-ee34-45e3-afca-8d23d8b9d602-maas-api-tls\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:08:13.878174 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:13.878139    2558 patch_prober.go:28] interesting pod/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 04:08:13.878329 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:13.878236    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br" podUID="00001a2c-a0d6-44e2-b2f2-a46b667c5a26" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 04:08:14.200761 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:14.200734    2558 generic.go:356] "Generic (PLEG): container finished" podID="c748a01f-ee34-45e3-afca-8d23d8b9d602" containerID="c146434a2c82901384eeb03f5ba034faebbd86792d77d836842eeefec6e40fb0" exitCode=0
Sep 11 04:08:14.201165 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:14.200785    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6904f79-6697bf4887-s62h5"
Sep 11 04:08:14.201165 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:14.200816    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6904f79-6697bf4887-s62h5" event={"ID":"c748a01f-ee34-45e3-afca-8d23d8b9d602","Type":"ContainerDied","Data":"c146434a2c82901384eeb03f5ba034faebbd86792d77d836842eeefec6e40fb0"}
Sep 11 04:08:14.201165 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:14.200873    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d6904f79-6697bf4887-s62h5" event={"ID":"c748a01f-ee34-45e3-afca-8d23d8b9d602","Type":"ContainerDied","Data":"61cdce50fef9c8672c1411014aa4840eebe95aeab032d163730a73123f49d347"}
Sep 11 04:08:14.201165 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:14.200898    2558 scope.go:117] "RemoveContainer" containerID="c146434a2c82901384eeb03f5ba034faebbd86792d77d836842eeefec6e40fb0"
Sep 11 04:08:14.210647 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:14.210630    2558 scope.go:117] "RemoveContainer" containerID="c146434a2c82901384eeb03f5ba034faebbd86792d77d836842eeefec6e40fb0"
Sep 11 04:08:14.210923 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:08:14.210900    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c146434a2c82901384eeb03f5ba034faebbd86792d77d836842eeefec6e40fb0\": container with ID starting with c146434a2c82901384eeb03f5ba034faebbd86792d77d836842eeefec6e40fb0 not found: ID does not exist" containerID="c146434a2c82901384eeb03f5ba034faebbd86792d77d836842eeefec6e40fb0"
Sep 11 04:08:14.210980 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:14.210934    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c146434a2c82901384eeb03f5ba034faebbd86792d77d836842eeefec6e40fb0"} err="failed to get container status \"c146434a2c82901384eeb03f5ba034faebbd86792d77d836842eeefec6e40fb0\": rpc error: code = NotFound desc = could not find container \"c146434a2c82901384eeb03f5ba034faebbd86792d77d836842eeefec6e40fb0\": container with ID starting with c146434a2c82901384eeb03f5ba034faebbd86792d77d836842eeefec6e40fb0 not found: ID does not exist"
Sep 11 04:08:14.221237 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:14.221215    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d6904f79-6697bf4887-s62h5"]
Sep 11 04:08:14.223838 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:14.223820    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d6904f79-6697bf4887-s62h5"]
Sep 11 04:08:15.817933 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:15.817856    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c748a01f-ee34-45e3-afca-8d23d8b9d602" path="/var/lib/kubelet/pods/c748a01f-ee34-45e3-afca-8d23d8b9d602/volumes"
Sep 11 04:08:17.397465 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:17.397427    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n"]
Sep 11 04:08:17.397944 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:17.397916    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c748a01f-ee34-45e3-afca-8d23d8b9d602" containerName="maas-api"
Sep 11 04:08:17.397944 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:17.397934    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c748a01f-ee34-45e3-afca-8d23d8b9d602" containerName="maas-api"
Sep 11 04:08:17.398077 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:17.398018    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c748a01f-ee34-45e3-afca-8d23d8b9d602" containerName="maas-api"
Sep 11 04:08:17.401456 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:17.401435    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n"
Sep 11 04:08:17.403802 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:17.403775    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-52e7067f-serving-cert\""
Sep 11 04:08:17.414614 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:17.414584    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n"]
Sep 11 04:08:17.572272 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:17.572235    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6eddfab-ab3a-47e3-8389-dfe1e1273699-openshift-service-ca\") pod \"maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n\" (UID: \"f6eddfab-ab3a-47e3-8389-dfe1e1273699\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n"
Sep 11 04:08:17.572482 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:17.572304    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnpg7\" (UniqueName: \"kubernetes.io/projected/f6eddfab-ab3a-47e3-8389-dfe1e1273699-kube-api-access-pnpg7\") pod \"maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n\" (UID: \"f6eddfab-ab3a-47e3-8389-dfe1e1273699\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n"
Sep 11 04:08:17.572482 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:17.572360    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6eddfab-ab3a-47e3-8389-dfe1e1273699-maas-api-tls\") pod \"maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n\" (UID: \"f6eddfab-ab3a-47e3-8389-dfe1e1273699\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n"
Sep 11 04:08:17.572482 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:17.572419    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6eddfab-ab3a-47e3-8389-dfe1e1273699-metrics-certs\") pod \"maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n\" (UID: \"f6eddfab-ab3a-47e3-8389-dfe1e1273699\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n"
Sep 11 04:08:17.673162 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:17.673085    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnpg7\" (UniqueName: \"kubernetes.io/projected/f6eddfab-ab3a-47e3-8389-dfe1e1273699-kube-api-access-pnpg7\") pod \"maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n\" (UID: \"f6eddfab-ab3a-47e3-8389-dfe1e1273699\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n"
Sep 11 04:08:17.673162 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:17.673134    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6eddfab-ab3a-47e3-8389-dfe1e1273699-maas-api-tls\") pod \"maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n\" (UID: \"f6eddfab-ab3a-47e3-8389-dfe1e1273699\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n"
Sep 11 04:08:17.673162 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:17.673158    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6eddfab-ab3a-47e3-8389-dfe1e1273699-metrics-certs\") pod \"maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n\" (UID: \"f6eddfab-ab3a-47e3-8389-dfe1e1273699\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n"
Sep 11 04:08:17.673402 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:17.673221    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6eddfab-ab3a-47e3-8389-dfe1e1273699-openshift-service-ca\") pod \"maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n\" (UID: \"f6eddfab-ab3a-47e3-8389-dfe1e1273699\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n"
Sep 11 04:08:17.673813 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:17.673790    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6eddfab-ab3a-47e3-8389-dfe1e1273699-openshift-service-ca\") pod \"maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n\" (UID: \"f6eddfab-ab3a-47e3-8389-dfe1e1273699\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n"
Sep 11 04:08:17.675571 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:17.675544    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6eddfab-ab3a-47e3-8389-dfe1e1273699-maas-api-tls\") pod \"maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n\" (UID: \"f6eddfab-ab3a-47e3-8389-dfe1e1273699\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n"
Sep 11 04:08:17.675654 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:17.675605    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6eddfab-ab3a-47e3-8389-dfe1e1273699-metrics-certs\") pod \"maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n\" (UID: \"f6eddfab-ab3a-47e3-8389-dfe1e1273699\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n"
Sep 11 04:08:17.683401 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:17.683363    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnpg7\" (UniqueName: \"kubernetes.io/projected/f6eddfab-ab3a-47e3-8389-dfe1e1273699-kube-api-access-pnpg7\") pod \"maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n\" (UID: \"f6eddfab-ab3a-47e3-8389-dfe1e1273699\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n"
Sep 11 04:08:17.717175 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:17.717152    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n"
Sep 11 04:08:18.008251 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:18.008225    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n"]
Sep 11 04:08:18.009353 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:08:18.009328    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6eddfab_ab3a_47e3_8389_dfe1e1273699.slice/crio-8877c06691d6f00761a4e39df9f581385015a008cc8e4c027e9e5185ef0f8e16 WatchSource:0}: Error finding container 8877c06691d6f00761a4e39df9f581385015a008cc8e4c027e9e5185ef0f8e16: Status 404 returned error can't find the container with id 8877c06691d6f00761a4e39df9f581385015a008cc8e4c027e9e5185ef0f8e16
Sep 11 04:08:18.226101 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:18.226071    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n" event={"ID":"f6eddfab-ab3a-47e3-8389-dfe1e1273699","Type":"ContainerStarted","Data":"8877c06691d6f00761a4e39df9f581385015a008cc8e4c027e9e5185ef0f8e16"}
Sep 11 04:08:18.769015 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:18.768988    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:08:18.885321 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:18.885239    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-workload-certs\") pod \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\" (UID: \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\") "
Sep 11 04:08:18.885321 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:18.885285    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-istio-data\") pod \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\" (UID: \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\") "
Sep 11 04:08:18.885321 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:18.885323    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-istio-envoy\") pod \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\" (UID: \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\") "
Sep 11 04:08:18.885631 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:18.885357    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-workload-socket\") pod \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\" (UID: \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\") "
Sep 11 04:08:18.885631 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:18.885413    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-istio-token\") pod \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\" (UID: \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\") "
Sep 11 04:08:18.885631 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:18.885443    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmts9\" (UniqueName: \"kubernetes.io/projected/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-kube-api-access-nmts9\") pod \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\" (UID: \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\") "
Sep 11 04:08:18.885631 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:18.885526    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-istio-podinfo\") pod \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\" (UID: \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\") "
Sep 11 04:08:18.885631 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:18.885560    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-istiod-ca-cert\") pod \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\" (UID: \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\") "
Sep 11 04:08:18.885631 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:18.885589    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-credential-socket\") pod \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\" (UID: \"00001a2c-a0d6-44e2-b2f2-a46b667c5a26\") "
Sep 11 04:08:18.885631 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:18.885598    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "00001a2c-a0d6-44e2-b2f2-a46b667c5a26" (UID: "00001a2c-a0d6-44e2-b2f2-a46b667c5a26"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:08:18.885631 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:18.885606    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-istio-data" (OuterVolumeSpecName: "istio-data") pod "00001a2c-a0d6-44e2-b2f2-a46b667c5a26" (UID: "00001a2c-a0d6-44e2-b2f2-a46b667c5a26"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:08:18.886011 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:18.885689    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "00001a2c-a0d6-44e2-b2f2-a46b667c5a26" (UID: "00001a2c-a0d6-44e2-b2f2-a46b667c5a26"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:08:18.886011 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:18.885878    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "00001a2c-a0d6-44e2-b2f2-a46b667c5a26" (UID: "00001a2c-a0d6-44e2-b2f2-a46b667c5a26"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:08:18.886011 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:18.885888    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "00001a2c-a0d6-44e2-b2f2-a46b667c5a26" (UID: "00001a2c-a0d6-44e2-b2f2-a46b667c5a26"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:08:18.886011 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:18.885988    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-workload-socket\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:08:18.886011 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:18.886008    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-istiod-ca-cert\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:08:18.886268 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:18.886023    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-credential-socket\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:08:18.886268 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:18.886036    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-workload-certs\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:08:18.886268 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:18.886050    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-istio-data\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:08:18.887696 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:18.887667    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-kube-api-access-nmts9" (OuterVolumeSpecName: "kube-api-access-nmts9") pod "00001a2c-a0d6-44e2-b2f2-a46b667c5a26" (UID: "00001a2c-a0d6-44e2-b2f2-a46b667c5a26"). InnerVolumeSpecName "kube-api-access-nmts9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:08:18.887816 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:18.887723    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-istio-token" (OuterVolumeSpecName: "istio-token") pod "00001a2c-a0d6-44e2-b2f2-a46b667c5a26" (UID: "00001a2c-a0d6-44e2-b2f2-a46b667c5a26"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:08:18.887816 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:18.887724    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "00001a2c-a0d6-44e2-b2f2-a46b667c5a26" (UID: "00001a2c-a0d6-44e2-b2f2-a46b667c5a26"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:08:18.887816 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:18.887776    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "00001a2c-a0d6-44e2-b2f2-a46b667c5a26" (UID: "00001a2c-a0d6-44e2-b2f2-a46b667c5a26"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 04:08:18.987204 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:18.987170    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-istio-token\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:08:18.987204 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:18.987198    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmts9\" (UniqueName: \"kubernetes.io/projected/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-kube-api-access-nmts9\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:08:18.987378 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:18.987212    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-istio-podinfo\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:08:18.987378 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:18.987226    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00001a2c-a0d6-44e2-b2f2-a46b667c5a26-istio-envoy\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:08:19.233946 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:19.233820    2558 generic.go:356] "Generic (PLEG): container finished" podID="00001a2c-a0d6-44e2-b2f2-a46b667c5a26" containerID="bbd51c6dc0f56ca73b40736fc422ba34dc0eb1bb120a64365ddea4180ad85cb0" exitCode=0
Sep 11 04:08:19.233946 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:19.233876    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"
Sep 11 04:08:19.233946 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:19.233914    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br" event={"ID":"00001a2c-a0d6-44e2-b2f2-a46b667c5a26","Type":"ContainerDied","Data":"bbd51c6dc0f56ca73b40736fc422ba34dc0eb1bb120a64365ddea4180ad85cb0"}
Sep 11 04:08:19.234191 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:19.233976    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br" event={"ID":"00001a2c-a0d6-44e2-b2f2-a46b667c5a26","Type":"ContainerDied","Data":"c4b745f5d550606608f8d5c9243533610bcc2bdb4c111b430389db153ea753f2"}
Sep 11 04:08:19.234191 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:19.234007    2558 scope.go:117] "RemoveContainer" containerID="bbd51c6dc0f56ca73b40736fc422ba34dc0eb1bb120a64365ddea4180ad85cb0"
Sep 11 04:08:19.235938 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:19.235911    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n" event={"ID":"f6eddfab-ab3a-47e3-8389-dfe1e1273699","Type":"ContainerStarted","Data":"df01d71af09ebd0e865c4ea8af6738ed7d725b423baeb19227f87c8f6b6d12a0"}
Sep 11 04:08:19.236049 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:19.235975    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n"
Sep 11 04:08:19.243878 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:19.243862    2558 scope.go:117] "RemoveContainer" containerID="ebce45bb5eacdfe7c91b1e12a0d86e3214681f23a4d2e4e3dd67e0138a7ccf27"
Sep 11 04:08:19.251981 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:19.251965    2558 scope.go:117] "RemoveContainer" containerID="bbd51c6dc0f56ca73b40736fc422ba34dc0eb1bb120a64365ddea4180ad85cb0"
Sep 11 04:08:19.252240 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:08:19.252223    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbd51c6dc0f56ca73b40736fc422ba34dc0eb1bb120a64365ddea4180ad85cb0\": container with ID starting with bbd51c6dc0f56ca73b40736fc422ba34dc0eb1bb120a64365ddea4180ad85cb0 not found: ID does not exist" containerID="bbd51c6dc0f56ca73b40736fc422ba34dc0eb1bb120a64365ddea4180ad85cb0"
Sep 11 04:08:19.252288 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:19.252248    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbd51c6dc0f56ca73b40736fc422ba34dc0eb1bb120a64365ddea4180ad85cb0"} err="failed to get container status \"bbd51c6dc0f56ca73b40736fc422ba34dc0eb1bb120a64365ddea4180ad85cb0\": rpc error: code = NotFound desc = could not find container \"bbd51c6dc0f56ca73b40736fc422ba34dc0eb1bb120a64365ddea4180ad85cb0\": container with ID starting with bbd51c6dc0f56ca73b40736fc422ba34dc0eb1bb120a64365ddea4180ad85cb0 not found: ID does not exist"
Sep 11 04:08:19.252288 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:19.252263    2558 scope.go:117] "RemoveContainer" containerID="ebce45bb5eacdfe7c91b1e12a0d86e3214681f23a4d2e4e3dd67e0138a7ccf27"
Sep 11 04:08:19.252524 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:08:19.252503    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebce45bb5eacdfe7c91b1e12a0d86e3214681f23a4d2e4e3dd67e0138a7ccf27\": container with ID starting with ebce45bb5eacdfe7c91b1e12a0d86e3214681f23a4d2e4e3dd67e0138a7ccf27 not found: ID does not exist" containerID="ebce45bb5eacdfe7c91b1e12a0d86e3214681f23a4d2e4e3dd67e0138a7ccf27"
Sep 11 04:08:19.252590 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:19.252531    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebce45bb5eacdfe7c91b1e12a0d86e3214681f23a4d2e4e3dd67e0138a7ccf27"} err="failed to get container status \"ebce45bb5eacdfe7c91b1e12a0d86e3214681f23a4d2e4e3dd67e0138a7ccf27\": rpc error: code = NotFound desc = could not find container \"ebce45bb5eacdfe7c91b1e12a0d86e3214681f23a4d2e4e3dd67e0138a7ccf27\": container with ID starting with ebce45bb5eacdfe7c91b1e12a0d86e3214681f23a4d2e4e3dd67e0138a7ccf27 not found: ID does not exist"
Sep 11 04:08:19.291727 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:19.291677    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n" podStartSLOduration=2.005077686 podStartE2EDuration="2.291663018s" totalImagesPullingTime="286.585332ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:08:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:08:19.28976189 +0000 UTC m=+896.087851619" watchObservedRunningTime="2026-09-11 04:08:19.291663018 +0000 UTC m=+896.089752745"
Sep 11 04:08:19.338962 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:19.338926    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"]
Sep 11 04:08:19.341396 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:19.341365    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br"]
Sep 11 04:08:19.810342 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:19.810308    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00001a2c-a0d6-44e2-b2f2-a46b667c5a26" path="/var/lib/kubelet/pods/00001a2c-a0d6-44e2-b2f2-a46b667c5a26/volumes"
Sep 11 04:08:22.505914 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:22.505885    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:08:23.773686 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:23.773658    2558 scope.go:117] "RemoveContainer" containerID="4d524103a3bb9444d04dcc2688216c93a86d539a4ef0d7a152d053ac174e9290"
Sep 11 04:08:23.774487 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:23.774465    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nfssn_c9add74a-5c51-4ccf-9edd-3b90a66b9ef9/ovn-acl-logging/0.log"
Sep 11 04:08:23.774636 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:23.774472    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nfssn_c9add74a-5c51-4ccf-9edd-3b90a66b9ef9/ovn-acl-logging/0.log"
Sep 11 04:08:25.248401 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:25.248360    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n"
Sep 11 04:08:40.202373 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:40.202336    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:08:57.701455 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:57.701422    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:08:59.258240 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:59.258197    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n"]
Sep 11 04:08:59.258705 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:59.258492    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n" podUID="f6eddfab-ab3a-47e3-8389-dfe1e1273699" containerName="maas-api" containerID="cri-o://df01d71af09ebd0e865c4ea8af6738ed7d725b423baeb19227f87c8f6b6d12a0" gracePeriod=30
Sep 11 04:08:59.461967 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:59.461931    2558 generic.go:356] "Generic (PLEG): container finished" podID="f6eddfab-ab3a-47e3-8389-dfe1e1273699" containerID="df01d71af09ebd0e865c4ea8af6738ed7d725b423baeb19227f87c8f6b6d12a0" exitCode=0
Sep 11 04:08:59.462146 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:59.461965    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n" event={"ID":"f6eddfab-ab3a-47e3-8389-dfe1e1273699","Type":"ContainerDied","Data":"df01d71af09ebd0e865c4ea8af6738ed7d725b423baeb19227f87c8f6b6d12a0"}
Sep 11 04:08:59.519366 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:59.519312    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n"
Sep 11 04:08:59.642244 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:59.642211    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6eddfab-ab3a-47e3-8389-dfe1e1273699-openshift-service-ca\") pod \"f6eddfab-ab3a-47e3-8389-dfe1e1273699\" (UID: \"f6eddfab-ab3a-47e3-8389-dfe1e1273699\") "
Sep 11 04:08:59.642438 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:59.642251    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6eddfab-ab3a-47e3-8389-dfe1e1273699-maas-api-tls\") pod \"f6eddfab-ab3a-47e3-8389-dfe1e1273699\" (UID: \"f6eddfab-ab3a-47e3-8389-dfe1e1273699\") "
Sep 11 04:08:59.642438 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:59.642292    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnpg7\" (UniqueName: \"kubernetes.io/projected/f6eddfab-ab3a-47e3-8389-dfe1e1273699-kube-api-access-pnpg7\") pod \"f6eddfab-ab3a-47e3-8389-dfe1e1273699\" (UID: \"f6eddfab-ab3a-47e3-8389-dfe1e1273699\") "
Sep 11 04:08:59.642438 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:59.642336    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6eddfab-ab3a-47e3-8389-dfe1e1273699-metrics-certs\") pod \"f6eddfab-ab3a-47e3-8389-dfe1e1273699\" (UID: \"f6eddfab-ab3a-47e3-8389-dfe1e1273699\") "
Sep 11 04:08:59.642646 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:59.642617    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6eddfab-ab3a-47e3-8389-dfe1e1273699-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f6eddfab-ab3a-47e3-8389-dfe1e1273699" (UID: "f6eddfab-ab3a-47e3-8389-dfe1e1273699"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:08:59.642797 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:59.642773    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6eddfab-ab3a-47e3-8389-dfe1e1273699-openshift-service-ca\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:08:59.644376 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:59.644348    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6eddfab-ab3a-47e3-8389-dfe1e1273699-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f6eddfab-ab3a-47e3-8389-dfe1e1273699" (UID: "f6eddfab-ab3a-47e3-8389-dfe1e1273699"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:08:59.644597 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:59.644561    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6eddfab-ab3a-47e3-8389-dfe1e1273699-kube-api-access-pnpg7" (OuterVolumeSpecName: "kube-api-access-pnpg7") pod "f6eddfab-ab3a-47e3-8389-dfe1e1273699" (UID: "f6eddfab-ab3a-47e3-8389-dfe1e1273699"). InnerVolumeSpecName "kube-api-access-pnpg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:08:59.644658 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:59.644633    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6eddfab-ab3a-47e3-8389-dfe1e1273699-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f6eddfab-ab3a-47e3-8389-dfe1e1273699" (UID: "f6eddfab-ab3a-47e3-8389-dfe1e1273699"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:08:59.744088 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:59.744058    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6eddfab-ab3a-47e3-8389-dfe1e1273699-maas-api-tls\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:08:59.744088 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:59.744085    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnpg7\" (UniqueName: \"kubernetes.io/projected/f6eddfab-ab3a-47e3-8389-dfe1e1273699-kube-api-access-pnpg7\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:08:59.744272 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:08:59.744096    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6eddfab-ab3a-47e3-8389-dfe1e1273699-metrics-certs\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:09:00.468683 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.468656    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n"
Sep 11 04:09:00.469063 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.468653    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n" event={"ID":"f6eddfab-ab3a-47e3-8389-dfe1e1273699","Type":"ContainerDied","Data":"8877c06691d6f00761a4e39df9f581385015a008cc8e4c027e9e5185ef0f8e16"}
Sep 11 04:09:00.469063 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.468789    2558 scope.go:117] "RemoveContainer" containerID="df01d71af09ebd0e865c4ea8af6738ed7d725b423baeb19227f87c8f6b6d12a0"
Sep 11 04:09:00.513511 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.513489    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n"]
Sep 11 04:09:00.515662 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.515643    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-52e7067f-59d6b5fc7-2822n"]
Sep 11 04:09:00.695826 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.695797    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"]
Sep 11 04:09:00.696171 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.696159    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00001a2c-a0d6-44e2-b2f2-a46b667c5a26" containerName="istio-proxy"
Sep 11 04:09:00.696228 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.696173    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="00001a2c-a0d6-44e2-b2f2-a46b667c5a26" containerName="istio-proxy"
Sep 11 04:09:00.696228 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.696192    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6eddfab-ab3a-47e3-8389-dfe1e1273699" containerName="maas-api"
Sep 11 04:09:00.696228 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.696197    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6eddfab-ab3a-47e3-8389-dfe1e1273699" containerName="maas-api"
Sep 11 04:09:00.696327 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.696256    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="00001a2c-a0d6-44e2-b2f2-a46b667c5a26" containerName="istio-proxy"
Sep 11 04:09:00.696327 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.696265    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="00001a2c-a0d6-44e2-b2f2-a46b667c5a26" containerName="istio-proxy"
Sep 11 04:09:00.696327 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.696275    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6eddfab-ab3a-47e3-8389-dfe1e1273699" containerName="maas-api"
Sep 11 04:09:00.698907 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.698888    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:00.707958 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.707937    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-26814939-openshift-default-dockercfg-4mcm4\""
Sep 11 04:09:00.739824 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.739765    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"]
Sep 11 04:09:00.852989 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.852957    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/493b6ba1-140e-4e8e-9e16-12920ba58d5e-istio-data\") pod \"e2e-ait-26814939-openshift-default-5f6898cb96-gppjg\" (UID: \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\") " pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:00.853141 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.853002    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/493b6ba1-140e-4e8e-9e16-12920ba58d5e-istiod-ca-cert\") pod \"e2e-ait-26814939-openshift-default-5f6898cb96-gppjg\" (UID: \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\") " pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:00.853141 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.853064    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/493b6ba1-140e-4e8e-9e16-12920ba58d5e-istio-envoy\") pod \"e2e-ait-26814939-openshift-default-5f6898cb96-gppjg\" (UID: \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\") " pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:00.853219 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.853147    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/493b6ba1-140e-4e8e-9e16-12920ba58d5e-credential-socket\") pod \"e2e-ait-26814939-openshift-default-5f6898cb96-gppjg\" (UID: \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\") " pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:00.853219 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.853168    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/493b6ba1-140e-4e8e-9e16-12920ba58d5e-istio-podinfo\") pod \"e2e-ait-26814939-openshift-default-5f6898cb96-gppjg\" (UID: \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\") " pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:00.853219 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.853190    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/493b6ba1-140e-4e8e-9e16-12920ba58d5e-workload-certs\") pod \"e2e-ait-26814939-openshift-default-5f6898cb96-gppjg\" (UID: \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\") " pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:00.853219 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.853213    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/493b6ba1-140e-4e8e-9e16-12920ba58d5e-istio-token\") pod \"e2e-ait-26814939-openshift-default-5f6898cb96-gppjg\" (UID: \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\") " pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:00.853436 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.853235    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r2wb\" (UniqueName: \"kubernetes.io/projected/493b6ba1-140e-4e8e-9e16-12920ba58d5e-kube-api-access-2r2wb\") pod \"e2e-ait-26814939-openshift-default-5f6898cb96-gppjg\" (UID: \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\") " pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:00.853436 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.853314    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/493b6ba1-140e-4e8e-9e16-12920ba58d5e-workload-socket\") pod \"e2e-ait-26814939-openshift-default-5f6898cb96-gppjg\" (UID: \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\") " pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:00.953890 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.953859    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/493b6ba1-140e-4e8e-9e16-12920ba58d5e-credential-socket\") pod \"e2e-ait-26814939-openshift-default-5f6898cb96-gppjg\" (UID: \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\") " pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:00.953890 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.953891    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/493b6ba1-140e-4e8e-9e16-12920ba58d5e-istio-podinfo\") pod \"e2e-ait-26814939-openshift-default-5f6898cb96-gppjg\" (UID: \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\") " pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:00.954070 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.953910    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/493b6ba1-140e-4e8e-9e16-12920ba58d5e-workload-certs\") pod \"e2e-ait-26814939-openshift-default-5f6898cb96-gppjg\" (UID: \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\") " pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:00.954070 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.953929    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/493b6ba1-140e-4e8e-9e16-12920ba58d5e-istio-token\") pod \"e2e-ait-26814939-openshift-default-5f6898cb96-gppjg\" (UID: \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\") " pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:00.954070 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.953957    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r2wb\" (UniqueName: \"kubernetes.io/projected/493b6ba1-140e-4e8e-9e16-12920ba58d5e-kube-api-access-2r2wb\") pod \"e2e-ait-26814939-openshift-default-5f6898cb96-gppjg\" (UID: \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\") " pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:00.954070 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.953984    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/493b6ba1-140e-4e8e-9e16-12920ba58d5e-workload-socket\") pod \"e2e-ait-26814939-openshift-default-5f6898cb96-gppjg\" (UID: \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\") " pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:00.954070 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.954057    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/493b6ba1-140e-4e8e-9e16-12920ba58d5e-istio-data\") pod \"e2e-ait-26814939-openshift-default-5f6898cb96-gppjg\" (UID: \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\") " pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:00.954333 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.954112    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/493b6ba1-140e-4e8e-9e16-12920ba58d5e-istiod-ca-cert\") pod \"e2e-ait-26814939-openshift-default-5f6898cb96-gppjg\" (UID: \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\") " pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:00.954333 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.954142    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/493b6ba1-140e-4e8e-9e16-12920ba58d5e-istio-envoy\") pod \"e2e-ait-26814939-openshift-default-5f6898cb96-gppjg\" (UID: \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\") " pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:00.954333 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.954301    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/493b6ba1-140e-4e8e-9e16-12920ba58d5e-workload-certs\") pod \"e2e-ait-26814939-openshift-default-5f6898cb96-gppjg\" (UID: \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\") " pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:00.954333 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.954320    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/493b6ba1-140e-4e8e-9e16-12920ba58d5e-credential-socket\") pod \"e2e-ait-26814939-openshift-default-5f6898cb96-gppjg\" (UID: \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\") " pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:00.954551 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.954450    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/493b6ba1-140e-4e8e-9e16-12920ba58d5e-workload-socket\") pod \"e2e-ait-26814939-openshift-default-5f6898cb96-gppjg\" (UID: \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\") " pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:00.954551 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.954539    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/493b6ba1-140e-4e8e-9e16-12920ba58d5e-istio-data\") pod \"e2e-ait-26814939-openshift-default-5f6898cb96-gppjg\" (UID: \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\") " pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:00.955005 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.954985    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/493b6ba1-140e-4e8e-9e16-12920ba58d5e-istiod-ca-cert\") pod \"e2e-ait-26814939-openshift-default-5f6898cb96-gppjg\" (UID: \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\") " pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:00.956316 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.956295    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/493b6ba1-140e-4e8e-9e16-12920ba58d5e-istio-envoy\") pod \"e2e-ait-26814939-openshift-default-5f6898cb96-gppjg\" (UID: \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\") " pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:00.956727 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.956706    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/493b6ba1-140e-4e8e-9e16-12920ba58d5e-istio-podinfo\") pod \"e2e-ait-26814939-openshift-default-5f6898cb96-gppjg\" (UID: \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\") " pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:00.973142 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.973117    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/493b6ba1-140e-4e8e-9e16-12920ba58d5e-istio-token\") pod \"e2e-ait-26814939-openshift-default-5f6898cb96-gppjg\" (UID: \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\") " pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:00.973259 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:00.973164    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r2wb\" (UniqueName: \"kubernetes.io/projected/493b6ba1-140e-4e8e-9e16-12920ba58d5e-kube-api-access-2r2wb\") pod \"e2e-ait-26814939-openshift-default-5f6898cb96-gppjg\" (UID: \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\") " pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:01.008826 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:01.008770    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:01.304284 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:01.304257    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"]
Sep 11 04:09:01.305923 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:09:01.305899    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod493b6ba1_140e_4e8e_9e16_12920ba58d5e.slice/crio-46cf2e1078a5fc217b27b4421d87d4a4ba06cf964fbab6492e266fb75be97d4d WatchSource:0}: Error finding container 46cf2e1078a5fc217b27b4421d87d4a4ba06cf964fbab6492e266fb75be97d4d: Status 404 returned error can't find the container with id 46cf2e1078a5fc217b27b4421d87d4a4ba06cf964fbab6492e266fb75be97d4d
Sep 11 04:09:01.307940 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:01.307910    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:09:01.308020 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:01.307973    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:09:01.308020 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:01.308002    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:09:01.477325 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:01.477287    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg" event={"ID":"493b6ba1-140e-4e8e-9e16-12920ba58d5e","Type":"ContainerStarted","Data":"e664cd3647c71b295311b8ebb6da72aea38484a4e09995b7030f977478978f02"}
Sep 11 04:09:01.477701 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:01.477348    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg" event={"ID":"493b6ba1-140e-4e8e-9e16-12920ba58d5e","Type":"ContainerStarted","Data":"46cf2e1078a5fc217b27b4421d87d4a4ba06cf964fbab6492e266fb75be97d4d"}
Sep 11 04:09:01.508439 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:01.508374    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg" podStartSLOduration=1.508360761 podStartE2EDuration="1.508360761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:09:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:09:01.50697059 +0000 UTC m=+938.305060316" watchObservedRunningTime="2026-09-11 04:09:01.508360761 +0000 UTC m=+938.306450533"
Sep 11 04:09:01.810716 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:01.810680    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6eddfab-ab3a-47e3-8389-dfe1e1273699" path="/var/lib/kubelet/pods/f6eddfab-ab3a-47e3-8389-dfe1e1273699/volumes"
Sep 11 04:09:02.009747 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:02.009722    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:02.014280 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:02.014252    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:02.483055 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:02.483023    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:02.484264 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:02.484238    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:04.022536 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:04.022502    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-26814939-6f47954b48-tfxhc"]
Sep 11 04:09:04.023012 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:04.022853    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00001a2c-a0d6-44e2-b2f2-a46b667c5a26" containerName="istio-proxy"
Sep 11 04:09:04.023012 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:04.022864    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="00001a2c-a0d6-44e2-b2f2-a46b667c5a26" containerName="istio-proxy"
Sep 11 04:09:04.030747 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:04.030718    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-26814939-6f47954b48-tfxhc"
Sep 11 04:09:04.033546 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:04.033523    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-26814939-serving-cert\""
Sep 11 04:09:04.046976 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:04.046950    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-26814939-6f47954b48-tfxhc"]
Sep 11 04:09:04.185575 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:04.185543    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b483f4ba-ec98-4abd-808b-42d66512a157-maas-api-tls\") pod \"maas-api-e2e-ait-26814939-6f47954b48-tfxhc\" (UID: \"b483f4ba-ec98-4abd-808b-42d66512a157\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-26814939-6f47954b48-tfxhc"
Sep 11 04:09:04.185731 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:04.185607    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnhn5\" (UniqueName: \"kubernetes.io/projected/b483f4ba-ec98-4abd-808b-42d66512a157-kube-api-access-pnhn5\") pod \"maas-api-e2e-ait-26814939-6f47954b48-tfxhc\" (UID: \"b483f4ba-ec98-4abd-808b-42d66512a157\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-26814939-6f47954b48-tfxhc"
Sep 11 04:09:04.185731 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:04.185649    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b483f4ba-ec98-4abd-808b-42d66512a157-openshift-service-ca\") pod \"maas-api-e2e-ait-26814939-6f47954b48-tfxhc\" (UID: \"b483f4ba-ec98-4abd-808b-42d66512a157\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-26814939-6f47954b48-tfxhc"
Sep 11 04:09:04.185731 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:04.185680    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b483f4ba-ec98-4abd-808b-42d66512a157-metrics-certs\") pod \"maas-api-e2e-ait-26814939-6f47954b48-tfxhc\" (UID: \"b483f4ba-ec98-4abd-808b-42d66512a157\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-26814939-6f47954b48-tfxhc"
Sep 11 04:09:04.286676 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:04.286599    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnhn5\" (UniqueName: \"kubernetes.io/projected/b483f4ba-ec98-4abd-808b-42d66512a157-kube-api-access-pnhn5\") pod \"maas-api-e2e-ait-26814939-6f47954b48-tfxhc\" (UID: \"b483f4ba-ec98-4abd-808b-42d66512a157\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-26814939-6f47954b48-tfxhc"
Sep 11 04:09:04.286676 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:04.286659    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b483f4ba-ec98-4abd-808b-42d66512a157-openshift-service-ca\") pod \"maas-api-e2e-ait-26814939-6f47954b48-tfxhc\" (UID: \"b483f4ba-ec98-4abd-808b-42d66512a157\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-26814939-6f47954b48-tfxhc"
Sep 11 04:09:04.286880 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:04.286690    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b483f4ba-ec98-4abd-808b-42d66512a157-metrics-certs\") pod \"maas-api-e2e-ait-26814939-6f47954b48-tfxhc\" (UID: \"b483f4ba-ec98-4abd-808b-42d66512a157\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-26814939-6f47954b48-tfxhc"
Sep 11 04:09:04.286880 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:04.286737    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b483f4ba-ec98-4abd-808b-42d66512a157-maas-api-tls\") pod \"maas-api-e2e-ait-26814939-6f47954b48-tfxhc\" (UID: \"b483f4ba-ec98-4abd-808b-42d66512a157\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-26814939-6f47954b48-tfxhc"
Sep 11 04:09:04.286880 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:09:04.286827    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-26814939-serving-cert: secret "maas-api-e2e-ait-26814939-serving-cert" not found
Sep 11 04:09:04.286880 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:09:04.286873    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b483f4ba-ec98-4abd-808b-42d66512a157-maas-api-tls podName:b483f4ba-ec98-4abd-808b-42d66512a157 nodeName:}" failed. No retries permitted until 2026-09-11 04:09:04.786858303 +0000 UTC m=+941.584948009 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b483f4ba-ec98-4abd-808b-42d66512a157-maas-api-tls") pod "maas-api-e2e-ait-26814939-6f47954b48-tfxhc" (UID: "b483f4ba-ec98-4abd-808b-42d66512a157") : secret "maas-api-e2e-ait-26814939-serving-cert" not found
Sep 11 04:09:04.287319 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:04.287295    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b483f4ba-ec98-4abd-808b-42d66512a157-openshift-service-ca\") pod \"maas-api-e2e-ait-26814939-6f47954b48-tfxhc\" (UID: \"b483f4ba-ec98-4abd-808b-42d66512a157\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-26814939-6f47954b48-tfxhc"
Sep 11 04:09:04.289217 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:04.289194    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b483f4ba-ec98-4abd-808b-42d66512a157-metrics-certs\") pod \"maas-api-e2e-ait-26814939-6f47954b48-tfxhc\" (UID: \"b483f4ba-ec98-4abd-808b-42d66512a157\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-26814939-6f47954b48-tfxhc"
Sep 11 04:09:04.298261 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:04.298241    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnhn5\" (UniqueName: \"kubernetes.io/projected/b483f4ba-ec98-4abd-808b-42d66512a157-kube-api-access-pnhn5\") pod \"maas-api-e2e-ait-26814939-6f47954b48-tfxhc\" (UID: \"b483f4ba-ec98-4abd-808b-42d66512a157\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-26814939-6f47954b48-tfxhc"
Sep 11 04:09:04.791453 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:04.791421    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b483f4ba-ec98-4abd-808b-42d66512a157-maas-api-tls\") pod \"maas-api-e2e-ait-26814939-6f47954b48-tfxhc\" (UID: \"b483f4ba-ec98-4abd-808b-42d66512a157\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-26814939-6f47954b48-tfxhc"
Sep 11 04:09:04.793839 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:04.793813    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b483f4ba-ec98-4abd-808b-42d66512a157-maas-api-tls\") pod \"maas-api-e2e-ait-26814939-6f47954b48-tfxhc\" (UID: \"b483f4ba-ec98-4abd-808b-42d66512a157\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-26814939-6f47954b48-tfxhc"
Sep 11 04:09:04.941454 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:04.941420    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-26814939-6f47954b48-tfxhc"
Sep 11 04:09:05.238502 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:05.238478    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-26814939-6f47954b48-tfxhc"]
Sep 11 04:09:05.240077 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:09:05.240055    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb483f4ba_ec98_4abd_808b_42d66512a157.slice/crio-68fa8a71f9506b7a2140d09abdd3f2681ee4a5c436565896933aa1d3cc5329ab WatchSource:0}: Error finding container 68fa8a71f9506b7a2140d09abdd3f2681ee4a5c436565896933aa1d3cc5329ab: Status 404 returned error can't find the container with id 68fa8a71f9506b7a2140d09abdd3f2681ee4a5c436565896933aa1d3cc5329ab
Sep 11 04:09:05.241559 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:05.241515    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 04:09:05.502571 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:05.502496    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-26814939-6f47954b48-tfxhc" event={"ID":"b483f4ba-ec98-4abd-808b-42d66512a157","Type":"ContainerStarted","Data":"68fa8a71f9506b7a2140d09abdd3f2681ee4a5c436565896933aa1d3cc5329ab"}
Sep 11 04:09:06.509761 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:06.509713    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-26814939-6f47954b48-tfxhc" event={"ID":"b483f4ba-ec98-4abd-808b-42d66512a157","Type":"ContainerStarted","Data":"1440282b668800e1e9397eef8155ea0bc1d08dfc24c06c1882aeca2198528b11"}
Sep 11 04:09:06.510199 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:06.509798    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-26814939-6f47954b48-tfxhc"
Sep 11 04:09:06.535664 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:06.535600    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-26814939-6f47954b48-tfxhc" podStartSLOduration=2.997351283 podStartE2EDuration="3.535582345s" totalImagesPullingTime="538.231062ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:09:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:09:06.532065737 +0000 UTC m=+943.330155468" watchObservedRunningTime="2026-09-11 04:09:06.535582345 +0000 UTC m=+943.333672072"
Sep 11 04:09:12.520328 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:12.520296    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-26814939-6f47954b48-tfxhc"
Sep 11 04:09:12.804609 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:12.804523    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:09:23.606666 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:23.606632    2558 generic.go:356] "Generic (PLEG): container finished" podID="493b6ba1-140e-4e8e-9e16-12920ba58d5e" containerID="e664cd3647c71b295311b8ebb6da72aea38484a4e09995b7030f977478978f02" exitCode=0
Sep 11 04:09:23.607051 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:23.606704    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg" event={"ID":"493b6ba1-140e-4e8e-9e16-12920ba58d5e","Type":"ContainerDied","Data":"e664cd3647c71b295311b8ebb6da72aea38484a4e09995b7030f977478978f02"}
Sep 11 04:09:23.607097 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:23.607085    2558 scope.go:117] "RemoveContainer" containerID="e664cd3647c71b295311b8ebb6da72aea38484a4e09995b7030f977478978f02"
Sep 11 04:09:23.608179 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:23.608148    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:09:23.608250 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:23.608234    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:09:23.608287 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:23.608273    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:09:24.614504 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:24.614464    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg" event={"ID":"493b6ba1-140e-4e8e-9e16-12920ba58d5e","Type":"ContainerStarted","Data":"ff8f88dce45feb0ebd60ab3d4a4248f875c2a04ce98f174a24bb5af74c010bf7"}
Sep 11 04:09:25.009190 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:25.009102    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:25.009340 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:25.009282    2558 patch_prober.go:28] interesting pod/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 11 04:09:25.009340 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:25.009321    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg" podUID="493b6ba1-140e-4e8e-9e16-12920ba58d5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 11 04:09:26.009733 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:26.009699    2558 patch_prober.go:28] interesting pod/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 11 04:09:26.010093 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:26.009759    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg" podUID="493b6ba1-140e-4e8e-9e16-12920ba58d5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 11 04:09:27.010024 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:27.009989    2558 patch_prober.go:28] interesting pod/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 11 04:09:27.010416 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:27.010054    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg" podUID="493b6ba1-140e-4e8e-9e16-12920ba58d5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 11 04:09:28.009459 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:28.009425    2558 patch_prober.go:28] interesting pod/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 11 04:09:28.009635 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:28.009489    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg" podUID="493b6ba1-140e-4e8e-9e16-12920ba58d5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 11 04:09:29.009434 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:29.009375    2558 patch_prober.go:28] interesting pod/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 11 04:09:29.009950 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:29.009467    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg" podUID="493b6ba1-140e-4e8e-9e16-12920ba58d5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 11 04:09:30.009381 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:30.009333    2558 patch_prober.go:28] interesting pod/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 11 04:09:30.009580 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:30.009423    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg" podUID="493b6ba1-140e-4e8e-9e16-12920ba58d5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 11 04:09:30.813007 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:30.812971    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:09:31.014149 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:31.014122    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:31.014602 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:31.014426    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:31.015337 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:31.015319    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:34.649989 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:34.649960    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-26814939-6f47954b48-tfxhc"]
Sep 11 04:09:34.650345 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:34.650153    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-26814939-6f47954b48-tfxhc" podUID="b483f4ba-ec98-4abd-808b-42d66512a157" containerName="maas-api" containerID="cri-o://1440282b668800e1e9397eef8155ea0bc1d08dfc24c06c1882aeca2198528b11" gracePeriod=30
Sep 11 04:09:34.917225 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:34.917201    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-26814939-6f47954b48-tfxhc"
Sep 11 04:09:35.010973 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:35.010935    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b483f4ba-ec98-4abd-808b-42d66512a157-openshift-service-ca\") pod \"b483f4ba-ec98-4abd-808b-42d66512a157\" (UID: \"b483f4ba-ec98-4abd-808b-42d66512a157\") "
Sep 11 04:09:35.011224 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:35.011000    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b483f4ba-ec98-4abd-808b-42d66512a157-metrics-certs\") pod \"b483f4ba-ec98-4abd-808b-42d66512a157\" (UID: \"b483f4ba-ec98-4abd-808b-42d66512a157\") "
Sep 11 04:09:35.011224 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:35.011101    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnhn5\" (UniqueName: \"kubernetes.io/projected/b483f4ba-ec98-4abd-808b-42d66512a157-kube-api-access-pnhn5\") pod \"b483f4ba-ec98-4abd-808b-42d66512a157\" (UID: \"b483f4ba-ec98-4abd-808b-42d66512a157\") "
Sep 11 04:09:35.011224 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:35.011169    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b483f4ba-ec98-4abd-808b-42d66512a157-maas-api-tls\") pod \"b483f4ba-ec98-4abd-808b-42d66512a157\" (UID: \"b483f4ba-ec98-4abd-808b-42d66512a157\") "
Sep 11 04:09:35.011474 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:35.011375    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b483f4ba-ec98-4abd-808b-42d66512a157-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b483f4ba-ec98-4abd-808b-42d66512a157" (UID: "b483f4ba-ec98-4abd-808b-42d66512a157"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:09:35.011756 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:35.011711    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b483f4ba-ec98-4abd-808b-42d66512a157-openshift-service-ca\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:09:35.013329 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:35.013302    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b483f4ba-ec98-4abd-808b-42d66512a157-kube-api-access-pnhn5" (OuterVolumeSpecName: "kube-api-access-pnhn5") pod "b483f4ba-ec98-4abd-808b-42d66512a157" (UID: "b483f4ba-ec98-4abd-808b-42d66512a157"). InnerVolumeSpecName "kube-api-access-pnhn5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:09:35.013622 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:35.013603    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b483f4ba-ec98-4abd-808b-42d66512a157-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b483f4ba-ec98-4abd-808b-42d66512a157" (UID: "b483f4ba-ec98-4abd-808b-42d66512a157"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:09:35.013713 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:35.013653    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b483f4ba-ec98-4abd-808b-42d66512a157-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b483f4ba-ec98-4abd-808b-42d66512a157" (UID: "b483f4ba-ec98-4abd-808b-42d66512a157"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:09:35.113146 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:35.113110    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b483f4ba-ec98-4abd-808b-42d66512a157-maas-api-tls\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:09:35.113146 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:35.113137    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b483f4ba-ec98-4abd-808b-42d66512a157-metrics-certs\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:09:35.113146 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:35.113146    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnhn5\" (UniqueName: \"kubernetes.io/projected/b483f4ba-ec98-4abd-808b-42d66512a157-kube-api-access-pnhn5\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:09:35.686906 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:35.686873    2558 generic.go:356] "Generic (PLEG): container finished" podID="b483f4ba-ec98-4abd-808b-42d66512a157" containerID="1440282b668800e1e9397eef8155ea0bc1d08dfc24c06c1882aeca2198528b11" exitCode=0
Sep 11 04:09:35.687269 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:35.686927    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-26814939-6f47954b48-tfxhc"
Sep 11 04:09:35.687269 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:35.686956    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-26814939-6f47954b48-tfxhc" event={"ID":"b483f4ba-ec98-4abd-808b-42d66512a157","Type":"ContainerDied","Data":"1440282b668800e1e9397eef8155ea0bc1d08dfc24c06c1882aeca2198528b11"}
Sep 11 04:09:35.687269 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:35.687039    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-26814939-6f47954b48-tfxhc" event={"ID":"b483f4ba-ec98-4abd-808b-42d66512a157","Type":"ContainerDied","Data":"68fa8a71f9506b7a2140d09abdd3f2681ee4a5c436565896933aa1d3cc5329ab"}
Sep 11 04:09:35.687269 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:35.687063    2558 scope.go:117] "RemoveContainer" containerID="1440282b668800e1e9397eef8155ea0bc1d08dfc24c06c1882aeca2198528b11"
Sep 11 04:09:35.697065 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:35.697049    2558 scope.go:117] "RemoveContainer" containerID="1440282b668800e1e9397eef8155ea0bc1d08dfc24c06c1882aeca2198528b11"
Sep 11 04:09:35.697335 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:09:35.697318    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1440282b668800e1e9397eef8155ea0bc1d08dfc24c06c1882aeca2198528b11\": container with ID starting with 1440282b668800e1e9397eef8155ea0bc1d08dfc24c06c1882aeca2198528b11 not found: ID does not exist" containerID="1440282b668800e1e9397eef8155ea0bc1d08dfc24c06c1882aeca2198528b11"
Sep 11 04:09:35.697403 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:35.697343    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1440282b668800e1e9397eef8155ea0bc1d08dfc24c06c1882aeca2198528b11"} err="failed to get container status \"1440282b668800e1e9397eef8155ea0bc1d08dfc24c06c1882aeca2198528b11\": rpc error: code = NotFound desc = could not find container \"1440282b668800e1e9397eef8155ea0bc1d08dfc24c06c1882aeca2198528b11\": container with ID starting with 1440282b668800e1e9397eef8155ea0bc1d08dfc24c06c1882aeca2198528b11 not found: ID does not exist"
Sep 11 04:09:35.711196 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:35.711176    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-26814939-6f47954b48-tfxhc"]
Sep 11 04:09:35.718193 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:35.718172    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-26814939-6f47954b48-tfxhc"]
Sep 11 04:09:35.809480 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:35.809460    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b483f4ba-ec98-4abd-808b-42d66512a157" path="/var/lib/kubelet/pods/b483f4ba-ec98-4abd-808b-42d66512a157/volumes"
Sep 11 04:09:36.132645 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:36.132612    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"]
Sep 11 04:09:36.132873 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:36.132848    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg" podUID="493b6ba1-140e-4e8e-9e16-12920ba58d5e" containerName="istio-proxy" containerID="cri-o://ff8f88dce45feb0ebd60ab3d4a4248f875c2a04ce98f174a24bb5af74c010bf7" gracePeriod=30
Sep 11 04:09:41.036436 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.036397    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-285c6871-68cccf587f-4ftzf"]
Sep 11 04:09:41.036810 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.036799    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b483f4ba-ec98-4abd-808b-42d66512a157" containerName="maas-api"
Sep 11 04:09:41.036810 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.036810    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b483f4ba-ec98-4abd-808b-42d66512a157" containerName="maas-api"
Sep 11 04:09:41.036903 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.036891    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b483f4ba-ec98-4abd-808b-42d66512a157" containerName="maas-api"
Sep 11 04:09:41.041470 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.041447    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-285c6871-68cccf587f-4ftzf"
Sep 11 04:09:41.048468 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.048445    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-285c6871-serving-cert\""
Sep 11 04:09:41.066800 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.066773    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-285c6871-68cccf587f-4ftzf"]
Sep 11 04:09:41.171961 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.171932    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae760c42-7851-4aa3-96e5-7b431c734458-openshift-service-ca\") pod \"maas-api-e2e-derive-285c6871-68cccf587f-4ftzf\" (UID: \"ae760c42-7851-4aa3-96e5-7b431c734458\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-285c6871-68cccf587f-4ftzf"
Sep 11 04:09:41.172064 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.171970    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rngll\" (UniqueName: \"kubernetes.io/projected/ae760c42-7851-4aa3-96e5-7b431c734458-kube-api-access-rngll\") pod \"maas-api-e2e-derive-285c6871-68cccf587f-4ftzf\" (UID: \"ae760c42-7851-4aa3-96e5-7b431c734458\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-285c6871-68cccf587f-4ftzf"
Sep 11 04:09:41.172064 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.171991    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae760c42-7851-4aa3-96e5-7b431c734458-maas-api-tls\") pod \"maas-api-e2e-derive-285c6871-68cccf587f-4ftzf\" (UID: \"ae760c42-7851-4aa3-96e5-7b431c734458\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-285c6871-68cccf587f-4ftzf"
Sep 11 04:09:41.172152 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.172125    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae760c42-7851-4aa3-96e5-7b431c734458-metrics-certs\") pod \"maas-api-e2e-derive-285c6871-68cccf587f-4ftzf\" (UID: \"ae760c42-7851-4aa3-96e5-7b431c734458\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-285c6871-68cccf587f-4ftzf"
Sep 11 04:09:41.273206 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.273159    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae760c42-7851-4aa3-96e5-7b431c734458-metrics-certs\") pod \"maas-api-e2e-derive-285c6871-68cccf587f-4ftzf\" (UID: \"ae760c42-7851-4aa3-96e5-7b431c734458\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-285c6871-68cccf587f-4ftzf"
Sep 11 04:09:41.273364 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.273268    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae760c42-7851-4aa3-96e5-7b431c734458-openshift-service-ca\") pod \"maas-api-e2e-derive-285c6871-68cccf587f-4ftzf\" (UID: \"ae760c42-7851-4aa3-96e5-7b431c734458\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-285c6871-68cccf587f-4ftzf"
Sep 11 04:09:41.273364 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.273317    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rngll\" (UniqueName: \"kubernetes.io/projected/ae760c42-7851-4aa3-96e5-7b431c734458-kube-api-access-rngll\") pod \"maas-api-e2e-derive-285c6871-68cccf587f-4ftzf\" (UID: \"ae760c42-7851-4aa3-96e5-7b431c734458\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-285c6871-68cccf587f-4ftzf"
Sep 11 04:09:41.273511 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.273359    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae760c42-7851-4aa3-96e5-7b431c734458-maas-api-tls\") pod \"maas-api-e2e-derive-285c6871-68cccf587f-4ftzf\" (UID: \"ae760c42-7851-4aa3-96e5-7b431c734458\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-285c6871-68cccf587f-4ftzf"
Sep 11 04:09:41.274089 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.274060    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae760c42-7851-4aa3-96e5-7b431c734458-openshift-service-ca\") pod \"maas-api-e2e-derive-285c6871-68cccf587f-4ftzf\" (UID: \"ae760c42-7851-4aa3-96e5-7b431c734458\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-285c6871-68cccf587f-4ftzf"
Sep 11 04:09:41.275768 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.275745    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae760c42-7851-4aa3-96e5-7b431c734458-metrics-certs\") pod \"maas-api-e2e-derive-285c6871-68cccf587f-4ftzf\" (UID: \"ae760c42-7851-4aa3-96e5-7b431c734458\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-285c6871-68cccf587f-4ftzf"
Sep 11 04:09:41.276005 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.275976    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae760c42-7851-4aa3-96e5-7b431c734458-maas-api-tls\") pod \"maas-api-e2e-derive-285c6871-68cccf587f-4ftzf\" (UID: \"ae760c42-7851-4aa3-96e5-7b431c734458\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-285c6871-68cccf587f-4ftzf"
Sep 11 04:09:41.283487 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.283465    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rngll\" (UniqueName: \"kubernetes.io/projected/ae760c42-7851-4aa3-96e5-7b431c734458-kube-api-access-rngll\") pod \"maas-api-e2e-derive-285c6871-68cccf587f-4ftzf\" (UID: \"ae760c42-7851-4aa3-96e5-7b431c734458\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-285c6871-68cccf587f-4ftzf"
Sep 11 04:09:41.351754 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.351729    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-285c6871-68cccf587f-4ftzf"
Sep 11 04:09:41.389123 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.389100    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:41.474855 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.474826    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/493b6ba1-140e-4e8e-9e16-12920ba58d5e-istio-data\") pod \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\" (UID: \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\") "
Sep 11 04:09:41.474855 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.474858    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2r2wb\" (UniqueName: \"kubernetes.io/projected/493b6ba1-140e-4e8e-9e16-12920ba58d5e-kube-api-access-2r2wb\") pod \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\" (UID: \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\") "
Sep 11 04:09:41.475039 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.474905    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/493b6ba1-140e-4e8e-9e16-12920ba58d5e-istio-envoy\") pod \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\" (UID: \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\") "
Sep 11 04:09:41.475039 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.474932    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/493b6ba1-140e-4e8e-9e16-12920ba58d5e-credential-socket\") pod \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\" (UID: \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\") "
Sep 11 04:09:41.475039 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.474998    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/493b6ba1-140e-4e8e-9e16-12920ba58d5e-istiod-ca-cert\") pod \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\" (UID: \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\") "
Sep 11 04:09:41.475220 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.475060    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/493b6ba1-140e-4e8e-9e16-12920ba58d5e-workload-socket\") pod \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\" (UID: \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\") "
Sep 11 04:09:41.475220 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.475063    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/493b6ba1-140e-4e8e-9e16-12920ba58d5e-istio-data" (OuterVolumeSpecName: "istio-data") pod "493b6ba1-140e-4e8e-9e16-12920ba58d5e" (UID: "493b6ba1-140e-4e8e-9e16-12920ba58d5e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:09:41.475220 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.475142    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/493b6ba1-140e-4e8e-9e16-12920ba58d5e-workload-certs\") pod \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\" (UID: \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\") "
Sep 11 04:09:41.475220 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.475195    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/493b6ba1-140e-4e8e-9e16-12920ba58d5e-istio-podinfo\") pod \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\" (UID: \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\") "
Sep 11 04:09:41.475467 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.475230    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/493b6ba1-140e-4e8e-9e16-12920ba58d5e-istio-token\") pod \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\" (UID: \"493b6ba1-140e-4e8e-9e16-12920ba58d5e\") "
Sep 11 04:09:41.475467 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.475253    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/493b6ba1-140e-4e8e-9e16-12920ba58d5e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "493b6ba1-140e-4e8e-9e16-12920ba58d5e" (UID: "493b6ba1-140e-4e8e-9e16-12920ba58d5e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:09:41.475575 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.475440    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/493b6ba1-140e-4e8e-9e16-12920ba58d5e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "493b6ba1-140e-4e8e-9e16-12920ba58d5e" (UID: "493b6ba1-140e-4e8e-9e16-12920ba58d5e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:09:41.475641 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.475608    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/493b6ba1-140e-4e8e-9e16-12920ba58d5e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "493b6ba1-140e-4e8e-9e16-12920ba58d5e" (UID: "493b6ba1-140e-4e8e-9e16-12920ba58d5e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:09:41.475701 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.475666    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/493b6ba1-140e-4e8e-9e16-12920ba58d5e-istio-data\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:09:41.475701 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.475680    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/493b6ba1-140e-4e8e-9e16-12920ba58d5e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "493b6ba1-140e-4e8e-9e16-12920ba58d5e" (UID: "493b6ba1-140e-4e8e-9e16-12920ba58d5e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:09:41.475814 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.475689    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/493b6ba1-140e-4e8e-9e16-12920ba58d5e-credential-socket\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:09:41.475814 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.475722    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/493b6ba1-140e-4e8e-9e16-12920ba58d5e-istiod-ca-cert\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:09:41.477356 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.477327    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/493b6ba1-140e-4e8e-9e16-12920ba58d5e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "493b6ba1-140e-4e8e-9e16-12920ba58d5e" (UID: "493b6ba1-140e-4e8e-9e16-12920ba58d5e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 04:09:41.477499 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.477378    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/493b6ba1-140e-4e8e-9e16-12920ba58d5e-istio-token" (OuterVolumeSpecName: "istio-token") pod "493b6ba1-140e-4e8e-9e16-12920ba58d5e" (UID: "493b6ba1-140e-4e8e-9e16-12920ba58d5e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:09:41.477556 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.477518    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/493b6ba1-140e-4e8e-9e16-12920ba58d5e-kube-api-access-2r2wb" (OuterVolumeSpecName: "kube-api-access-2r2wb") pod "493b6ba1-140e-4e8e-9e16-12920ba58d5e" (UID: "493b6ba1-140e-4e8e-9e16-12920ba58d5e"). InnerVolumeSpecName "kube-api-access-2r2wb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:09:41.477556 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.477517    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/493b6ba1-140e-4e8e-9e16-12920ba58d5e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "493b6ba1-140e-4e8e-9e16-12920ba58d5e" (UID: "493b6ba1-140e-4e8e-9e16-12920ba58d5e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:09:41.576336 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.576316    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/493b6ba1-140e-4e8e-9e16-12920ba58d5e-workload-certs\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:09:41.576336 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.576336    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/493b6ba1-140e-4e8e-9e16-12920ba58d5e-istio-podinfo\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:09:41.576496 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.576344    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/493b6ba1-140e-4e8e-9e16-12920ba58d5e-istio-token\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:09:41.576496 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.576355    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2r2wb\" (UniqueName: \"kubernetes.io/projected/493b6ba1-140e-4e8e-9e16-12920ba58d5e-kube-api-access-2r2wb\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:09:41.576496 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.576364    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/493b6ba1-140e-4e8e-9e16-12920ba58d5e-istio-envoy\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:09:41.576496 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.576372    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/493b6ba1-140e-4e8e-9e16-12920ba58d5e-workload-socket\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:09:41.644695 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.644664    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-285c6871-68cccf587f-4ftzf"]
Sep 11 04:09:41.648071 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:09:41.648041    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae760c42_7851_4aa3_96e5_7b431c734458.slice/crio-e6b1458dd936813328e44effe34d5b81c91a89e84992334dc03e667aa83ea77a WatchSource:0}: Error finding container e6b1458dd936813328e44effe34d5b81c91a89e84992334dc03e667aa83ea77a: Status 404 returned error can't find the container with id e6b1458dd936813328e44effe34d5b81c91a89e84992334dc03e667aa83ea77a
Sep 11 04:09:41.722298 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.722268    2558 generic.go:356] "Generic (PLEG): container finished" podID="493b6ba1-140e-4e8e-9e16-12920ba58d5e" containerID="ff8f88dce45feb0ebd60ab3d4a4248f875c2a04ce98f174a24bb5af74c010bf7" exitCode=0
Sep 11 04:09:41.722449 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.722325    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"
Sep 11 04:09:41.722449 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.722347    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg" event={"ID":"493b6ba1-140e-4e8e-9e16-12920ba58d5e","Type":"ContainerDied","Data":"ff8f88dce45feb0ebd60ab3d4a4248f875c2a04ce98f174a24bb5af74c010bf7"}
Sep 11 04:09:41.722449 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.722419    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg" event={"ID":"493b6ba1-140e-4e8e-9e16-12920ba58d5e","Type":"ContainerDied","Data":"46cf2e1078a5fc217b27b4421d87d4a4ba06cf964fbab6492e266fb75be97d4d"}
Sep 11 04:09:41.722449 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.722437    2558 scope.go:117] "RemoveContainer" containerID="ff8f88dce45feb0ebd60ab3d4a4248f875c2a04ce98f174a24bb5af74c010bf7"
Sep 11 04:09:41.723950 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.723925    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-285c6871-68cccf587f-4ftzf" event={"ID":"ae760c42-7851-4aa3-96e5-7b431c734458","Type":"ContainerStarted","Data":"e6b1458dd936813328e44effe34d5b81c91a89e84992334dc03e667aa83ea77a"}
Sep 11 04:09:41.731764 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.731739    2558 scope.go:117] "RemoveContainer" containerID="e664cd3647c71b295311b8ebb6da72aea38484a4e09995b7030f977478978f02"
Sep 11 04:09:41.740372 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.740356    2558 scope.go:117] "RemoveContainer" containerID="ff8f88dce45feb0ebd60ab3d4a4248f875c2a04ce98f174a24bb5af74c010bf7"
Sep 11 04:09:41.740688 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:09:41.740672    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff8f88dce45feb0ebd60ab3d4a4248f875c2a04ce98f174a24bb5af74c010bf7\": container with ID starting with ff8f88dce45feb0ebd60ab3d4a4248f875c2a04ce98f174a24bb5af74c010bf7 not found: ID does not exist" containerID="ff8f88dce45feb0ebd60ab3d4a4248f875c2a04ce98f174a24bb5af74c010bf7"
Sep 11 04:09:41.740744 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.740722    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff8f88dce45feb0ebd60ab3d4a4248f875c2a04ce98f174a24bb5af74c010bf7"} err="failed to get container status \"ff8f88dce45feb0ebd60ab3d4a4248f875c2a04ce98f174a24bb5af74c010bf7\": rpc error: code = NotFound desc = could not find container \"ff8f88dce45feb0ebd60ab3d4a4248f875c2a04ce98f174a24bb5af74c010bf7\": container with ID starting with ff8f88dce45feb0ebd60ab3d4a4248f875c2a04ce98f174a24bb5af74c010bf7 not found: ID does not exist"
Sep 11 04:09:41.740744 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.740741    2558 scope.go:117] "RemoveContainer" containerID="e664cd3647c71b295311b8ebb6da72aea38484a4e09995b7030f977478978f02"
Sep 11 04:09:41.741022 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:09:41.740991    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e664cd3647c71b295311b8ebb6da72aea38484a4e09995b7030f977478978f02\": container with ID starting with e664cd3647c71b295311b8ebb6da72aea38484a4e09995b7030f977478978f02 not found: ID does not exist" containerID="e664cd3647c71b295311b8ebb6da72aea38484a4e09995b7030f977478978f02"
Sep 11 04:09:41.741082 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.741026    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e664cd3647c71b295311b8ebb6da72aea38484a4e09995b7030f977478978f02"} err="failed to get container status \"e664cd3647c71b295311b8ebb6da72aea38484a4e09995b7030f977478978f02\": rpc error: code = NotFound desc = could not find container \"e664cd3647c71b295311b8ebb6da72aea38484a4e09995b7030f977478978f02\": container with ID starting with e664cd3647c71b295311b8ebb6da72aea38484a4e09995b7030f977478978f02 not found: ID does not exist"
Sep 11 04:09:41.753072 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.753041    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"]
Sep 11 04:09:41.765105 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.765084    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg"]
Sep 11 04:09:41.810459 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:41.810428    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="493b6ba1-140e-4e8e-9e16-12920ba58d5e" path="/var/lib/kubelet/pods/493b6ba1-140e-4e8e-9e16-12920ba58d5e/volumes"
Sep 11 04:09:42.732565 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:42.732534    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-285c6871-68cccf587f-4ftzf" event={"ID":"ae760c42-7851-4aa3-96e5-7b431c734458","Type":"ContainerStarted","Data":"c41b8b3a20973965d8245336d6b226dc74aafa08cf8673e22c861a881e743d79"}
Sep 11 04:09:42.732971 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:42.732664    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-285c6871-68cccf587f-4ftzf"
Sep 11 04:09:42.772796 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:42.772736    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-285c6871-68cccf587f-4ftzf" podStartSLOduration=1.2787048300000001 podStartE2EDuration="1.772720443s" totalImagesPullingTime="494.015613ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:09:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:09:42.771234986 +0000 UTC m=+979.569324715" watchObservedRunningTime="2026-09-11 04:09:42.772720443 +0000 UTC m=+979.570810196"
Sep 11 04:09:48.744145 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:48.744061    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-285c6871-68cccf587f-4ftzf"
Sep 11 04:09:49.003154 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:49.003063    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:09:56.417954 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:56.417913    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp"]
Sep 11 04:09:56.418429 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:56.418411    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="493b6ba1-140e-4e8e-9e16-12920ba58d5e" containerName="istio-proxy"
Sep 11 04:09:56.418489 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:56.418430    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="493b6ba1-140e-4e8e-9e16-12920ba58d5e" containerName="istio-proxy"
Sep 11 04:09:56.418489 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:56.418445    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="493b6ba1-140e-4e8e-9e16-12920ba58d5e" containerName="istio-proxy"
Sep 11 04:09:56.418489 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:56.418451    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="493b6ba1-140e-4e8e-9e16-12920ba58d5e" containerName="istio-proxy"
Sep 11 04:09:56.418701 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:56.418519    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="493b6ba1-140e-4e8e-9e16-12920ba58d5e" containerName="istio-proxy"
Sep 11 04:09:56.418701 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:56.418527    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="493b6ba1-140e-4e8e-9e16-12920ba58d5e" containerName="istio-proxy"
Sep 11 04:09:56.421144 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:56.421125    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp"
Sep 11 04:09:56.424621 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:56.424601    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-a28c9f\"/\"openshift-service-ca.crt\""
Sep 11 04:09:56.424746 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:56.424618    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-a28c9f\"/\"kube-root-ca.crt\""
Sep 11 04:09:56.425988 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:56.425966    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-a28c9f\"/\"test-model-a28c9f-kserve-self-signed-certs\""
Sep 11 04:09:56.426094 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:56.425967    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-a28c9f\"/\"default-dockercfg-4c22w\""
Sep 11 04:09:56.438475 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:56.438445    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp"]
Sep 11 04:09:56.619214 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:56.619175    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbde454e-030c-4f60-ad5c-278488287be9-dshm\") pod \"test-model-a28c9f-kserve-68bf8c5bf9-r8gwp\" (UID: \"dbde454e-030c-4f60-ad5c-278488287be9\") " pod="ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp"
Sep 11 04:09:56.619431 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:56.619223    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzhfq\" (UniqueName: \"kubernetes.io/projected/dbde454e-030c-4f60-ad5c-278488287be9-kube-api-access-xzhfq\") pod \"test-model-a28c9f-kserve-68bf8c5bf9-r8gwp\" (UID: \"dbde454e-030c-4f60-ad5c-278488287be9\") " pod="ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp"
Sep 11 04:09:56.619431 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:56.619246    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbde454e-030c-4f60-ad5c-278488287be9-tmp-dir\") pod \"test-model-a28c9f-kserve-68bf8c5bf9-r8gwp\" (UID: \"dbde454e-030c-4f60-ad5c-278488287be9\") " pod="ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp"
Sep 11 04:09:56.619431 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:56.619382    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbde454e-030c-4f60-ad5c-278488287be9-tls-certs\") pod \"test-model-a28c9f-kserve-68bf8c5bf9-r8gwp\" (UID: \"dbde454e-030c-4f60-ad5c-278488287be9\") " pod="ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp"
Sep 11 04:09:56.619576 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:56.619476    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbde454e-030c-4f60-ad5c-278488287be9-home\") pod \"test-model-a28c9f-kserve-68bf8c5bf9-r8gwp\" (UID: \"dbde454e-030c-4f60-ad5c-278488287be9\") " pod="ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp"
Sep 11 04:09:56.619576 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:56.619500    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbde454e-030c-4f60-ad5c-278488287be9-model-cache\") pod \"test-model-a28c9f-kserve-68bf8c5bf9-r8gwp\" (UID: \"dbde454e-030c-4f60-ad5c-278488287be9\") " pod="ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp"
Sep 11 04:09:56.720251 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:56.720144    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbde454e-030c-4f60-ad5c-278488287be9-tls-certs\") pod \"test-model-a28c9f-kserve-68bf8c5bf9-r8gwp\" (UID: \"dbde454e-030c-4f60-ad5c-278488287be9\") " pod="ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp"
Sep 11 04:09:56.720251 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:56.720195    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbde454e-030c-4f60-ad5c-278488287be9-home\") pod \"test-model-a28c9f-kserve-68bf8c5bf9-r8gwp\" (UID: \"dbde454e-030c-4f60-ad5c-278488287be9\") " pod="ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp"
Sep 11 04:09:56.720251 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:56.720218    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbde454e-030c-4f60-ad5c-278488287be9-model-cache\") pod \"test-model-a28c9f-kserve-68bf8c5bf9-r8gwp\" (UID: \"dbde454e-030c-4f60-ad5c-278488287be9\") " pod="ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp"
Sep 11 04:09:56.720251 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:56.720257    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbde454e-030c-4f60-ad5c-278488287be9-dshm\") pod \"test-model-a28c9f-kserve-68bf8c5bf9-r8gwp\" (UID: \"dbde454e-030c-4f60-ad5c-278488287be9\") " pod="ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp"
Sep 11 04:09:56.720649 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:56.720281    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzhfq\" (UniqueName: \"kubernetes.io/projected/dbde454e-030c-4f60-ad5c-278488287be9-kube-api-access-xzhfq\") pod \"test-model-a28c9f-kserve-68bf8c5bf9-r8gwp\" (UID: \"dbde454e-030c-4f60-ad5c-278488287be9\") " pod="ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp"
Sep 11 04:09:56.720649 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:56.720299    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbde454e-030c-4f60-ad5c-278488287be9-tmp-dir\") pod \"test-model-a28c9f-kserve-68bf8c5bf9-r8gwp\" (UID: \"dbde454e-030c-4f60-ad5c-278488287be9\") " pod="ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp"
Sep 11 04:09:56.720762 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:56.720649    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbde454e-030c-4f60-ad5c-278488287be9-home\") pod \"test-model-a28c9f-kserve-68bf8c5bf9-r8gwp\" (UID: \"dbde454e-030c-4f60-ad5c-278488287be9\") " pod="ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp"
Sep 11 04:09:56.720762 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:56.720673    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbde454e-030c-4f60-ad5c-278488287be9-tmp-dir\") pod \"test-model-a28c9f-kserve-68bf8c5bf9-r8gwp\" (UID: \"dbde454e-030c-4f60-ad5c-278488287be9\") " pod="ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp"
Sep 11 04:09:56.720762 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:56.720728    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbde454e-030c-4f60-ad5c-278488287be9-model-cache\") pod \"test-model-a28c9f-kserve-68bf8c5bf9-r8gwp\" (UID: \"dbde454e-030c-4f60-ad5c-278488287be9\") " pod="ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp"
Sep 11 04:09:56.722675 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:56.722651    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbde454e-030c-4f60-ad5c-278488287be9-dshm\") pod \"test-model-a28c9f-kserve-68bf8c5bf9-r8gwp\" (UID: \"dbde454e-030c-4f60-ad5c-278488287be9\") " pod="ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp"
Sep 11 04:09:56.722930 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:56.722912    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbde454e-030c-4f60-ad5c-278488287be9-tls-certs\") pod \"test-model-a28c9f-kserve-68bf8c5bf9-r8gwp\" (UID: \"dbde454e-030c-4f60-ad5c-278488287be9\") " pod="ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp"
Sep 11 04:09:56.728796 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:56.728776    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzhfq\" (UniqueName: \"kubernetes.io/projected/dbde454e-030c-4f60-ad5c-278488287be9-kube-api-access-xzhfq\") pod \"test-model-a28c9f-kserve-68bf8c5bf9-r8gwp\" (UID: \"dbde454e-030c-4f60-ad5c-278488287be9\") " pod="ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp"
Sep 11 04:09:56.731678 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:56.731659    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp"
Sep 11 04:09:57.007813 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:57.007776    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp"]
Sep 11 04:09:57.009672 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:09:57.009646    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddbde454e_030c_4f60_ad5c_278488287be9.slice/crio-7587bee2f74a908c10de535f67b76681205beab11847b1238332dfccd4173c71 WatchSource:0}: Error finding container 7587bee2f74a908c10de535f67b76681205beab11847b1238332dfccd4173c71: Status 404 returned error can't find the container with id 7587bee2f74a908c10de535f67b76681205beab11847b1238332dfccd4173c71
Sep 11 04:09:57.816282 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:57.816245    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp" event={"ID":"dbde454e-030c-4f60-ad5c-278488287be9","Type":"ContainerStarted","Data":"04deb166ce852323e5ffa223509cf5d59ad19a5f00f1f91c16853cbeed4c2685"}
Sep 11 04:09:57.816282 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:57.816286    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp" event={"ID":"dbde454e-030c-4f60-ad5c-278488287be9","Type":"ContainerStarted","Data":"7587bee2f74a908c10de535f67b76681205beab11847b1238332dfccd4173c71"}
Sep 11 04:09:57.837854 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:09:57.837800    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp" podStartSLOduration=1.837784363 podStartE2EDuration="1.837784363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:09:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:09:57.835102907 +0000 UTC m=+994.633192635" watchObservedRunningTime="2026-09-11 04:09:57.837784363 +0000 UTC m=+994.635874090"
Sep 11 04:10:04.121269 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:04.121235    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:10:06.732725 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:06.732688    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp"
Sep 11 04:10:06.733156 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:06.732737    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp"
Sep 11 04:10:06.745294 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:06.745270    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp"
Sep 11 04:10:06.883813 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:06.883777    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp"
Sep 11 04:10:10.175397 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:10.175353    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87"]
Sep 11 04:10:10.176134 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:10.176097    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87" podUID="3f834672-6736-4226-93d4-659a31a9f766" containerName="maas-api" containerID="cri-o://b5bc7270a04fe8ea0b73b34618a2e376844295ea18d453dfa8eb9ba76d7b07e3" gracePeriod=30
Sep 11 04:10:10.427638 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:10.427583    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87"
Sep 11 04:10:10.548504 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:10.548475    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2884\" (UniqueName: \"kubernetes.io/projected/3f834672-6736-4226-93d4-659a31a9f766-kube-api-access-k2884\") pod \"3f834672-6736-4226-93d4-659a31a9f766\" (UID: \"3f834672-6736-4226-93d4-659a31a9f766\") "
Sep 11 04:10:10.548641 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:10.548510    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f834672-6736-4226-93d4-659a31a9f766-metrics-certs\") pod \"3f834672-6736-4226-93d4-659a31a9f766\" (UID: \"3f834672-6736-4226-93d4-659a31a9f766\") "
Sep 11 04:10:10.548641 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:10.548546    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f834672-6736-4226-93d4-659a31a9f766-maas-api-tls\") pod \"3f834672-6736-4226-93d4-659a31a9f766\" (UID: \"3f834672-6736-4226-93d4-659a31a9f766\") "
Sep 11 04:10:10.548641 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:10.548624    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f834672-6736-4226-93d4-659a31a9f766-openshift-service-ca\") pod \"3f834672-6736-4226-93d4-659a31a9f766\" (UID: \"3f834672-6736-4226-93d4-659a31a9f766\") "
Sep 11 04:10:10.549027 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:10.549000    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f834672-6736-4226-93d4-659a31a9f766-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3f834672-6736-4226-93d4-659a31a9f766" (UID: "3f834672-6736-4226-93d4-659a31a9f766"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:10:10.550524 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:10.550501    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f834672-6736-4226-93d4-659a31a9f766-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3f834672-6736-4226-93d4-659a31a9f766" (UID: "3f834672-6736-4226-93d4-659a31a9f766"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:10:10.550524 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:10.550507    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f834672-6736-4226-93d4-659a31a9f766-kube-api-access-k2884" (OuterVolumeSpecName: "kube-api-access-k2884") pod "3f834672-6736-4226-93d4-659a31a9f766" (UID: "3f834672-6736-4226-93d4-659a31a9f766"). InnerVolumeSpecName "kube-api-access-k2884". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:10:10.550655 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:10.550525    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f834672-6736-4226-93d4-659a31a9f766-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3f834672-6736-4226-93d4-659a31a9f766" (UID: "3f834672-6736-4226-93d4-659a31a9f766"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:10:10.650176 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:10.650144    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f834672-6736-4226-93d4-659a31a9f766-openshift-service-ca\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:10:10.650176 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:10.650168    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2884\" (UniqueName: \"kubernetes.io/projected/3f834672-6736-4226-93d4-659a31a9f766-kube-api-access-k2884\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:10:10.650176 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:10.650178    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f834672-6736-4226-93d4-659a31a9f766-metrics-certs\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:10:10.650424 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:10.650189    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f834672-6736-4226-93d4-659a31a9f766-maas-api-tls\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:10:10.894188 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:10.894156    2558 generic.go:356] "Generic (PLEG): container finished" podID="3f834672-6736-4226-93d4-659a31a9f766" containerID="b5bc7270a04fe8ea0b73b34618a2e376844295ea18d453dfa8eb9ba76d7b07e3" exitCode=0
Sep 11 04:10:10.894335 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:10.894196    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87"
Sep 11 04:10:10.894335 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:10.894197    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87" event={"ID":"3f834672-6736-4226-93d4-659a31a9f766","Type":"ContainerDied","Data":"b5bc7270a04fe8ea0b73b34618a2e376844295ea18d453dfa8eb9ba76d7b07e3"}
Sep 11 04:10:10.894435 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:10.894329    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87" event={"ID":"3f834672-6736-4226-93d4-659a31a9f766","Type":"ContainerDied","Data":"b6d4074d547b992a2b5e3de4e33399ed90f98e65fb1ed00a59aff16ac6cb72f0"}
Sep 11 04:10:10.894435 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:10.894360    2558 scope.go:117] "RemoveContainer" containerID="b5bc7270a04fe8ea0b73b34618a2e376844295ea18d453dfa8eb9ba76d7b07e3"
Sep 11 04:10:10.904433 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:10.904414    2558 scope.go:117] "RemoveContainer" containerID="b5bc7270a04fe8ea0b73b34618a2e376844295ea18d453dfa8eb9ba76d7b07e3"
Sep 11 04:10:10.904721 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:10:10.904702    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5bc7270a04fe8ea0b73b34618a2e376844295ea18d453dfa8eb9ba76d7b07e3\": container with ID starting with b5bc7270a04fe8ea0b73b34618a2e376844295ea18d453dfa8eb9ba76d7b07e3 not found: ID does not exist" containerID="b5bc7270a04fe8ea0b73b34618a2e376844295ea18d453dfa8eb9ba76d7b07e3"
Sep 11 04:10:10.904767 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:10.904730    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5bc7270a04fe8ea0b73b34618a2e376844295ea18d453dfa8eb9ba76d7b07e3"} err="failed to get container status \"b5bc7270a04fe8ea0b73b34618a2e376844295ea18d453dfa8eb9ba76d7b07e3\": rpc error: code = NotFound desc = could not find container \"b5bc7270a04fe8ea0b73b34618a2e376844295ea18d453dfa8eb9ba76d7b07e3\": container with ID starting with b5bc7270a04fe8ea0b73b34618a2e376844295ea18d453dfa8eb9ba76d7b07e3 not found: ID does not exist"
Sep 11 04:10:10.920170 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:10.920144    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87"]
Sep 11 04:10:10.926687 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:10.926665    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-eda9e4-7fdfb57947-xmm87"]
Sep 11 04:10:11.817402 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:11.817345    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f834672-6736-4226-93d4-659a31a9f766" path="/var/lib/kubelet/pods/3f834672-6736-4226-93d4-659a31a9f766/volumes"
Sep 11 04:10:11.824232 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:11.824206    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-285c6871-68cccf587f-4ftzf"]
Sep 11 04:10:11.824465 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:11.824439    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-285c6871-68cccf587f-4ftzf" podUID="ae760c42-7851-4aa3-96e5-7b431c734458" containerName="maas-api" containerID="cri-o://c41b8b3a20973965d8245336d6b226dc74aafa08cf8673e22c861a881e743d79" gracePeriod=30
Sep 11 04:10:12.092503 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:12.092478    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-285c6871-68cccf587f-4ftzf"
Sep 11 04:10:12.163051 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:12.163023    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae760c42-7851-4aa3-96e5-7b431c734458-maas-api-tls\") pod \"ae760c42-7851-4aa3-96e5-7b431c734458\" (UID: \"ae760c42-7851-4aa3-96e5-7b431c734458\") "
Sep 11 04:10:12.163180 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:12.163073    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rngll\" (UniqueName: \"kubernetes.io/projected/ae760c42-7851-4aa3-96e5-7b431c734458-kube-api-access-rngll\") pod \"ae760c42-7851-4aa3-96e5-7b431c734458\" (UID: \"ae760c42-7851-4aa3-96e5-7b431c734458\") "
Sep 11 04:10:12.163180 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:12.163126    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae760c42-7851-4aa3-96e5-7b431c734458-openshift-service-ca\") pod \"ae760c42-7851-4aa3-96e5-7b431c734458\" (UID: \"ae760c42-7851-4aa3-96e5-7b431c734458\") "
Sep 11 04:10:12.163180 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:12.163165    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae760c42-7851-4aa3-96e5-7b431c734458-metrics-certs\") pod \"ae760c42-7851-4aa3-96e5-7b431c734458\" (UID: \"ae760c42-7851-4aa3-96e5-7b431c734458\") "
Sep 11 04:10:12.163528 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:12.163498    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae760c42-7851-4aa3-96e5-7b431c734458-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ae760c42-7851-4aa3-96e5-7b431c734458" (UID: "ae760c42-7851-4aa3-96e5-7b431c734458"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:10:12.165402 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:12.165354    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae760c42-7851-4aa3-96e5-7b431c734458-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ae760c42-7851-4aa3-96e5-7b431c734458" (UID: "ae760c42-7851-4aa3-96e5-7b431c734458"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:10:12.165517 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:12.165376    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae760c42-7851-4aa3-96e5-7b431c734458-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ae760c42-7851-4aa3-96e5-7b431c734458" (UID: "ae760c42-7851-4aa3-96e5-7b431c734458"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:10:12.165583 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:12.165534    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae760c42-7851-4aa3-96e5-7b431c734458-kube-api-access-rngll" (OuterVolumeSpecName: "kube-api-access-rngll") pod "ae760c42-7851-4aa3-96e5-7b431c734458" (UID: "ae760c42-7851-4aa3-96e5-7b431c734458"). InnerVolumeSpecName "kube-api-access-rngll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:10:12.264589 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:12.264561    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae760c42-7851-4aa3-96e5-7b431c734458-metrics-certs\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:10:12.264589 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:12.264587    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae760c42-7851-4aa3-96e5-7b431c734458-maas-api-tls\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:10:12.264756 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:12.264598    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rngll\" (UniqueName: \"kubernetes.io/projected/ae760c42-7851-4aa3-96e5-7b431c734458-kube-api-access-rngll\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:10:12.264756 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:12.264609    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae760c42-7851-4aa3-96e5-7b431c734458-openshift-service-ca\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:10:12.908545 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:12.908515    2558 generic.go:356] "Generic (PLEG): container finished" podID="ae760c42-7851-4aa3-96e5-7b431c734458" containerID="c41b8b3a20973965d8245336d6b226dc74aafa08cf8673e22c861a881e743d79" exitCode=0
Sep 11 04:10:12.908970 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:12.908558    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-285c6871-68cccf587f-4ftzf"
Sep 11 04:10:12.908970 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:12.908594    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-285c6871-68cccf587f-4ftzf" event={"ID":"ae760c42-7851-4aa3-96e5-7b431c734458","Type":"ContainerDied","Data":"c41b8b3a20973965d8245336d6b226dc74aafa08cf8673e22c861a881e743d79"}
Sep 11 04:10:12.908970 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:12.908650    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-285c6871-68cccf587f-4ftzf" event={"ID":"ae760c42-7851-4aa3-96e5-7b431c734458","Type":"ContainerDied","Data":"e6b1458dd936813328e44effe34d5b81c91a89e84992334dc03e667aa83ea77a"}
Sep 11 04:10:12.908970 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:12.908672    2558 scope.go:117] "RemoveContainer" containerID="c41b8b3a20973965d8245336d6b226dc74aafa08cf8673e22c861a881e743d79"
Sep 11 04:10:12.919653 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:12.919625    2558 scope.go:117] "RemoveContainer" containerID="c41b8b3a20973965d8245336d6b226dc74aafa08cf8673e22c861a881e743d79"
Sep 11 04:10:12.919955 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:10:12.919934    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c41b8b3a20973965d8245336d6b226dc74aafa08cf8673e22c861a881e743d79\": container with ID starting with c41b8b3a20973965d8245336d6b226dc74aafa08cf8673e22c861a881e743d79 not found: ID does not exist" containerID="c41b8b3a20973965d8245336d6b226dc74aafa08cf8673e22c861a881e743d79"
Sep 11 04:10:12.920005 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:12.919963    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c41b8b3a20973965d8245336d6b226dc74aafa08cf8673e22c861a881e743d79"} err="failed to get container status \"c41b8b3a20973965d8245336d6b226dc74aafa08cf8673e22c861a881e743d79\": rpc error: code = NotFound desc = could not find container \"c41b8b3a20973965d8245336d6b226dc74aafa08cf8673e22c861a881e743d79\": container with ID starting with c41b8b3a20973965d8245336d6b226dc74aafa08cf8673e22c861a881e743d79 not found: ID does not exist"
Sep 11 04:10:12.936541 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:12.936516    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-285c6871-68cccf587f-4ftzf"]
Sep 11 04:10:12.941154 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:12.941132    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-285c6871-68cccf587f-4ftzf"]
Sep 11 04:10:13.811035 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:13.811001    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae760c42-7851-4aa3-96e5-7b431c734458" path="/var/lib/kubelet/pods/ae760c42-7851-4aa3-96e5-7b431c734458/volumes"
Sep 11 04:10:17.753670 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:17.753638    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"]
Sep 11 04:10:17.755110 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:17.755087    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae760c42-7851-4aa3-96e5-7b431c734458" containerName="maas-api"
Sep 11 04:10:17.755258 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:17.755246    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae760c42-7851-4aa3-96e5-7b431c734458" containerName="maas-api"
Sep 11 04:10:17.755374 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:17.755364    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f834672-6736-4226-93d4-659a31a9f766" containerName="maas-api"
Sep 11 04:10:17.755479 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:17.755469    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f834672-6736-4226-93d4-659a31a9f766" containerName="maas-api"
Sep 11 04:10:17.755746 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:17.755731    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f834672-6736-4226-93d4-659a31a9f766" containerName="maas-api"
Sep 11 04:10:17.755884 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:17.755873    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae760c42-7851-4aa3-96e5-7b431c734458" containerName="maas-api"
Sep 11 04:10:17.761439 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:17.761416    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:10:17.764851 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:17.764831    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-57c530-openshift-default-dockercfg-hchdc\""
Sep 11 04:10:17.767638 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:17.767616    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"]
Sep 11 04:10:17.811936 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:17.811907    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ef01c45-505f-45f6-98ec-4e08418caeee-workload-certs\") pod \"e2e-explicit-57c530-openshift-default-db4c98744-4lhn4\" (UID: \"3ef01c45-505f-45f6-98ec-4e08418caeee\") " pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:10:17.812054 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:17.811944    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ef01c45-505f-45f6-98ec-4e08418caeee-istiod-ca-cert\") pod \"e2e-explicit-57c530-openshift-default-db4c98744-4lhn4\" (UID: \"3ef01c45-505f-45f6-98ec-4e08418caeee\") " pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:10:17.812054 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:17.812000    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ef01c45-505f-45f6-98ec-4e08418caeee-istio-data\") pod \"e2e-explicit-57c530-openshift-default-db4c98744-4lhn4\" (UID: \"3ef01c45-505f-45f6-98ec-4e08418caeee\") " pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:10:17.812054 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:17.812024    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ef01c45-505f-45f6-98ec-4e08418caeee-istio-token\") pod \"e2e-explicit-57c530-openshift-default-db4c98744-4lhn4\" (UID: \"3ef01c45-505f-45f6-98ec-4e08418caeee\") " pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:10:17.812054 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:17.812051    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ef01c45-505f-45f6-98ec-4e08418caeee-workload-socket\") pod \"e2e-explicit-57c530-openshift-default-db4c98744-4lhn4\" (UID: \"3ef01c45-505f-45f6-98ec-4e08418caeee\") " pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:10:17.812236 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:17.812102    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ef01c45-505f-45f6-98ec-4e08418caeee-istio-podinfo\") pod \"e2e-explicit-57c530-openshift-default-db4c98744-4lhn4\" (UID: \"3ef01c45-505f-45f6-98ec-4e08418caeee\") " pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:10:17.812236 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:17.812128    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ef01c45-505f-45f6-98ec-4e08418caeee-credential-socket\") pod \"e2e-explicit-57c530-openshift-default-db4c98744-4lhn4\" (UID: \"3ef01c45-505f-45f6-98ec-4e08418caeee\") " pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:10:17.812236 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:17.812207    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ef01c45-505f-45f6-98ec-4e08418caeee-istio-envoy\") pod \"e2e-explicit-57c530-openshift-default-db4c98744-4lhn4\" (UID: \"3ef01c45-505f-45f6-98ec-4e08418caeee\") " pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:10:17.812236 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:17.812234    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp252\" (UniqueName: \"kubernetes.io/projected/3ef01c45-505f-45f6-98ec-4e08418caeee-kube-api-access-bp252\") pod \"e2e-explicit-57c530-openshift-default-db4c98744-4lhn4\" (UID: \"3ef01c45-505f-45f6-98ec-4e08418caeee\") " pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:10:17.913060 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:17.913023    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ef01c45-505f-45f6-98ec-4e08418caeee-workload-socket\") pod \"e2e-explicit-57c530-openshift-default-db4c98744-4lhn4\" (UID: \"3ef01c45-505f-45f6-98ec-4e08418caeee\") " pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:10:17.913262 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:17.913079    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ef01c45-505f-45f6-98ec-4e08418caeee-istio-podinfo\") pod \"e2e-explicit-57c530-openshift-default-db4c98744-4lhn4\" (UID: \"3ef01c45-505f-45f6-98ec-4e08418caeee\") " pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:10:17.913262 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:17.913107    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ef01c45-505f-45f6-98ec-4e08418caeee-credential-socket\") pod \"e2e-explicit-57c530-openshift-default-db4c98744-4lhn4\" (UID: \"3ef01c45-505f-45f6-98ec-4e08418caeee\") " pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:10:17.913262 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:17.913199    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ef01c45-505f-45f6-98ec-4e08418caeee-istio-envoy\") pod \"e2e-explicit-57c530-openshift-default-db4c98744-4lhn4\" (UID: \"3ef01c45-505f-45f6-98ec-4e08418caeee\") " pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:10:17.913262 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:17.913239    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp252\" (UniqueName: \"kubernetes.io/projected/3ef01c45-505f-45f6-98ec-4e08418caeee-kube-api-access-bp252\") pod \"e2e-explicit-57c530-openshift-default-db4c98744-4lhn4\" (UID: \"3ef01c45-505f-45f6-98ec-4e08418caeee\") " pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:10:17.913528 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:17.913271    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ef01c45-505f-45f6-98ec-4e08418caeee-workload-certs\") pod \"e2e-explicit-57c530-openshift-default-db4c98744-4lhn4\" (UID: \"3ef01c45-505f-45f6-98ec-4e08418caeee\") " pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:10:17.913528 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:17.913298    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ef01c45-505f-45f6-98ec-4e08418caeee-istiod-ca-cert\") pod \"e2e-explicit-57c530-openshift-default-db4c98744-4lhn4\" (UID: \"3ef01c45-505f-45f6-98ec-4e08418caeee\") " pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:10:17.913528 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:17.913342    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ef01c45-505f-45f6-98ec-4e08418caeee-istio-data\") pod \"e2e-explicit-57c530-openshift-default-db4c98744-4lhn4\" (UID: \"3ef01c45-505f-45f6-98ec-4e08418caeee\") " pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:10:17.913528 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:17.913360    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ef01c45-505f-45f6-98ec-4e08418caeee-istio-token\") pod \"e2e-explicit-57c530-openshift-default-db4c98744-4lhn4\" (UID: \"3ef01c45-505f-45f6-98ec-4e08418caeee\") " pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:10:17.913528 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:17.913496    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ef01c45-505f-45f6-98ec-4e08418caeee-workload-socket\") pod \"e2e-explicit-57c530-openshift-default-db4c98744-4lhn4\" (UID: \"3ef01c45-505f-45f6-98ec-4e08418caeee\") " pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:10:17.913800 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:17.913555    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ef01c45-505f-45f6-98ec-4e08418caeee-credential-socket\") pod \"e2e-explicit-57c530-openshift-default-db4c98744-4lhn4\" (UID: \"3ef01c45-505f-45f6-98ec-4e08418caeee\") " pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:10:17.913874 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:17.913853    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ef01c45-505f-45f6-98ec-4e08418caeee-istio-data\") pod \"e2e-explicit-57c530-openshift-default-db4c98744-4lhn4\" (UID: \"3ef01c45-505f-45f6-98ec-4e08418caeee\") " pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:10:17.914010 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:17.913986    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ef01c45-505f-45f6-98ec-4e08418caeee-workload-certs\") pod \"e2e-explicit-57c530-openshift-default-db4c98744-4lhn4\" (UID: \"3ef01c45-505f-45f6-98ec-4e08418caeee\") " pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:10:17.914138 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:17.914085    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ef01c45-505f-45f6-98ec-4e08418caeee-istiod-ca-cert\") pod \"e2e-explicit-57c530-openshift-default-db4c98744-4lhn4\" (UID: \"3ef01c45-505f-45f6-98ec-4e08418caeee\") " pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:10:17.915632 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:17.915612    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ef01c45-505f-45f6-98ec-4e08418caeee-istio-envoy\") pod \"e2e-explicit-57c530-openshift-default-db4c98744-4lhn4\" (UID: \"3ef01c45-505f-45f6-98ec-4e08418caeee\") " pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:10:17.915868 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:17.915846    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ef01c45-505f-45f6-98ec-4e08418caeee-istio-podinfo\") pod \"e2e-explicit-57c530-openshift-default-db4c98744-4lhn4\" (UID: \"3ef01c45-505f-45f6-98ec-4e08418caeee\") " pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:10:17.922507 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:17.922487    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp252\" (UniqueName: \"kubernetes.io/projected/3ef01c45-505f-45f6-98ec-4e08418caeee-kube-api-access-bp252\") pod \"e2e-explicit-57c530-openshift-default-db4c98744-4lhn4\" (UID: \"3ef01c45-505f-45f6-98ec-4e08418caeee\") " pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:10:17.924721 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:17.924697    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ef01c45-505f-45f6-98ec-4e08418caeee-istio-token\") pod \"e2e-explicit-57c530-openshift-default-db4c98744-4lhn4\" (UID: \"3ef01c45-505f-45f6-98ec-4e08418caeee\") " pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:10:18.073343 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:18.073318    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:10:18.355484 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:18.355437    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"]
Sep 11 04:10:18.356501 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:10:18.356468    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ef01c45_505f_45f6_98ec_4e08418caeee.slice/crio-2042f437093cb2d5fc19fb1cc935cdc434f581d558f19a7f4f13b80f83011fae WatchSource:0}: Error finding container 2042f437093cb2d5fc19fb1cc935cdc434f581d558f19a7f4f13b80f83011fae: Status 404 returned error can't find the container with id 2042f437093cb2d5fc19fb1cc935cdc434f581d558f19a7f4f13b80f83011fae
Sep 11 04:10:18.358662 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:18.358630    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:10:18.358762 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:18.358696    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:10:18.358762 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:18.358724    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:10:18.949861 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:18.949832    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4" event={"ID":"3ef01c45-505f-45f6-98ec-4e08418caeee","Type":"ContainerStarted","Data":"51625f78249753e7202e0b8c964c495846308042572fdc05efb46aaacf02ac40"}
Sep 11 04:10:18.950211 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:18.949878    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4" event={"ID":"3ef01c45-505f-45f6-98ec-4e08418caeee","Type":"ContainerStarted","Data":"2042f437093cb2d5fc19fb1cc935cdc434f581d558f19a7f4f13b80f83011fae"}
Sep 11 04:10:18.981848 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:18.981800    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4" podStartSLOduration=1.981783973 podStartE2EDuration="1.981783973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:10:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:10:18.977641838 +0000 UTC m=+1015.775731565" watchObservedRunningTime="2026-09-11 04:10:18.981783973 +0000 UTC m=+1015.779873700"
Sep 11 04:10:19.073686 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:19.073661    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:10:19.078722 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:19.078699    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:10:19.955630 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:19.955603    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:10:19.956454 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:19.956434    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:10:22.075460 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:22.075422    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-57c530-6b8f4855df-jxgln"]
Sep 11 04:10:22.079400 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:22.079356    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-57c530-6b8f4855df-jxgln"
Sep 11 04:10:22.082202 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:22.082172    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-57c530-serving-cert\""
Sep 11 04:10:22.090902 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:22.090872    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-57c530-6b8f4855df-jxgln"]
Sep 11 04:10:22.157872 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:22.157838    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3647eeed-b4cd-47b7-a180-0c34b5930a9c-metrics-certs\") pod \"maas-api-e2e-explicit-57c530-6b8f4855df-jxgln\" (UID: \"3647eeed-b4cd-47b7-a180-0c34b5930a9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-57c530-6b8f4855df-jxgln"
Sep 11 04:10:22.158049 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:22.157896    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3647eeed-b4cd-47b7-a180-0c34b5930a9c-openshift-service-ca\") pod \"maas-api-e2e-explicit-57c530-6b8f4855df-jxgln\" (UID: \"3647eeed-b4cd-47b7-a180-0c34b5930a9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-57c530-6b8f4855df-jxgln"
Sep 11 04:10:22.158049 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:22.157969    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpsz5\" (UniqueName: \"kubernetes.io/projected/3647eeed-b4cd-47b7-a180-0c34b5930a9c-kube-api-access-cpsz5\") pod \"maas-api-e2e-explicit-57c530-6b8f4855df-jxgln\" (UID: \"3647eeed-b4cd-47b7-a180-0c34b5930a9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-57c530-6b8f4855df-jxgln"
Sep 11 04:10:22.158049 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:22.158020    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3647eeed-b4cd-47b7-a180-0c34b5930a9c-maas-api-tls\") pod \"maas-api-e2e-explicit-57c530-6b8f4855df-jxgln\" (UID: \"3647eeed-b4cd-47b7-a180-0c34b5930a9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-57c530-6b8f4855df-jxgln"
Sep 11 04:10:22.203362 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:22.203315    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:10:22.259560 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:22.259519    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3647eeed-b4cd-47b7-a180-0c34b5930a9c-openshift-service-ca\") pod \"maas-api-e2e-explicit-57c530-6b8f4855df-jxgln\" (UID: \"3647eeed-b4cd-47b7-a180-0c34b5930a9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-57c530-6b8f4855df-jxgln"
Sep 11 04:10:22.259774 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:22.259572    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpsz5\" (UniqueName: \"kubernetes.io/projected/3647eeed-b4cd-47b7-a180-0c34b5930a9c-kube-api-access-cpsz5\") pod \"maas-api-e2e-explicit-57c530-6b8f4855df-jxgln\" (UID: \"3647eeed-b4cd-47b7-a180-0c34b5930a9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-57c530-6b8f4855df-jxgln"
Sep 11 04:10:22.259774 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:22.259694    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3647eeed-b4cd-47b7-a180-0c34b5930a9c-maas-api-tls\") pod \"maas-api-e2e-explicit-57c530-6b8f4855df-jxgln\" (UID: \"3647eeed-b4cd-47b7-a180-0c34b5930a9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-57c530-6b8f4855df-jxgln"
Sep 11 04:10:22.259913 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:22.259800    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3647eeed-b4cd-47b7-a180-0c34b5930a9c-metrics-certs\") pod \"maas-api-e2e-explicit-57c530-6b8f4855df-jxgln\" (UID: \"3647eeed-b4cd-47b7-a180-0c34b5930a9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-57c530-6b8f4855df-jxgln"
Sep 11 04:10:22.259913 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:10:22.259820    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-57c530-serving-cert: secret "maas-api-e2e-explicit-57c530-serving-cert" not found
Sep 11 04:10:22.259913 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:10:22.259874    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3647eeed-b4cd-47b7-a180-0c34b5930a9c-maas-api-tls podName:3647eeed-b4cd-47b7-a180-0c34b5930a9c nodeName:}" failed. No retries permitted until 2026-09-11 04:10:22.759858668 +0000 UTC m=+1019.557948390 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3647eeed-b4cd-47b7-a180-0c34b5930a9c-maas-api-tls") pod "maas-api-e2e-explicit-57c530-6b8f4855df-jxgln" (UID: "3647eeed-b4cd-47b7-a180-0c34b5930a9c") : secret "maas-api-e2e-explicit-57c530-serving-cert" not found
Sep 11 04:10:22.260355 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:22.260324    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3647eeed-b4cd-47b7-a180-0c34b5930a9c-openshift-service-ca\") pod \"maas-api-e2e-explicit-57c530-6b8f4855df-jxgln\" (UID: \"3647eeed-b4cd-47b7-a180-0c34b5930a9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-57c530-6b8f4855df-jxgln"
Sep 11 04:10:22.262240 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:22.262223    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3647eeed-b4cd-47b7-a180-0c34b5930a9c-metrics-certs\") pod \"maas-api-e2e-explicit-57c530-6b8f4855df-jxgln\" (UID: \"3647eeed-b4cd-47b7-a180-0c34b5930a9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-57c530-6b8f4855df-jxgln"
Sep 11 04:10:22.275612 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:22.275583    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpsz5\" (UniqueName: \"kubernetes.io/projected/3647eeed-b4cd-47b7-a180-0c34b5930a9c-kube-api-access-cpsz5\") pod \"maas-api-e2e-explicit-57c530-6b8f4855df-jxgln\" (UID: \"3647eeed-b4cd-47b7-a180-0c34b5930a9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-57c530-6b8f4855df-jxgln"
Sep 11 04:10:22.764728 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:22.764688    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3647eeed-b4cd-47b7-a180-0c34b5930a9c-maas-api-tls\") pod \"maas-api-e2e-explicit-57c530-6b8f4855df-jxgln\" (UID: \"3647eeed-b4cd-47b7-a180-0c34b5930a9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-57c530-6b8f4855df-jxgln"
Sep 11 04:10:22.767029 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:22.767000    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3647eeed-b4cd-47b7-a180-0c34b5930a9c-maas-api-tls\") pod \"maas-api-e2e-explicit-57c530-6b8f4855df-jxgln\" (UID: \"3647eeed-b4cd-47b7-a180-0c34b5930a9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-57c530-6b8f4855df-jxgln"
Sep 11 04:10:22.995131 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:22.995080    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-57c530-6b8f4855df-jxgln"
Sep 11 04:10:23.279370 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:23.279336    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-57c530-6b8f4855df-jxgln"]
Sep 11 04:10:23.279772 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:10:23.279500    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3647eeed_b4cd_47b7_a180_0c34b5930a9c.slice/crio-72bb2de5beb0b08c702d904303d3ca1d7be945326462660e6ab45ae956743f24 WatchSource:0}: Error finding container 72bb2de5beb0b08c702d904303d3ca1d7be945326462660e6ab45ae956743f24: Status 404 returned error can't find the container with id 72bb2de5beb0b08c702d904303d3ca1d7be945326462660e6ab45ae956743f24
Sep 11 04:10:23.982673 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:23.982588    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-57c530-6b8f4855df-jxgln" event={"ID":"3647eeed-b4cd-47b7-a180-0c34b5930a9c","Type":"ContainerStarted","Data":"f0b7a56450962daccac91acffa3c41e6ce70d1be275d59b40bf0d255c679f1ea"}
Sep 11 04:10:23.982673 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:23.982642    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-57c530-6b8f4855df-jxgln" event={"ID":"3647eeed-b4cd-47b7-a180-0c34b5930a9c","Type":"ContainerStarted","Data":"72bb2de5beb0b08c702d904303d3ca1d7be945326462660e6ab45ae956743f24"}
Sep 11 04:10:23.982673 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:23.982674    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-57c530-6b8f4855df-jxgln"
Sep 11 04:10:24.005955 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:24.005899    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-57c530-6b8f4855df-jxgln" podStartSLOduration=1.607091179 podStartE2EDuration="2.005883197s" totalImagesPullingTime="398.792018ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:10:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:10:24.002470252 +0000 UTC m=+1020.800559980" watchObservedRunningTime="2026-09-11 04:10:24.005883197 +0000 UTC m=+1020.803972924"
Sep 11 04:10:29.995525 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:29.995496    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-57c530-6b8f4855df-jxgln"
Sep 11 04:10:40.998931 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:40.998903    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:10:41.086713 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:41.086687    2558 generic.go:356] "Generic (PLEG): container finished" podID="3ef01c45-505f-45f6-98ec-4e08418caeee" containerID="51625f78249753e7202e0b8c964c495846308042572fdc05efb46aaacf02ac40" exitCode=0
Sep 11 04:10:41.086816 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:41.086753    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4" event={"ID":"3ef01c45-505f-45f6-98ec-4e08418caeee","Type":"ContainerDied","Data":"51625f78249753e7202e0b8c964c495846308042572fdc05efb46aaacf02ac40"}
Sep 11 04:10:41.087139 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:41.087125    2558 scope.go:117] "RemoveContainer" containerID="51625f78249753e7202e0b8c964c495846308042572fdc05efb46aaacf02ac40"
Sep 11 04:10:41.088151 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:41.088126    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:10:41.088203 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:41.088191    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:10:41.088258 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:41.088221    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:10:42.097806 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:42.097772    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4" event={"ID":"3ef01c45-505f-45f6-98ec-4e08418caeee","Type":"ContainerStarted","Data":"050dea9abc355bf1fca0e45f57b866238bfc7235dfe49ee8ee14e7630f18b8e6"}
Sep 11 04:10:43.074281 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:43.074248    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:10:43.074525 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:43.074503    2558 patch_prober.go:28] interesting pod/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 11 04:10:43.074582 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:43.074552    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4" podUID="3ef01c45-505f-45f6-98ec-4e08418caeee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 11 04:10:44.074689 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:44.074654    2558 patch_prober.go:28] interesting pod/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 11 04:10:44.075052 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:44.074714    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4" podUID="3ef01c45-505f-45f6-98ec-4e08418caeee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 11 04:10:45.074358 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:45.074319    2558 patch_prober.go:28] interesting pod/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 11 04:10:45.074548 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:45.074411    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4" podUID="3ef01c45-505f-45f6-98ec-4e08418caeee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 11 04:10:46.073894 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:46.073861    2558 patch_prober.go:28] interesting pod/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 11 04:10:46.074330 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:46.073919    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4" podUID="3ef01c45-505f-45f6-98ec-4e08418caeee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 11 04:10:47.222642 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:47.222614    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:10:47.223110 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:47.222987    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:10:47.223665 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:47.223644    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:10:57.793146 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:10:57.793108    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:11:17.005436 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:17.005338    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:11:31.897171 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:31.897127    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:11:32.818001 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:32.817956    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-57c530-6b8f4855df-jxgln"]
Sep 11 04:11:32.818282 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:32.818232    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-57c530-6b8f4855df-jxgln" podUID="3647eeed-b4cd-47b7-a180-0c34b5930a9c" containerName="maas-api" containerID="cri-o://f0b7a56450962daccac91acffa3c41e6ce70d1be275d59b40bf0d255c679f1ea" gracePeriod=30
Sep 11 04:11:33.079653 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:33.079596    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-57c530-6b8f4855df-jxgln"
Sep 11 04:11:33.119112 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:33.119076    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3647eeed-b4cd-47b7-a180-0c34b5930a9c-metrics-certs\") pod \"3647eeed-b4cd-47b7-a180-0c34b5930a9c\" (UID: \"3647eeed-b4cd-47b7-a180-0c34b5930a9c\") "
Sep 11 04:11:33.119293 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:33.119137    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3647eeed-b4cd-47b7-a180-0c34b5930a9c-maas-api-tls\") pod \"3647eeed-b4cd-47b7-a180-0c34b5930a9c\" (UID: \"3647eeed-b4cd-47b7-a180-0c34b5930a9c\") "
Sep 11 04:11:33.119293 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:33.119196    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3647eeed-b4cd-47b7-a180-0c34b5930a9c-openshift-service-ca\") pod \"3647eeed-b4cd-47b7-a180-0c34b5930a9c\" (UID: \"3647eeed-b4cd-47b7-a180-0c34b5930a9c\") "
Sep 11 04:11:33.119452 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:33.119297    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpsz5\" (UniqueName: \"kubernetes.io/projected/3647eeed-b4cd-47b7-a180-0c34b5930a9c-kube-api-access-cpsz5\") pod \"3647eeed-b4cd-47b7-a180-0c34b5930a9c\" (UID: \"3647eeed-b4cd-47b7-a180-0c34b5930a9c\") "
Sep 11 04:11:33.119956 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:33.119898    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3647eeed-b4cd-47b7-a180-0c34b5930a9c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3647eeed-b4cd-47b7-a180-0c34b5930a9c" (UID: "3647eeed-b4cd-47b7-a180-0c34b5930a9c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:11:33.122342 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:33.122147    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3647eeed-b4cd-47b7-a180-0c34b5930a9c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3647eeed-b4cd-47b7-a180-0c34b5930a9c" (UID: "3647eeed-b4cd-47b7-a180-0c34b5930a9c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:11:33.123635 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:33.123597    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3647eeed-b4cd-47b7-a180-0c34b5930a9c-kube-api-access-cpsz5" (OuterVolumeSpecName: "kube-api-access-cpsz5") pod "3647eeed-b4cd-47b7-a180-0c34b5930a9c" (UID: "3647eeed-b4cd-47b7-a180-0c34b5930a9c"). InnerVolumeSpecName "kube-api-access-cpsz5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:11:33.131550 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:33.130884    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3647eeed-b4cd-47b7-a180-0c34b5930a9c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3647eeed-b4cd-47b7-a180-0c34b5930a9c" (UID: "3647eeed-b4cd-47b7-a180-0c34b5930a9c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:11:33.221047 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:33.221012    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpsz5\" (UniqueName: \"kubernetes.io/projected/3647eeed-b4cd-47b7-a180-0c34b5930a9c-kube-api-access-cpsz5\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:11:33.221047 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:33.221045    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3647eeed-b4cd-47b7-a180-0c34b5930a9c-metrics-certs\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:11:33.221047 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:33.221055    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3647eeed-b4cd-47b7-a180-0c34b5930a9c-maas-api-tls\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:11:33.221047 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:33.221063    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3647eeed-b4cd-47b7-a180-0c34b5930a9c-openshift-service-ca\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:11:33.390658 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:33.390579    2558 generic.go:356] "Generic (PLEG): container finished" podID="3647eeed-b4cd-47b7-a180-0c34b5930a9c" containerID="f0b7a56450962daccac91acffa3c41e6ce70d1be275d59b40bf0d255c679f1ea" exitCode=0
Sep 11 04:11:33.390658 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:33.390638    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-57c530-6b8f4855df-jxgln"
Sep 11 04:11:33.390836 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:33.390625    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-57c530-6b8f4855df-jxgln" event={"ID":"3647eeed-b4cd-47b7-a180-0c34b5930a9c","Type":"ContainerDied","Data":"f0b7a56450962daccac91acffa3c41e6ce70d1be275d59b40bf0d255c679f1ea"}
Sep 11 04:11:33.390836 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:33.390776    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-57c530-6b8f4855df-jxgln" event={"ID":"3647eeed-b4cd-47b7-a180-0c34b5930a9c","Type":"ContainerDied","Data":"72bb2de5beb0b08c702d904303d3ca1d7be945326462660e6ab45ae956743f24"}
Sep 11 04:11:33.390836 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:33.390806    2558 scope.go:117] "RemoveContainer" containerID="f0b7a56450962daccac91acffa3c41e6ce70d1be275d59b40bf0d255c679f1ea"
Sep 11 04:11:33.401183 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:33.401169    2558 scope.go:117] "RemoveContainer" containerID="f0b7a56450962daccac91acffa3c41e6ce70d1be275d59b40bf0d255c679f1ea"
Sep 11 04:11:33.401445 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:11:33.401428    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0b7a56450962daccac91acffa3c41e6ce70d1be275d59b40bf0d255c679f1ea\": container with ID starting with f0b7a56450962daccac91acffa3c41e6ce70d1be275d59b40bf0d255c679f1ea not found: ID does not exist" containerID="f0b7a56450962daccac91acffa3c41e6ce70d1be275d59b40bf0d255c679f1ea"
Sep 11 04:11:33.401494 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:33.401454    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0b7a56450962daccac91acffa3c41e6ce70d1be275d59b40bf0d255c679f1ea"} err="failed to get container status \"f0b7a56450962daccac91acffa3c41e6ce70d1be275d59b40bf0d255c679f1ea\": rpc error: code = NotFound desc = could not find container \"f0b7a56450962daccac91acffa3c41e6ce70d1be275d59b40bf0d255c679f1ea\": container with ID starting with f0b7a56450962daccac91acffa3c41e6ce70d1be275d59b40bf0d255c679f1ea not found: ID does not exist"
Sep 11 04:11:33.413986 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:33.413963    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-57c530-6b8f4855df-jxgln"]
Sep 11 04:11:33.424192 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:33.424169    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-57c530-6b8f4855df-jxgln"]
Sep 11 04:11:33.810616 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:33.810541    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3647eeed-b4cd-47b7-a180-0c34b5930a9c" path="/var/lib/kubelet/pods/3647eeed-b4cd-47b7-a180-0c34b5930a9c/volumes"
Sep 11 04:11:40.161433 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:40.161399    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"]
Sep 11 04:11:40.161901 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:40.161629    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4" podUID="3ef01c45-505f-45f6-98ec-4e08418caeee" containerName="istio-proxy" containerID="cri-o://050dea9abc355bf1fca0e45f57b866238bfc7235dfe49ee8ee14e7630f18b8e6" gracePeriod=30
Sep 11 04:11:40.710394 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:40.710349    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp"]
Sep 11 04:11:45.431779 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.431716    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:11:45.463527 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.463492    2558 generic.go:356] "Generic (PLEG): container finished" podID="3ef01c45-505f-45f6-98ec-4e08418caeee" containerID="050dea9abc355bf1fca0e45f57b866238bfc7235dfe49ee8ee14e7630f18b8e6" exitCode=0
Sep 11 04:11:45.463693 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.463535    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"
Sep 11 04:11:45.463693 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.463548    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4" event={"ID":"3ef01c45-505f-45f6-98ec-4e08418caeee","Type":"ContainerDied","Data":"050dea9abc355bf1fca0e45f57b866238bfc7235dfe49ee8ee14e7630f18b8e6"}
Sep 11 04:11:45.463693 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.463594    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4" event={"ID":"3ef01c45-505f-45f6-98ec-4e08418caeee","Type":"ContainerDied","Data":"2042f437093cb2d5fc19fb1cc935cdc434f581d558f19a7f4f13b80f83011fae"}
Sep 11 04:11:45.463693 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.463617    2558 scope.go:117] "RemoveContainer" containerID="050dea9abc355bf1fca0e45f57b866238bfc7235dfe49ee8ee14e7630f18b8e6"
Sep 11 04:11:45.476188 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.476165    2558 scope.go:117] "RemoveContainer" containerID="51625f78249753e7202e0b8c964c495846308042572fdc05efb46aaacf02ac40"
Sep 11 04:11:45.484420 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.484373    2558 scope.go:117] "RemoveContainer" containerID="050dea9abc355bf1fca0e45f57b866238bfc7235dfe49ee8ee14e7630f18b8e6"
Sep 11 04:11:45.484705 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:11:45.484685    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"050dea9abc355bf1fca0e45f57b866238bfc7235dfe49ee8ee14e7630f18b8e6\": container with ID starting with 050dea9abc355bf1fca0e45f57b866238bfc7235dfe49ee8ee14e7630f18b8e6 not found: ID does not exist" containerID="050dea9abc355bf1fca0e45f57b866238bfc7235dfe49ee8ee14e7630f18b8e6"
Sep 11 04:11:45.484773 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.484715    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"050dea9abc355bf1fca0e45f57b866238bfc7235dfe49ee8ee14e7630f18b8e6"} err="failed to get container status \"050dea9abc355bf1fca0e45f57b866238bfc7235dfe49ee8ee14e7630f18b8e6\": rpc error: code = NotFound desc = could not find container \"050dea9abc355bf1fca0e45f57b866238bfc7235dfe49ee8ee14e7630f18b8e6\": container with ID starting with 050dea9abc355bf1fca0e45f57b866238bfc7235dfe49ee8ee14e7630f18b8e6 not found: ID does not exist"
Sep 11 04:11:45.484773 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.484732    2558 scope.go:117] "RemoveContainer" containerID="51625f78249753e7202e0b8c964c495846308042572fdc05efb46aaacf02ac40"
Sep 11 04:11:45.484997 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:11:45.484976    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51625f78249753e7202e0b8c964c495846308042572fdc05efb46aaacf02ac40\": container with ID starting with 51625f78249753e7202e0b8c964c495846308042572fdc05efb46aaacf02ac40 not found: ID does not exist" containerID="51625f78249753e7202e0b8c964c495846308042572fdc05efb46aaacf02ac40"
Sep 11 04:11:45.485046 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.485002    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51625f78249753e7202e0b8c964c495846308042572fdc05efb46aaacf02ac40"} err="failed to get container status \"51625f78249753e7202e0b8c964c495846308042572fdc05efb46aaacf02ac40\": rpc error: code = NotFound desc = could not find container \"51625f78249753e7202e0b8c964c495846308042572fdc05efb46aaacf02ac40\": container with ID starting with 51625f78249753e7202e0b8c964c495846308042572fdc05efb46aaacf02ac40 not found: ID does not exist"
Sep 11 04:11:45.539329 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.539299    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ef01c45-505f-45f6-98ec-4e08418caeee-istio-data\") pod \"3ef01c45-505f-45f6-98ec-4e08418caeee\" (UID: \"3ef01c45-505f-45f6-98ec-4e08418caeee\") "
Sep 11 04:11:45.539527 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.539357    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ef01c45-505f-45f6-98ec-4e08418caeee-istio-token\") pod \"3ef01c45-505f-45f6-98ec-4e08418caeee\" (UID: \"3ef01c45-505f-45f6-98ec-4e08418caeee\") "
Sep 11 04:11:45.539527 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.539411    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ef01c45-505f-45f6-98ec-4e08418caeee-credential-socket\") pod \"3ef01c45-505f-45f6-98ec-4e08418caeee\" (UID: \"3ef01c45-505f-45f6-98ec-4e08418caeee\") "
Sep 11 04:11:45.539527 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.539447    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ef01c45-505f-45f6-98ec-4e08418caeee-istio-podinfo\") pod \"3ef01c45-505f-45f6-98ec-4e08418caeee\" (UID: \"3ef01c45-505f-45f6-98ec-4e08418caeee\") "
Sep 11 04:11:45.539527 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.539471    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bp252\" (UniqueName: \"kubernetes.io/projected/3ef01c45-505f-45f6-98ec-4e08418caeee-kube-api-access-bp252\") pod \"3ef01c45-505f-45f6-98ec-4e08418caeee\" (UID: \"3ef01c45-505f-45f6-98ec-4e08418caeee\") "
Sep 11 04:11:45.539527 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.539501    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ef01c45-505f-45f6-98ec-4e08418caeee-workload-certs\") pod \"3ef01c45-505f-45f6-98ec-4e08418caeee\" (UID: \"3ef01c45-505f-45f6-98ec-4e08418caeee\") "
Sep 11 04:11:45.539798 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.539532    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ef01c45-505f-45f6-98ec-4e08418caeee-workload-socket\") pod \"3ef01c45-505f-45f6-98ec-4e08418caeee\" (UID: \"3ef01c45-505f-45f6-98ec-4e08418caeee\") "
Sep 11 04:11:45.539798 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.539561    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ef01c45-505f-45f6-98ec-4e08418caeee-istio-envoy\") pod \"3ef01c45-505f-45f6-98ec-4e08418caeee\" (UID: \"3ef01c45-505f-45f6-98ec-4e08418caeee\") "
Sep 11 04:11:45.539798 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.539621    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ef01c45-505f-45f6-98ec-4e08418caeee-istio-data" (OuterVolumeSpecName: "istio-data") pod "3ef01c45-505f-45f6-98ec-4e08418caeee" (UID: "3ef01c45-505f-45f6-98ec-4e08418caeee"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:11:45.539798 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.539639    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ef01c45-505f-45f6-98ec-4e08418caeee-istiod-ca-cert\") pod \"3ef01c45-505f-45f6-98ec-4e08418caeee\" (UID: \"3ef01c45-505f-45f6-98ec-4e08418caeee\") "
Sep 11 04:11:45.539798 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.539721    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ef01c45-505f-45f6-98ec-4e08418caeee-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3ef01c45-505f-45f6-98ec-4e08418caeee" (UID: "3ef01c45-505f-45f6-98ec-4e08418caeee"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:11:45.540121 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.539805    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ef01c45-505f-45f6-98ec-4e08418caeee-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3ef01c45-505f-45f6-98ec-4e08418caeee" (UID: "3ef01c45-505f-45f6-98ec-4e08418caeee"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:11:45.540121 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.539987    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ef01c45-505f-45f6-98ec-4e08418caeee-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3ef01c45-505f-45f6-98ec-4e08418caeee" (UID: "3ef01c45-505f-45f6-98ec-4e08418caeee"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:11:45.540121 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.540022    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ef01c45-505f-45f6-98ec-4e08418caeee-workload-socket\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:11:45.540121 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.540039    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ef01c45-505f-45f6-98ec-4e08418caeee-istio-data\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:11:45.540121 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.540051    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ef01c45-505f-45f6-98ec-4e08418caeee-credential-socket\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:11:45.540121 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.540113    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ef01c45-505f-45f6-98ec-4e08418caeee-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3ef01c45-505f-45f6-98ec-4e08418caeee" (UID: "3ef01c45-505f-45f6-98ec-4e08418caeee"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:11:45.541834 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.541808    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ef01c45-505f-45f6-98ec-4e08418caeee-kube-api-access-bp252" (OuterVolumeSpecName: "kube-api-access-bp252") pod "3ef01c45-505f-45f6-98ec-4e08418caeee" (UID: "3ef01c45-505f-45f6-98ec-4e08418caeee"). InnerVolumeSpecName "kube-api-access-bp252". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:11:45.541834 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.541823    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3ef01c45-505f-45f6-98ec-4e08418caeee-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3ef01c45-505f-45f6-98ec-4e08418caeee" (UID: "3ef01c45-505f-45f6-98ec-4e08418caeee"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 04:11:45.541965 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.541824    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ef01c45-505f-45f6-98ec-4e08418caeee-istio-token" (OuterVolumeSpecName: "istio-token") pod "3ef01c45-505f-45f6-98ec-4e08418caeee" (UID: "3ef01c45-505f-45f6-98ec-4e08418caeee"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:11:45.541965 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.541882    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ef01c45-505f-45f6-98ec-4e08418caeee-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3ef01c45-505f-45f6-98ec-4e08418caeee" (UID: "3ef01c45-505f-45f6-98ec-4e08418caeee"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:11:45.640531 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.640493    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ef01c45-505f-45f6-98ec-4e08418caeee-istiod-ca-cert\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:11:45.640531 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.640524    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ef01c45-505f-45f6-98ec-4e08418caeee-istio-token\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:11:45.640531 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.640536    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ef01c45-505f-45f6-98ec-4e08418caeee-istio-podinfo\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:11:45.640769 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.640547    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bp252\" (UniqueName: \"kubernetes.io/projected/3ef01c45-505f-45f6-98ec-4e08418caeee-kube-api-access-bp252\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:11:45.640769 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.640560    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ef01c45-505f-45f6-98ec-4e08418caeee-workload-certs\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:11:45.640769 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.640570    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ef01c45-505f-45f6-98ec-4e08418caeee-istio-envoy\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:11:45.787725 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.787697    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"]
Sep 11 04:11:45.791277 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.791250    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4"]
Sep 11 04:11:45.810260 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:45.810235    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ef01c45-505f-45f6-98ec-4e08418caeee" path="/var/lib/kubelet/pods/3ef01c45-505f-45f6-98ec-4e08418caeee/volumes"
Sep 11 04:11:46.897367 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:46.897327    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:11:50.167593 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.167564    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"]
Sep 11 04:11:50.167984 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.167933    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ef01c45-505f-45f6-98ec-4e08418caeee" containerName="istio-proxy"
Sep 11 04:11:50.167984 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.167944    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ef01c45-505f-45f6-98ec-4e08418caeee" containerName="istio-proxy"
Sep 11 04:11:50.167984 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.167954    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3647eeed-b4cd-47b7-a180-0c34b5930a9c" containerName="maas-api"
Sep 11 04:11:50.167984 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.167959    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3647eeed-b4cd-47b7-a180-0c34b5930a9c" containerName="maas-api"
Sep 11 04:11:50.167984 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.167967    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ef01c45-505f-45f6-98ec-4e08418caeee" containerName="istio-proxy"
Sep 11 04:11:50.167984 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.167972    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ef01c45-505f-45f6-98ec-4e08418caeee" containerName="istio-proxy"
Sep 11 04:11:50.168207 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.168039    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ef01c45-505f-45f6-98ec-4e08418caeee" containerName="istio-proxy"
Sep 11 04:11:50.168207 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.168050    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3647eeed-b4cd-47b7-a180-0c34b5930a9c" containerName="maas-api"
Sep 11 04:11:50.172931 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.172911    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:11:50.175894 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.175871    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-34523cde-openshift-default-dockercfg-l2b2x\""
Sep 11 04:11:50.188061 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.188036    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"]
Sep 11 04:11:50.283911 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.283873    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nt2w\" (UniqueName: \"kubernetes.io/projected/92dc0c33-84f3-4dd8-957e-d3eb9301f146-kube-api-access-7nt2w\") pod \"e2e-mt-34523cde-openshift-default-67c485458d-m4t8x\" (UID: \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\") " pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:11:50.284103 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.283951    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92dc0c33-84f3-4dd8-957e-d3eb9301f146-istio-data\") pod \"e2e-mt-34523cde-openshift-default-67c485458d-m4t8x\" (UID: \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\") " pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:11:50.284103 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.283989    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92dc0c33-84f3-4dd8-957e-d3eb9301f146-istio-podinfo\") pod \"e2e-mt-34523cde-openshift-default-67c485458d-m4t8x\" (UID: \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\") " pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:11:50.284103 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.284062    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92dc0c33-84f3-4dd8-957e-d3eb9301f146-workload-certs\") pod \"e2e-mt-34523cde-openshift-default-67c485458d-m4t8x\" (UID: \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\") " pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:11:50.284103 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.284098    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92dc0c33-84f3-4dd8-957e-d3eb9301f146-workload-socket\") pod \"e2e-mt-34523cde-openshift-default-67c485458d-m4t8x\" (UID: \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\") " pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:11:50.284275 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.284130    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92dc0c33-84f3-4dd8-957e-d3eb9301f146-istio-envoy\") pod \"e2e-mt-34523cde-openshift-default-67c485458d-m4t8x\" (UID: \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\") " pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:11:50.284275 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.284159    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92dc0c33-84f3-4dd8-957e-d3eb9301f146-istiod-ca-cert\") pod \"e2e-mt-34523cde-openshift-default-67c485458d-m4t8x\" (UID: \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\") " pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:11:50.284275 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.284215    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92dc0c33-84f3-4dd8-957e-d3eb9301f146-credential-socket\") pod \"e2e-mt-34523cde-openshift-default-67c485458d-m4t8x\" (UID: \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\") " pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:11:50.284275 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.284267    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92dc0c33-84f3-4dd8-957e-d3eb9301f146-istio-token\") pod \"e2e-mt-34523cde-openshift-default-67c485458d-m4t8x\" (UID: \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\") " pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:11:50.385024 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.384994    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92dc0c33-84f3-4dd8-957e-d3eb9301f146-istio-data\") pod \"e2e-mt-34523cde-openshift-default-67c485458d-m4t8x\" (UID: \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\") " pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:11:50.385175 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.385029    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92dc0c33-84f3-4dd8-957e-d3eb9301f146-istio-podinfo\") pod \"e2e-mt-34523cde-openshift-default-67c485458d-m4t8x\" (UID: \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\") " pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:11:50.385175 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.385056    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92dc0c33-84f3-4dd8-957e-d3eb9301f146-workload-certs\") pod \"e2e-mt-34523cde-openshift-default-67c485458d-m4t8x\" (UID: \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\") " pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:11:50.385175 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.385075    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92dc0c33-84f3-4dd8-957e-d3eb9301f146-workload-socket\") pod \"e2e-mt-34523cde-openshift-default-67c485458d-m4t8x\" (UID: \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\") " pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:11:50.385175 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.385099    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92dc0c33-84f3-4dd8-957e-d3eb9301f146-istio-envoy\") pod \"e2e-mt-34523cde-openshift-default-67c485458d-m4t8x\" (UID: \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\") " pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:11:50.385175 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.385131    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92dc0c33-84f3-4dd8-957e-d3eb9301f146-istiod-ca-cert\") pod \"e2e-mt-34523cde-openshift-default-67c485458d-m4t8x\" (UID: \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\") " pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:11:50.385175 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.385149    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92dc0c33-84f3-4dd8-957e-d3eb9301f146-credential-socket\") pod \"e2e-mt-34523cde-openshift-default-67c485458d-m4t8x\" (UID: \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\") " pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:11:50.385175 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.385172    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92dc0c33-84f3-4dd8-957e-d3eb9301f146-istio-token\") pod \"e2e-mt-34523cde-openshift-default-67c485458d-m4t8x\" (UID: \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\") " pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:11:50.385566 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.385220    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nt2w\" (UniqueName: \"kubernetes.io/projected/92dc0c33-84f3-4dd8-957e-d3eb9301f146-kube-api-access-7nt2w\") pod \"e2e-mt-34523cde-openshift-default-67c485458d-m4t8x\" (UID: \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\") " pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:11:50.385566 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.385455    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92dc0c33-84f3-4dd8-957e-d3eb9301f146-istio-data\") pod \"e2e-mt-34523cde-openshift-default-67c485458d-m4t8x\" (UID: \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\") " pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:11:50.385709 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.385681    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92dc0c33-84f3-4dd8-957e-d3eb9301f146-workload-socket\") pod \"e2e-mt-34523cde-openshift-default-67c485458d-m4t8x\" (UID: \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\") " pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:11:50.385769 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.385693    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92dc0c33-84f3-4dd8-957e-d3eb9301f146-workload-certs\") pod \"e2e-mt-34523cde-openshift-default-67c485458d-m4t8x\" (UID: \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\") " pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:11:50.385769 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.385743    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92dc0c33-84f3-4dd8-957e-d3eb9301f146-credential-socket\") pod \"e2e-mt-34523cde-openshift-default-67c485458d-m4t8x\" (UID: \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\") " pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:11:50.386157 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.386132    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92dc0c33-84f3-4dd8-957e-d3eb9301f146-istiod-ca-cert\") pod \"e2e-mt-34523cde-openshift-default-67c485458d-m4t8x\" (UID: \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\") " pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:11:50.387482 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.387459    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92dc0c33-84f3-4dd8-957e-d3eb9301f146-istio-envoy\") pod \"e2e-mt-34523cde-openshift-default-67c485458d-m4t8x\" (UID: \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\") " pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:11:50.387578 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.387522    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92dc0c33-84f3-4dd8-957e-d3eb9301f146-istio-podinfo\") pod \"e2e-mt-34523cde-openshift-default-67c485458d-m4t8x\" (UID: \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\") " pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:11:50.393927 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.393898    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92dc0c33-84f3-4dd8-957e-d3eb9301f146-istio-token\") pod \"e2e-mt-34523cde-openshift-default-67c485458d-m4t8x\" (UID: \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\") " pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:11:50.394030 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.394014    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nt2w\" (UniqueName: \"kubernetes.io/projected/92dc0c33-84f3-4dd8-957e-d3eb9301f146-kube-api-access-7nt2w\") pod \"e2e-mt-34523cde-openshift-default-67c485458d-m4t8x\" (UID: \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\") " pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:11:50.482703 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.482626    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:11:50.761858 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.761828    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"]
Sep 11 04:11:50.763034 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:11:50.763006    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92dc0c33_84f3_4dd8_957e_d3eb9301f146.slice/crio-c80ef0e5a9502d2285c2a4161a6be8fb333b9b58d0c7f0ca03a64a8d47eca15e WatchSource:0}: Error finding container c80ef0e5a9502d2285c2a4161a6be8fb333b9b58d0c7f0ca03a64a8d47eca15e: Status 404 returned error can't find the container with id c80ef0e5a9502d2285c2a4161a6be8fb333b9b58d0c7f0ca03a64a8d47eca15e
Sep 11 04:11:50.765329 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.765293    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:11:50.765465 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.765377    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:11:50.765465 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:50.765448    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:11:51.499552 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:51.499514    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x" event={"ID":"92dc0c33-84f3-4dd8-957e-d3eb9301f146","Type":"ContainerStarted","Data":"6db91dffb1a457bde2796de598b0f12e32f3333217debdb16f36030fefe6439a"}
Sep 11 04:11:51.500000 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:51.499566    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x" event={"ID":"92dc0c33-84f3-4dd8-957e-d3eb9301f146","Type":"ContainerStarted","Data":"c80ef0e5a9502d2285c2a4161a6be8fb333b9b58d0c7f0ca03a64a8d47eca15e"}
Sep 11 04:11:51.521000 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:51.520946    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x" podStartSLOduration=1.5209330570000001 podStartE2EDuration="1.520933057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:11:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:11:51.520562593 +0000 UTC m=+1108.318652322" watchObservedRunningTime="2026-09-11 04:11:51.520933057 +0000 UTC m=+1108.319022778"
Sep 11 04:11:52.483428 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:52.483379    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:11:52.488630 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:52.488605    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:11:52.505422 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:52.505374    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:11:52.506102 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:52.506081    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:11:52.758520 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:52.758438    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv"]
Sep 11 04:11:52.758702 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:52.758654    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv" podUID="415bcf79-d9fc-447a-8b35-5596c284a7fd" containerName="maas-api" containerID="cri-o://0f2656d71e6204a634869412e9dfa811fdd242d68e477b6df7c3379afbfde284" gracePeriod=30
Sep 11 04:11:52.901154 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:52.901115    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv" podUID="415bcf79-d9fc-447a-8b35-5596c284a7fd" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.47:8443/health\": dial tcp 10.133.0.47:8443: connect: connection refused"
Sep 11 04:11:53.015916 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:53.015856    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv"
Sep 11 04:11:53.110325 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:53.110290    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/415bcf79-d9fc-447a-8b35-5596c284a7fd-maas-api-tls\") pod \"415bcf79-d9fc-447a-8b35-5596c284a7fd\" (UID: \"415bcf79-d9fc-447a-8b35-5596c284a7fd\") "
Sep 11 04:11:53.110498 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:53.110332    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/415bcf79-d9fc-447a-8b35-5596c284a7fd-metrics-certs\") pod \"415bcf79-d9fc-447a-8b35-5596c284a7fd\" (UID: \"415bcf79-d9fc-447a-8b35-5596c284a7fd\") "
Sep 11 04:11:53.110498 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:53.110406    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcjk2\" (UniqueName: \"kubernetes.io/projected/415bcf79-d9fc-447a-8b35-5596c284a7fd-kube-api-access-wcjk2\") pod \"415bcf79-d9fc-447a-8b35-5596c284a7fd\" (UID: \"415bcf79-d9fc-447a-8b35-5596c284a7fd\") "
Sep 11 04:11:53.110498 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:53.110450    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/415bcf79-d9fc-447a-8b35-5596c284a7fd-openshift-service-ca\") pod \"415bcf79-d9fc-447a-8b35-5596c284a7fd\" (UID: \"415bcf79-d9fc-447a-8b35-5596c284a7fd\") "
Sep 11 04:11:53.110897 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:53.110873    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/415bcf79-d9fc-447a-8b35-5596c284a7fd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "415bcf79-d9fc-447a-8b35-5596c284a7fd" (UID: "415bcf79-d9fc-447a-8b35-5596c284a7fd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:11:53.112455 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:53.112426    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/415bcf79-d9fc-447a-8b35-5596c284a7fd-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "415bcf79-d9fc-447a-8b35-5596c284a7fd" (UID: "415bcf79-d9fc-447a-8b35-5596c284a7fd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:11:53.112455 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:53.112447    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/415bcf79-d9fc-447a-8b35-5596c284a7fd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "415bcf79-d9fc-447a-8b35-5596c284a7fd" (UID: "415bcf79-d9fc-447a-8b35-5596c284a7fd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:11:53.112604 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:53.112477    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/415bcf79-d9fc-447a-8b35-5596c284a7fd-kube-api-access-wcjk2" (OuterVolumeSpecName: "kube-api-access-wcjk2") pod "415bcf79-d9fc-447a-8b35-5596c284a7fd" (UID: "415bcf79-d9fc-447a-8b35-5596c284a7fd"). InnerVolumeSpecName "kube-api-access-wcjk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:11:53.211960 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:53.211925    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/415bcf79-d9fc-447a-8b35-5596c284a7fd-openshift-service-ca\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:11:53.211960 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:53.211953    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/415bcf79-d9fc-447a-8b35-5596c284a7fd-maas-api-tls\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:11:53.211960 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:53.211965    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/415bcf79-d9fc-447a-8b35-5596c284a7fd-metrics-certs\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:11:53.212190 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:53.211978    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcjk2\" (UniqueName: \"kubernetes.io/projected/415bcf79-d9fc-447a-8b35-5596c284a7fd-kube-api-access-wcjk2\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:11:53.512100 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:53.512061    2558 generic.go:356] "Generic (PLEG): container finished" podID="415bcf79-d9fc-447a-8b35-5596c284a7fd" containerID="0f2656d71e6204a634869412e9dfa811fdd242d68e477b6df7c3379afbfde284" exitCode=0
Sep 11 04:11:53.512548 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:53.512105    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv"
Sep 11 04:11:53.512548 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:53.512140    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv" event={"ID":"415bcf79-d9fc-447a-8b35-5596c284a7fd","Type":"ContainerDied","Data":"0f2656d71e6204a634869412e9dfa811fdd242d68e477b6df7c3379afbfde284"}
Sep 11 04:11:53.512548 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:53.512188    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv" event={"ID":"415bcf79-d9fc-447a-8b35-5596c284a7fd","Type":"ContainerDied","Data":"f606299ca5a9bb34cba9b3f7727e8042b023af5e25506f392971da58e2765437"}
Sep 11 04:11:53.512548 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:53.512210    2558 scope.go:117] "RemoveContainer" containerID="0f2656d71e6204a634869412e9dfa811fdd242d68e477b6df7c3379afbfde284"
Sep 11 04:11:53.521985 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:53.521969    2558 scope.go:117] "RemoveContainer" containerID="0f2656d71e6204a634869412e9dfa811fdd242d68e477b6df7c3379afbfde284"
Sep 11 04:11:53.522242 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:11:53.522223    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f2656d71e6204a634869412e9dfa811fdd242d68e477b6df7c3379afbfde284\": container with ID starting with 0f2656d71e6204a634869412e9dfa811fdd242d68e477b6df7c3379afbfde284 not found: ID does not exist" containerID="0f2656d71e6204a634869412e9dfa811fdd242d68e477b6df7c3379afbfde284"
Sep 11 04:11:53.522315 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:53.522249    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f2656d71e6204a634869412e9dfa811fdd242d68e477b6df7c3379afbfde284"} err="failed to get container status \"0f2656d71e6204a634869412e9dfa811fdd242d68e477b6df7c3379afbfde284\": rpc error: code = NotFound desc = could not find container \"0f2656d71e6204a634869412e9dfa811fdd242d68e477b6df7c3379afbfde284\": container with ID starting with 0f2656d71e6204a634869412e9dfa811fdd242d68e477b6df7c3379afbfde284 not found: ID does not exist"
Sep 11 04:11:53.539912 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:53.539887    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv"]
Sep 11 04:11:53.542140 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:53.542121    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a28c9f-cc6fc9644-4vtrv"]
Sep 11 04:11:53.810021 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:53.809940    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="415bcf79-d9fc-447a-8b35-5596c284a7fd" path="/var/lib/kubelet/pods/415bcf79-d9fc-447a-8b35-5596c284a7fd/volumes"
Sep 11 04:11:54.563795 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:54.563756    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg"]
Sep 11 04:11:54.564333 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:54.564312    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="415bcf79-d9fc-447a-8b35-5596c284a7fd" containerName="maas-api"
Sep 11 04:11:54.564436 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:54.564335    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="415bcf79-d9fc-447a-8b35-5596c284a7fd" containerName="maas-api"
Sep 11 04:11:54.564500 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:54.564460    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="415bcf79-d9fc-447a-8b35-5596c284a7fd" containerName="maas-api"
Sep 11 04:11:54.564500 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:54.564473    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ef01c45-505f-45f6-98ec-4e08418caeee" containerName="istio-proxy"
Sep 11 04:11:54.568818 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:54.568796    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg"
Sep 11 04:11:54.571344 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:54.571326    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-34523cde-serving-cert\""
Sep 11 04:11:54.581279 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:54.581253    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg"]
Sep 11 04:11:54.725263 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:54.725223    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24999c1b-098a-4350-bdf4-5d350bed801b-openshift-service-ca\") pod \"maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg\" (UID: \"24999c1b-098a-4350-bdf4-5d350bed801b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg"
Sep 11 04:11:54.725464 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:54.725275    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24999c1b-098a-4350-bdf4-5d350bed801b-maas-api-tls\") pod \"maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg\" (UID: \"24999c1b-098a-4350-bdf4-5d350bed801b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg"
Sep 11 04:11:54.725464 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:54.725344    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9rzc\" (UniqueName: \"kubernetes.io/projected/24999c1b-098a-4350-bdf4-5d350bed801b-kube-api-access-x9rzc\") pod \"maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg\" (UID: \"24999c1b-098a-4350-bdf4-5d350bed801b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg"
Sep 11 04:11:54.725464 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:54.725458    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24999c1b-098a-4350-bdf4-5d350bed801b-metrics-certs\") pod \"maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg\" (UID: \"24999c1b-098a-4350-bdf4-5d350bed801b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg"
Sep 11 04:11:54.826780 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:54.826750    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24999c1b-098a-4350-bdf4-5d350bed801b-metrics-certs\") pod \"maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg\" (UID: \"24999c1b-098a-4350-bdf4-5d350bed801b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg"
Sep 11 04:11:54.826949 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:54.826829    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24999c1b-098a-4350-bdf4-5d350bed801b-openshift-service-ca\") pod \"maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg\" (UID: \"24999c1b-098a-4350-bdf4-5d350bed801b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg"
Sep 11 04:11:54.826949 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:54.826876    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24999c1b-098a-4350-bdf4-5d350bed801b-maas-api-tls\") pod \"maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg\" (UID: \"24999c1b-098a-4350-bdf4-5d350bed801b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg"
Sep 11 04:11:54.826949 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:54.826911    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9rzc\" (UniqueName: \"kubernetes.io/projected/24999c1b-098a-4350-bdf4-5d350bed801b-kube-api-access-x9rzc\") pod \"maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg\" (UID: \"24999c1b-098a-4350-bdf4-5d350bed801b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg"
Sep 11 04:11:54.827110 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:11:54.827064    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-34523cde-serving-cert: secret "maas-api-e2e-mt-34523cde-serving-cert" not found
Sep 11 04:11:54.827224 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:11:54.827145    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24999c1b-098a-4350-bdf4-5d350bed801b-maas-api-tls podName:24999c1b-098a-4350-bdf4-5d350bed801b nodeName:}" failed. No retries permitted until 2026-09-11 04:11:55.327123358 +0000 UTC m=+1112.125213087 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/24999c1b-098a-4350-bdf4-5d350bed801b-maas-api-tls") pod "maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg" (UID: "24999c1b-098a-4350-bdf4-5d350bed801b") : secret "maas-api-e2e-mt-34523cde-serving-cert" not found
Sep 11 04:11:54.827498 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:54.827480    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24999c1b-098a-4350-bdf4-5d350bed801b-openshift-service-ca\") pod \"maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg\" (UID: \"24999c1b-098a-4350-bdf4-5d350bed801b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg"
Sep 11 04:11:54.829324 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:54.829305    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24999c1b-098a-4350-bdf4-5d350bed801b-metrics-certs\") pod \"maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg\" (UID: \"24999c1b-098a-4350-bdf4-5d350bed801b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg"
Sep 11 04:11:54.840135 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:54.840107    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9rzc\" (UniqueName: \"kubernetes.io/projected/24999c1b-098a-4350-bdf4-5d350bed801b-kube-api-access-x9rzc\") pod \"maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg\" (UID: \"24999c1b-098a-4350-bdf4-5d350bed801b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg"
Sep 11 04:11:55.332741 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:55.332710    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24999c1b-098a-4350-bdf4-5d350bed801b-maas-api-tls\") pod \"maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg\" (UID: \"24999c1b-098a-4350-bdf4-5d350bed801b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg"
Sep 11 04:11:55.335057 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:55.335030    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24999c1b-098a-4350-bdf4-5d350bed801b-maas-api-tls\") pod \"maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg\" (UID: \"24999c1b-098a-4350-bdf4-5d350bed801b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg"
Sep 11 04:11:55.480483 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:55.480448    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg"
Sep 11 04:11:55.729276 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:55.729174    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp" podUID="dbde454e-030c-4f60-ad5c-278488287be9" containerName="main" containerID="cri-o://04deb166ce852323e5ffa223509cf5d59ad19a5f00f1f91c16853cbeed4c2685" gracePeriod=45
Sep 11 04:11:55.758307 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:55.758277    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg"]
Sep 11 04:11:55.780255 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:11:55.780225    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24999c1b_098a_4350_bdf4_5d350bed801b.slice/crio-2a4afde2edb325c05591aa2e341df5fd8ee7ebadf2de7f4b156bfa60236f15e1 WatchSource:0}: Error finding container 2a4afde2edb325c05591aa2e341df5fd8ee7ebadf2de7f4b156bfa60236f15e1: Status 404 returned error can't find the container with id 2a4afde2edb325c05591aa2e341df5fd8ee7ebadf2de7f4b156bfa60236f15e1
Sep 11 04:11:55.972504 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:55.972482    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp"
Sep 11 04:11:56.141729 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:56.141695    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbde454e-030c-4f60-ad5c-278488287be9-tmp-dir\") pod \"dbde454e-030c-4f60-ad5c-278488287be9\" (UID: \"dbde454e-030c-4f60-ad5c-278488287be9\") "
Sep 11 04:11:56.141729 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:56.141733    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbde454e-030c-4f60-ad5c-278488287be9-home\") pod \"dbde454e-030c-4f60-ad5c-278488287be9\" (UID: \"dbde454e-030c-4f60-ad5c-278488287be9\") "
Sep 11 04:11:56.141957 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:56.141771    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzhfq\" (UniqueName: \"kubernetes.io/projected/dbde454e-030c-4f60-ad5c-278488287be9-kube-api-access-xzhfq\") pod \"dbde454e-030c-4f60-ad5c-278488287be9\" (UID: \"dbde454e-030c-4f60-ad5c-278488287be9\") "
Sep 11 04:11:56.141957 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:56.141846    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbde454e-030c-4f60-ad5c-278488287be9-model-cache\") pod \"dbde454e-030c-4f60-ad5c-278488287be9\" (UID: \"dbde454e-030c-4f60-ad5c-278488287be9\") "
Sep 11 04:11:56.141957 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:56.141876    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbde454e-030c-4f60-ad5c-278488287be9-dshm\") pod \"dbde454e-030c-4f60-ad5c-278488287be9\" (UID: \"dbde454e-030c-4f60-ad5c-278488287be9\") "
Sep 11 04:11:56.141957 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:56.141904    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbde454e-030c-4f60-ad5c-278488287be9-tls-certs\") pod \"dbde454e-030c-4f60-ad5c-278488287be9\" (UID: \"dbde454e-030c-4f60-ad5c-278488287be9\") "
Sep 11 04:11:56.142170 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:56.141971    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbde454e-030c-4f60-ad5c-278488287be9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dbde454e-030c-4f60-ad5c-278488287be9" (UID: "dbde454e-030c-4f60-ad5c-278488287be9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:11:56.142170 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:56.142039    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbde454e-030c-4f60-ad5c-278488287be9-home" (OuterVolumeSpecName: "home") pod "dbde454e-030c-4f60-ad5c-278488287be9" (UID: "dbde454e-030c-4f60-ad5c-278488287be9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:11:56.142261 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:56.142173    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbde454e-030c-4f60-ad5c-278488287be9-model-cache" (OuterVolumeSpecName: "model-cache") pod "dbde454e-030c-4f60-ad5c-278488287be9" (UID: "dbde454e-030c-4f60-ad5c-278488287be9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:11:56.142298 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:56.142277    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbde454e-030c-4f60-ad5c-278488287be9-tmp-dir\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:11:56.142330 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:56.142295    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbde454e-030c-4f60-ad5c-278488287be9-home\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:11:56.142330 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:56.142312    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbde454e-030c-4f60-ad5c-278488287be9-model-cache\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:11:56.144172 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:56.144145    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbde454e-030c-4f60-ad5c-278488287be9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dbde454e-030c-4f60-ad5c-278488287be9" (UID: "dbde454e-030c-4f60-ad5c-278488287be9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:11:56.144286 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:56.144179    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbde454e-030c-4f60-ad5c-278488287be9-dshm" (OuterVolumeSpecName: "dshm") pod "dbde454e-030c-4f60-ad5c-278488287be9" (UID: "dbde454e-030c-4f60-ad5c-278488287be9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:11:56.144286 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:56.144191    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbde454e-030c-4f60-ad5c-278488287be9-kube-api-access-xzhfq" (OuterVolumeSpecName: "kube-api-access-xzhfq") pod "dbde454e-030c-4f60-ad5c-278488287be9" (UID: "dbde454e-030c-4f60-ad5c-278488287be9"). InnerVolumeSpecName "kube-api-access-xzhfq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:11:56.250007 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:56.249970    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbde454e-030c-4f60-ad5c-278488287be9-dshm\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:11:56.250147 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:56.250003    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbde454e-030c-4f60-ad5c-278488287be9-tls-certs\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:11:56.250199 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:56.250170    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzhfq\" (UniqueName: \"kubernetes.io/projected/dbde454e-030c-4f60-ad5c-278488287be9-kube-api-access-xzhfq\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:11:56.532890 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:56.532788    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg" event={"ID":"24999c1b-098a-4350-bdf4-5d350bed801b","Type":"ContainerStarted","Data":"edcb29a017ddfa7875907af6fcb120dc5ca80c1a02d91e9f7497aae83952729e"}
Sep 11 04:11:56.532890 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:56.532874    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg" event={"ID":"24999c1b-098a-4350-bdf4-5d350bed801b","Type":"ContainerStarted","Data":"2a4afde2edb325c05591aa2e341df5fd8ee7ebadf2de7f4b156bfa60236f15e1"}
Sep 11 04:11:56.533100 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:56.532902    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg"
Sep 11 04:11:56.534244 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:56.534214    2558 generic.go:356] "Generic (PLEG): container finished" podID="dbde454e-030c-4f60-ad5c-278488287be9" containerID="04deb166ce852323e5ffa223509cf5d59ad19a5f00f1f91c16853cbeed4c2685" exitCode=0
Sep 11 04:11:56.534344 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:56.534257    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp"
Sep 11 04:11:56.534344 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:56.534270    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp" event={"ID":"dbde454e-030c-4f60-ad5c-278488287be9","Type":"ContainerDied","Data":"04deb166ce852323e5ffa223509cf5d59ad19a5f00f1f91c16853cbeed4c2685"}
Sep 11 04:11:56.534344 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:56.534307    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp" event={"ID":"dbde454e-030c-4f60-ad5c-278488287be9","Type":"ContainerDied","Data":"7587bee2f74a908c10de535f67b76681205beab11847b1238332dfccd4173c71"}
Sep 11 04:11:56.534344 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:56.534330    2558 scope.go:117] "RemoveContainer" containerID="04deb166ce852323e5ffa223509cf5d59ad19a5f00f1f91c16853cbeed4c2685"
Sep 11 04:11:56.544313 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:56.544281    2558 scope.go:117] "RemoveContainer" containerID="04deb166ce852323e5ffa223509cf5d59ad19a5f00f1f91c16853cbeed4c2685"
Sep 11 04:11:56.544602 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:11:56.544583    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04deb166ce852323e5ffa223509cf5d59ad19a5f00f1f91c16853cbeed4c2685\": container with ID starting with 04deb166ce852323e5ffa223509cf5d59ad19a5f00f1f91c16853cbeed4c2685 not found: ID does not exist" containerID="04deb166ce852323e5ffa223509cf5d59ad19a5f00f1f91c16853cbeed4c2685"
Sep 11 04:11:56.544674 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:56.544616    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04deb166ce852323e5ffa223509cf5d59ad19a5f00f1f91c16853cbeed4c2685"} err="failed to get container status \"04deb166ce852323e5ffa223509cf5d59ad19a5f00f1f91c16853cbeed4c2685\": rpc error: code = NotFound desc = could not find container \"04deb166ce852323e5ffa223509cf5d59ad19a5f00f1f91c16853cbeed4c2685\": container with ID starting with 04deb166ce852323e5ffa223509cf5d59ad19a5f00f1f91c16853cbeed4c2685 not found: ID does not exist"
Sep 11 04:11:56.553483 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:56.553444    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg" podStartSLOduration=2.118340808 podStartE2EDuration="2.553431416s" totalImagesPullingTime="435.090608ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:11:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:11:56.551604889 +0000 UTC m=+1113.349694617" watchObservedRunningTime="2026-09-11 04:11:56.553431416 +0000 UTC m=+1113.351521142"
Sep 11 04:11:56.572928 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:56.572909    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp"]
Sep 11 04:11:56.575144 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:56.575125    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-a28c9f/test-model-a28c9f-kserve-68bf8c5bf9-r8gwp"]
Sep 11 04:11:57.810531 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:11:57.810493    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbde454e-030c-4f60-ad5c-278488287be9" path="/var/lib/kubelet/pods/dbde454e-030c-4f60-ad5c-278488287be9/volumes"
Sep 11 04:12:00.003088 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:00.003054    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:12:02.547710 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:02.547680    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg"
Sep 11 04:12:08.546551 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:08.546504    2558 patch_prober.go:28] interesting pod/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 04:12:08.547032 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:08.546594    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x" podUID="92dc0c33-84f3-4dd8-957e-d3eb9301f146" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 04:12:10.614250 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:10.614210    2558 generic.go:356] "Generic (PLEG): container finished" podID="92dc0c33-84f3-4dd8-957e-d3eb9301f146" containerID="6db91dffb1a457bde2796de598b0f12e32f3333217debdb16f36030fefe6439a" exitCode=0
Sep 11 04:12:10.614704 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:10.614255    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x" event={"ID":"92dc0c33-84f3-4dd8-957e-d3eb9301f146","Type":"ContainerDied","Data":"6db91dffb1a457bde2796de598b0f12e32f3333217debdb16f36030fefe6439a"}
Sep 11 04:12:10.614757 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:10.614701    2558 scope.go:117] "RemoveContainer" containerID="6db91dffb1a457bde2796de598b0f12e32f3333217debdb16f36030fefe6439a"
Sep 11 04:12:10.615780 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:10.615740    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:12:10.615893 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:10.615846    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:12:10.615958 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:10.615891    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:12:10.793599 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:10.793563    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j"]
Sep 11 04:12:10.793890 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:10.793820    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j" podUID="af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3" containerName="maas-api" containerID="cri-o://273ca12339a228591600faa60e81585616f4ec91ec23dbe7e212c17ec0d910bb" gracePeriod=30
Sep 11 04:12:11.069185 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:11.069151    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j"
Sep 11 04:12:11.102691 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:11.102656    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3-maas-api-tls\") pod \"af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3\" (UID: \"af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3\") "
Sep 11 04:12:11.102897 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:11.102771    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3-metrics-certs\") pod \"af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3\" (UID: \"af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3\") "
Sep 11 04:12:11.102897 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:11.102800    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3-openshift-service-ca\") pod \"af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3\" (UID: \"af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3\") "
Sep 11 04:12:11.102897 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:11.102821    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7r79g\" (UniqueName: \"kubernetes.io/projected/af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3-kube-api-access-7r79g\") pod \"af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3\" (UID: \"af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3\") "
Sep 11 04:12:11.103224 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:11.103195    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3" (UID: "af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:12:11.105007 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:11.104974    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3" (UID: "af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:12:11.105272 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:11.105254    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3-kube-api-access-7r79g" (OuterVolumeSpecName: "kube-api-access-7r79g") pod "af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3" (UID: "af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3"). InnerVolumeSpecName "kube-api-access-7r79g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:12:11.105337 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:11.105253    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3" (UID: "af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:12:11.204067 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:11.203970    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3-openshift-service-ca\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:12:11.204067 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:11.204007    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7r79g\" (UniqueName: \"kubernetes.io/projected/af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3-kube-api-access-7r79g\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:12:11.204067 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:11.204024    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3-maas-api-tls\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:12:11.204067 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:11.204037    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3-metrics-certs\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:12:11.624281 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:11.624235    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x" event={"ID":"92dc0c33-84f3-4dd8-957e-d3eb9301f146","Type":"ContainerStarted","Data":"3751653b0d2a7931ee60cdbf939241e72b51567909ea782003fe8e90d66d3428"}
Sep 11 04:12:11.627052 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:11.627020    2558 generic.go:356] "Generic (PLEG): container finished" podID="af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3" containerID="273ca12339a228591600faa60e81585616f4ec91ec23dbe7e212c17ec0d910bb" exitCode=0
Sep 11 04:12:11.627217 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:11.627074    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j" event={"ID":"af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3","Type":"ContainerDied","Data":"273ca12339a228591600faa60e81585616f4ec91ec23dbe7e212c17ec0d910bb"}
Sep 11 04:12:11.627217 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:11.627119    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j" event={"ID":"af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3","Type":"ContainerDied","Data":"8eb549cd723de459d975e66de859240fda2372159c71e74abf2718c4df07f11e"}
Sep 11 04:12:11.627217 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:11.627148    2558 scope.go:117] "RemoveContainer" containerID="273ca12339a228591600faa60e81585616f4ec91ec23dbe7e212c17ec0d910bb"
Sep 11 04:12:11.627217 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:11.627075    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j"
Sep 11 04:12:11.645830 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:11.645699    2558 scope.go:117] "RemoveContainer" containerID="273ca12339a228591600faa60e81585616f4ec91ec23dbe7e212c17ec0d910bb"
Sep 11 04:12:11.649526 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:12:11.646237    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"273ca12339a228591600faa60e81585616f4ec91ec23dbe7e212c17ec0d910bb\": container with ID starting with 273ca12339a228591600faa60e81585616f4ec91ec23dbe7e212c17ec0d910bb not found: ID does not exist" containerID="273ca12339a228591600faa60e81585616f4ec91ec23dbe7e212c17ec0d910bb"
Sep 11 04:12:11.649526 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:11.646301    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"273ca12339a228591600faa60e81585616f4ec91ec23dbe7e212c17ec0d910bb"} err="failed to get container status \"273ca12339a228591600faa60e81585616f4ec91ec23dbe7e212c17ec0d910bb\": rpc error: code = NotFound desc = could not find container \"273ca12339a228591600faa60e81585616f4ec91ec23dbe7e212c17ec0d910bb\": container with ID starting with 273ca12339a228591600faa60e81585616f4ec91ec23dbe7e212c17ec0d910bb not found: ID does not exist"
Sep 11 04:12:11.663455 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:11.663421    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j"]
Sep 11 04:12:11.668620 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:11.668584    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fca08f-54d5c4b5f8-h4n2j"]
Sep 11 04:12:11.810323 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:11.810276    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3" path="/var/lib/kubelet/pods/af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3/volumes"
Sep 11 04:12:12.483344 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:12.483305    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:12:12.483604 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:12.483586    2558 patch_prober.go:28] interesting pod/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 11 04:12:12.483661 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:12.483639    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x" podUID="92dc0c33-84f3-4dd8-957e-d3eb9301f146" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 11 04:12:13.483618 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:13.483580    2558 patch_prober.go:28] interesting pod/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 11 04:12:13.483978 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:13.483669    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x" podUID="92dc0c33-84f3-4dd8-957e-d3eb9301f146" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 11 04:12:14.483777 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:14.483740    2558 patch_prober.go:28] interesting pod/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 11 04:12:14.484184 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:14.483806    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x" podUID="92dc0c33-84f3-4dd8-957e-d3eb9301f146" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 11 04:12:15.482964 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:15.482931    2558 patch_prober.go:28] interesting pod/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 11 04:12:15.483137 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:15.482987    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x" podUID="92dc0c33-84f3-4dd8-957e-d3eb9301f146" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 11 04:12:16.483850 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:16.483813    2558 patch_prober.go:28] interesting pod/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 11 04:12:16.484232 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:16.483871    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x" podUID="92dc0c33-84f3-4dd8-957e-d3eb9301f146" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 11 04:12:16.500031 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:16.499998    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:12:17.486583 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:17.486546    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:12:17.486949 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:17.486832    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:12:17.487439 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:17.487421    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:12:27.010165 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:27.010124    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:12:37.227745 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:37.227708    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg"]
Sep 11 04:12:37.228197 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:37.227967    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg" podUID="24999c1b-098a-4350-bdf4-5d350bed801b" containerName="maas-api" containerID="cri-o://edcb29a017ddfa7875907af6fcb120dc5ca80c1a02d91e9f7497aae83952729e" gracePeriod=30
Sep 11 04:12:37.495524 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:37.495460    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg"
Sep 11 04:12:37.657006 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:37.656967    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24999c1b-098a-4350-bdf4-5d350bed801b-metrics-certs\") pod \"24999c1b-098a-4350-bdf4-5d350bed801b\" (UID: \"24999c1b-098a-4350-bdf4-5d350bed801b\") "
Sep 11 04:12:37.657006 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:37.657005    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9rzc\" (UniqueName: \"kubernetes.io/projected/24999c1b-098a-4350-bdf4-5d350bed801b-kube-api-access-x9rzc\") pod \"24999c1b-098a-4350-bdf4-5d350bed801b\" (UID: \"24999c1b-098a-4350-bdf4-5d350bed801b\") "
Sep 11 04:12:37.657260 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:37.657026    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24999c1b-098a-4350-bdf4-5d350bed801b-maas-api-tls\") pod \"24999c1b-098a-4350-bdf4-5d350bed801b\" (UID: \"24999c1b-098a-4350-bdf4-5d350bed801b\") "
Sep 11 04:12:37.657260 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:37.657222    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24999c1b-098a-4350-bdf4-5d350bed801b-openshift-service-ca\") pod \"24999c1b-098a-4350-bdf4-5d350bed801b\" (UID: \"24999c1b-098a-4350-bdf4-5d350bed801b\") "
Sep 11 04:12:37.657705 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:37.657665    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24999c1b-098a-4350-bdf4-5d350bed801b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "24999c1b-098a-4350-bdf4-5d350bed801b" (UID: "24999c1b-098a-4350-bdf4-5d350bed801b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:12:37.659229 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:37.659197    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24999c1b-098a-4350-bdf4-5d350bed801b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "24999c1b-098a-4350-bdf4-5d350bed801b" (UID: "24999c1b-098a-4350-bdf4-5d350bed801b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:12:37.659229 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:37.659213    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24999c1b-098a-4350-bdf4-5d350bed801b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "24999c1b-098a-4350-bdf4-5d350bed801b" (UID: "24999c1b-098a-4350-bdf4-5d350bed801b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:12:37.659511 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:37.659493    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24999c1b-098a-4350-bdf4-5d350bed801b-kube-api-access-x9rzc" (OuterVolumeSpecName: "kube-api-access-x9rzc") pod "24999c1b-098a-4350-bdf4-5d350bed801b" (UID: "24999c1b-098a-4350-bdf4-5d350bed801b"). InnerVolumeSpecName "kube-api-access-x9rzc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:12:37.758938 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:37.758862    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24999c1b-098a-4350-bdf4-5d350bed801b-metrics-certs\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:12:37.758938 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:37.758890    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9rzc\" (UniqueName: \"kubernetes.io/projected/24999c1b-098a-4350-bdf4-5d350bed801b-kube-api-access-x9rzc\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:12:37.758938 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:37.758903    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24999c1b-098a-4350-bdf4-5d350bed801b-maas-api-tls\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:12:37.758938 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:37.758911    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24999c1b-098a-4350-bdf4-5d350bed801b-openshift-service-ca\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:12:37.777651 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:37.777620    2558 generic.go:356] "Generic (PLEG): container finished" podID="24999c1b-098a-4350-bdf4-5d350bed801b" containerID="edcb29a017ddfa7875907af6fcb120dc5ca80c1a02d91e9f7497aae83952729e" exitCode=0
Sep 11 04:12:37.777777 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:37.777670    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg"
Sep 11 04:12:37.777777 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:37.777709    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg" event={"ID":"24999c1b-098a-4350-bdf4-5d350bed801b","Type":"ContainerDied","Data":"edcb29a017ddfa7875907af6fcb120dc5ca80c1a02d91e9f7497aae83952729e"}
Sep 11 04:12:37.777777 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:37.777765    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg" event={"ID":"24999c1b-098a-4350-bdf4-5d350bed801b","Type":"ContainerDied","Data":"2a4afde2edb325c05591aa2e341df5fd8ee7ebadf2de7f4b156bfa60236f15e1"}
Sep 11 04:12:37.777892 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:37.777788    2558 scope.go:117] "RemoveContainer" containerID="edcb29a017ddfa7875907af6fcb120dc5ca80c1a02d91e9f7497aae83952729e"
Sep 11 04:12:37.787447 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:37.787428    2558 scope.go:117] "RemoveContainer" containerID="edcb29a017ddfa7875907af6fcb120dc5ca80c1a02d91e9f7497aae83952729e"
Sep 11 04:12:37.787803 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:12:37.787777    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edcb29a017ddfa7875907af6fcb120dc5ca80c1a02d91e9f7497aae83952729e\": container with ID starting with edcb29a017ddfa7875907af6fcb120dc5ca80c1a02d91e9f7497aae83952729e not found: ID does not exist" containerID="edcb29a017ddfa7875907af6fcb120dc5ca80c1a02d91e9f7497aae83952729e"
Sep 11 04:12:37.787856 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:37.787811    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edcb29a017ddfa7875907af6fcb120dc5ca80c1a02d91e9f7497aae83952729e"} err="failed to get container status \"edcb29a017ddfa7875907af6fcb120dc5ca80c1a02d91e9f7497aae83952729e\": rpc error: code = NotFound desc = could not find container \"edcb29a017ddfa7875907af6fcb120dc5ca80c1a02d91e9f7497aae83952729e\": container with ID starting with edcb29a017ddfa7875907af6fcb120dc5ca80c1a02d91e9f7497aae83952729e not found: ID does not exist"
Sep 11 04:12:37.799947 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:37.799921    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg"]
Sep 11 04:12:37.810007 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:37.809982    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-34523cde-5bfd9d774b-dk8xg"]
Sep 11 04:12:39.809065 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:39.809033    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24999c1b-098a-4350-bdf4-5d350bed801b" path="/var/lib/kubelet/pods/24999c1b-098a-4350-bdf4-5d350bed801b/volumes"
Sep 11 04:12:42.903281 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:42.903248    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:12:44.566096 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:44.566066    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"]
Sep 11 04:12:44.566537 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:44.566271    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x" podUID="92dc0c33-84f3-4dd8-957e-d3eb9301f146" containerName="istio-proxy" containerID="cri-o://3751653b0d2a7931ee60cdbf939241e72b51567909ea782003fe8e90d66d3428" gracePeriod=30
Sep 11 04:12:47.489990 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:47.489902    2558 patch_prober.go:28] interesting pod/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 04:12:47.489990 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:47.489972    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x" podUID="92dc0c33-84f3-4dd8-957e-d3eb9301f146" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 04:12:49.829141 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.829061    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:12:49.844113 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.844081    2558 generic.go:356] "Generic (PLEG): container finished" podID="92dc0c33-84f3-4dd8-957e-d3eb9301f146" containerID="3751653b0d2a7931ee60cdbf939241e72b51567909ea782003fe8e90d66d3428" exitCode=0
Sep 11 04:12:49.844308 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.844142    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"
Sep 11 04:12:49.844308 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.844170    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x" event={"ID":"92dc0c33-84f3-4dd8-957e-d3eb9301f146","Type":"ContainerDied","Data":"3751653b0d2a7931ee60cdbf939241e72b51567909ea782003fe8e90d66d3428"}
Sep 11 04:12:49.844308 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.844235    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x" event={"ID":"92dc0c33-84f3-4dd8-957e-d3eb9301f146","Type":"ContainerDied","Data":"c80ef0e5a9502d2285c2a4161a6be8fb333b9b58d0c7f0ca03a64a8d47eca15e"}
Sep 11 04:12:49.844308 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.844266    2558 scope.go:117] "RemoveContainer" containerID="3751653b0d2a7931ee60cdbf939241e72b51567909ea782003fe8e90d66d3428"
Sep 11 04:12:49.857859 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.857825    2558 scope.go:117] "RemoveContainer" containerID="6db91dffb1a457bde2796de598b0f12e32f3333217debdb16f36030fefe6439a"
Sep 11 04:12:49.865415 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.865368    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92dc0c33-84f3-4dd8-957e-d3eb9301f146-credential-socket\") pod \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\" (UID: \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\") "
Sep 11 04:12:49.865558 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.865428    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92dc0c33-84f3-4dd8-957e-d3eb9301f146-workload-certs\") pod \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\" (UID: \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\") "
Sep 11 04:12:49.865558 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.865496    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92dc0c33-84f3-4dd8-957e-d3eb9301f146-istio-envoy\") pod \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\" (UID: \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\") "
Sep 11 04:12:49.865558 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.865516    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92dc0c33-84f3-4dd8-957e-d3eb9301f146-istio-token\") pod \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\" (UID: \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\") "
Sep 11 04:12:49.865558 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.865541    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92dc0c33-84f3-4dd8-957e-d3eb9301f146-istio-podinfo\") pod \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\" (UID: \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\") "
Sep 11 04:12:49.865811 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.865570    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92dc0c33-84f3-4dd8-957e-d3eb9301f146-workload-socket\") pod \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\" (UID: \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\") "
Sep 11 04:12:49.865811 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.865621    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92dc0c33-84f3-4dd8-957e-d3eb9301f146-istio-data\") pod \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\" (UID: \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\") "
Sep 11 04:12:49.865811 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.865657    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92dc0c33-84f3-4dd8-957e-d3eb9301f146-istiod-ca-cert\") pod \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\" (UID: \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\") "
Sep 11 04:12:49.865811 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.865684    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92dc0c33-84f3-4dd8-957e-d3eb9301f146-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "92dc0c33-84f3-4dd8-957e-d3eb9301f146" (UID: "92dc0c33-84f3-4dd8-957e-d3eb9301f146"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:12:49.865811 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.865697    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92dc0c33-84f3-4dd8-957e-d3eb9301f146-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "92dc0c33-84f3-4dd8-957e-d3eb9301f146" (UID: "92dc0c33-84f3-4dd8-957e-d3eb9301f146"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:12:49.865811 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.865692    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7nt2w\" (UniqueName: \"kubernetes.io/projected/92dc0c33-84f3-4dd8-957e-d3eb9301f146-kube-api-access-7nt2w\") pod \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\" (UID: \"92dc0c33-84f3-4dd8-957e-d3eb9301f146\") "
Sep 11 04:12:49.866139 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.865948    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92dc0c33-84f3-4dd8-957e-d3eb9301f146-istio-data" (OuterVolumeSpecName: "istio-data") pod "92dc0c33-84f3-4dd8-957e-d3eb9301f146" (UID: "92dc0c33-84f3-4dd8-957e-d3eb9301f146"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:12:49.866139 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.866013    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92dc0c33-84f3-4dd8-957e-d3eb9301f146-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "92dc0c33-84f3-4dd8-957e-d3eb9301f146" (UID: "92dc0c33-84f3-4dd8-957e-d3eb9301f146"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:12:49.866242 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.866162    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92dc0c33-84f3-4dd8-957e-d3eb9301f146-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "92dc0c33-84f3-4dd8-957e-d3eb9301f146" (UID: "92dc0c33-84f3-4dd8-957e-d3eb9301f146"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:12:49.866447 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.866426    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92dc0c33-84f3-4dd8-957e-d3eb9301f146-workload-certs\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:12:49.866541 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.866454    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92dc0c33-84f3-4dd8-957e-d3eb9301f146-workload-socket\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:12:49.866541 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.866468    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92dc0c33-84f3-4dd8-957e-d3eb9301f146-istio-data\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:12:49.866541 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.866482    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92dc0c33-84f3-4dd8-957e-d3eb9301f146-istiod-ca-cert\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:12:49.866541 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.866495    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92dc0c33-84f3-4dd8-957e-d3eb9301f146-credential-socket\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:12:49.868550 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.868523    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92dc0c33-84f3-4dd8-957e-d3eb9301f146-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "92dc0c33-84f3-4dd8-957e-d3eb9301f146" (UID: "92dc0c33-84f3-4dd8-957e-d3eb9301f146"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:12:49.868677 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.868563    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92dc0c33-84f3-4dd8-957e-d3eb9301f146-istio-token" (OuterVolumeSpecName: "istio-token") pod "92dc0c33-84f3-4dd8-957e-d3eb9301f146" (UID: "92dc0c33-84f3-4dd8-957e-d3eb9301f146"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:12:49.868887 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.868841    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92dc0c33-84f3-4dd8-957e-d3eb9301f146-kube-api-access-7nt2w" (OuterVolumeSpecName: "kube-api-access-7nt2w") pod "92dc0c33-84f3-4dd8-957e-d3eb9301f146" (UID: "92dc0c33-84f3-4dd8-957e-d3eb9301f146"). InnerVolumeSpecName "kube-api-access-7nt2w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:12:49.869407 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.869365    2558 scope.go:117] "RemoveContainer" containerID="3751653b0d2a7931ee60cdbf939241e72b51567909ea782003fe8e90d66d3428"
Sep 11 04:12:49.869500 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.869370    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/92dc0c33-84f3-4dd8-957e-d3eb9301f146-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "92dc0c33-84f3-4dd8-957e-d3eb9301f146" (UID: "92dc0c33-84f3-4dd8-957e-d3eb9301f146"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 04:12:49.869793 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:12:49.869770    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3751653b0d2a7931ee60cdbf939241e72b51567909ea782003fe8e90d66d3428\": container with ID starting with 3751653b0d2a7931ee60cdbf939241e72b51567909ea782003fe8e90d66d3428 not found: ID does not exist" containerID="3751653b0d2a7931ee60cdbf939241e72b51567909ea782003fe8e90d66d3428"
Sep 11 04:12:49.869853 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.869808    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3751653b0d2a7931ee60cdbf939241e72b51567909ea782003fe8e90d66d3428"} err="failed to get container status \"3751653b0d2a7931ee60cdbf939241e72b51567909ea782003fe8e90d66d3428\": rpc error: code = NotFound desc = could not find container \"3751653b0d2a7931ee60cdbf939241e72b51567909ea782003fe8e90d66d3428\": container with ID starting with 3751653b0d2a7931ee60cdbf939241e72b51567909ea782003fe8e90d66d3428 not found: ID does not exist"
Sep 11 04:12:49.869853 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.869835    2558 scope.go:117] "RemoveContainer" containerID="6db91dffb1a457bde2796de598b0f12e32f3333217debdb16f36030fefe6439a"
Sep 11 04:12:49.870182 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:12:49.870163    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6db91dffb1a457bde2796de598b0f12e32f3333217debdb16f36030fefe6439a\": container with ID starting with 6db91dffb1a457bde2796de598b0f12e32f3333217debdb16f36030fefe6439a not found: ID does not exist" containerID="6db91dffb1a457bde2796de598b0f12e32f3333217debdb16f36030fefe6439a"
Sep 11 04:12:49.870250 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.870191    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6db91dffb1a457bde2796de598b0f12e32f3333217debdb16f36030fefe6439a"} err="failed to get container status \"6db91dffb1a457bde2796de598b0f12e32f3333217debdb16f36030fefe6439a\": rpc error: code = NotFound desc = could not find container \"6db91dffb1a457bde2796de598b0f12e32f3333217debdb16f36030fefe6439a\": container with ID starting with 6db91dffb1a457bde2796de598b0f12e32f3333217debdb16f36030fefe6439a not found: ID does not exist"
Sep 11 04:12:49.967894 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.967847    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7nt2w\" (UniqueName: \"kubernetes.io/projected/92dc0c33-84f3-4dd8-957e-d3eb9301f146-kube-api-access-7nt2w\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:12:49.967894 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.967887    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92dc0c33-84f3-4dd8-957e-d3eb9301f146-istio-envoy\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:12:49.967894 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.967900    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92dc0c33-84f3-4dd8-957e-d3eb9301f146-istio-token\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:12:49.968136 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:49.967914    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92dc0c33-84f3-4dd8-957e-d3eb9301f146-istio-podinfo\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:12:50.166542 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:50.166505    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"]
Sep 11 04:12:50.168738 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:50.168711    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x"]
Sep 11 04:12:51.810838 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:51.810803    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92dc0c33-84f3-4dd8-957e-d3eb9301f146" path="/var/lib/kubelet/pods/92dc0c33-84f3-4dd8-957e-d3eb9301f146/volumes"
Sep 11 04:12:52.478039 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:52.477990    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl"]
Sep 11 04:12:52.484625 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:52.484589    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92dc0c33-84f3-4dd8-957e-d3eb9301f146" containerName="istio-proxy"
Sep 11 04:12:52.484625 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:52.484622    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="92dc0c33-84f3-4dd8-957e-d3eb9301f146" containerName="istio-proxy"
Sep 11 04:12:52.484914 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:52.484639    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92dc0c33-84f3-4dd8-957e-d3eb9301f146" containerName="istio-proxy"
Sep 11 04:12:52.484914 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:52.484648    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="92dc0c33-84f3-4dd8-957e-d3eb9301f146" containerName="istio-proxy"
Sep 11 04:12:52.484914 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:52.484667    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24999c1b-098a-4350-bdf4-5d350bed801b" containerName="maas-api"
Sep 11 04:12:52.484914 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:52.484675    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="24999c1b-098a-4350-bdf4-5d350bed801b" containerName="maas-api"
Sep 11 04:12:52.484914 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:52.484713    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbde454e-030c-4f60-ad5c-278488287be9" containerName="main"
Sep 11 04:12:52.484914 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:52.484721    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbde454e-030c-4f60-ad5c-278488287be9" containerName="main"
Sep 11 04:12:52.484914 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:52.484739    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3" containerName="maas-api"
Sep 11 04:12:52.484914 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:52.484750    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3" containerName="maas-api"
Sep 11 04:12:52.485179 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:52.485101    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="92dc0c33-84f3-4dd8-957e-d3eb9301f146" containerName="istio-proxy"
Sep 11 04:12:52.485179 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:52.485120    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbde454e-030c-4f60-ad5c-278488287be9" containerName="main"
Sep 11 04:12:52.485179 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:52.485127    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="24999c1b-098a-4350-bdf4-5d350bed801b" containerName="maas-api"
Sep 11 04:12:52.485179 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:52.485135    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="af97cb7d-8c7d-4f37-9e05-aade7ba8f5a3" containerName="maas-api"
Sep 11 04:12:52.490546 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:52.490503    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl"
Sep 11 04:12:52.493894 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:52.493675    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-9342ed-serving-cert\""
Sep 11 04:12:52.495803 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:52.495772    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl"]
Sep 11 04:12:52.592745 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:52.592699    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b95ca31-ad4e-416c-8d6e-d547fd806734-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl\" (UID: \"2b95ca31-ad4e-416c-8d6e-d547fd806734\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl"
Sep 11 04:12:52.592745 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:52.592754    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b95ca31-ad4e-416c-8d6e-d547fd806734-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl\" (UID: \"2b95ca31-ad4e-416c-8d6e-d547fd806734\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl"
Sep 11 04:12:52.592745 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:52.593115    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlqm9\" (UniqueName: \"kubernetes.io/projected/2b95ca31-ad4e-416c-8d6e-d547fd806734-kube-api-access-vlqm9\") pod \"maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl\" (UID: \"2b95ca31-ad4e-416c-8d6e-d547fd806734\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl"
Sep 11 04:12:52.593683 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:52.593324    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b95ca31-ad4e-416c-8d6e-d547fd806734-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl\" (UID: \"2b95ca31-ad4e-416c-8d6e-d547fd806734\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl"
Sep 11 04:12:52.694961 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:52.694913    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b95ca31-ad4e-416c-8d6e-d547fd806734-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl\" (UID: \"2b95ca31-ad4e-416c-8d6e-d547fd806734\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl"
Sep 11 04:12:52.695141 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:52.694967    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b95ca31-ad4e-416c-8d6e-d547fd806734-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl\" (UID: \"2b95ca31-ad4e-416c-8d6e-d547fd806734\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl"
Sep 11 04:12:52.695141 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:52.695021    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlqm9\" (UniqueName: \"kubernetes.io/projected/2b95ca31-ad4e-416c-8d6e-d547fd806734-kube-api-access-vlqm9\") pod \"maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl\" (UID: \"2b95ca31-ad4e-416c-8d6e-d547fd806734\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl"
Sep 11 04:12:52.695141 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:52.695048    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b95ca31-ad4e-416c-8d6e-d547fd806734-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl\" (UID: \"2b95ca31-ad4e-416c-8d6e-d547fd806734\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl"
Sep 11 04:12:52.695768 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:52.695739    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b95ca31-ad4e-416c-8d6e-d547fd806734-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl\" (UID: \"2b95ca31-ad4e-416c-8d6e-d547fd806734\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl"
Sep 11 04:12:52.697593 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:52.697569    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b95ca31-ad4e-416c-8d6e-d547fd806734-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl\" (UID: \"2b95ca31-ad4e-416c-8d6e-d547fd806734\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl"
Sep 11 04:12:52.697692 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:52.697592    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b95ca31-ad4e-416c-8d6e-d547fd806734-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl\" (UID: \"2b95ca31-ad4e-416c-8d6e-d547fd806734\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl"
Sep 11 04:12:52.716248 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:52.716216    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlqm9\" (UniqueName: \"kubernetes.io/projected/2b95ca31-ad4e-416c-8d6e-d547fd806734-kube-api-access-vlqm9\") pod \"maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl\" (UID: \"2b95ca31-ad4e-416c-8d6e-d547fd806734\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl"
Sep 11 04:12:52.803611 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:52.803505    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl"
Sep 11 04:12:53.083309 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:53.083283    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl"]
Sep 11 04:12:53.085499 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:12:53.085467    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b95ca31_ad4e_416c_8d6e_d547fd806734.slice/crio-d2c81d51124c9e13127908be3ed55b8035526249eca3968cf3910e07bdd291bd WatchSource:0}: Error finding container d2c81d51124c9e13127908be3ed55b8035526249eca3968cf3910e07bdd291bd: Status 404 returned error can't find the container with id d2c81d51124c9e13127908be3ed55b8035526249eca3968cf3910e07bdd291bd
Sep 11 04:12:53.872529 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:53.872495    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl" event={"ID":"2b95ca31-ad4e-416c-8d6e-d547fd806734","Type":"ContainerStarted","Data":"e6102fddada8a728552a1df56af6b67faedf977d9dde55aa0234d396a218277b"}
Sep 11 04:12:53.872749 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:53.872556    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl" event={"ID":"2b95ca31-ad4e-416c-8d6e-d547fd806734","Type":"ContainerStarted","Data":"d2c81d51124c9e13127908be3ed55b8035526249eca3968cf3910e07bdd291bd"}
Sep 11 04:12:53.872749 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:53.872718    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl"
Sep 11 04:12:53.892703 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:53.892658    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl" podStartSLOduration=1.5871726179999999 podStartE2EDuration="1.892644914s" totalImagesPullingTime="305.472296ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:12:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:12:53.891057862 +0000 UTC m=+1170.689147590" watchObservedRunningTime="2026-09-11 04:12:53.892644914 +0000 UTC m=+1170.690734674"
Sep 11 04:12:56.500961 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:56.500928    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:12:58.885028 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:58.884990    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"]
Sep 11 04:12:58.885668 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:58.885629    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="92dc0c33-84f3-4dd8-957e-d3eb9301f146" containerName="istio-proxy"
Sep 11 04:12:58.889445 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:58.889380    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:12:58.892053 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:58.892017    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-772e41-openshift-default-dockercfg-frkfk\""
Sep 11 04:12:58.901514 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:58.901492    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"]
Sep 11 04:12:58.954915 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:58.954888    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/037e1650-4608-4114-89bc-cb855bb8e67a-istio-envoy\") pod \"e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4\" (UID: \"037e1650-4608-4114-89bc-cb855bb8e67a\") " pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:12:58.955035 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:58.954920    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/037e1650-4608-4114-89bc-cb855bb8e67a-istiod-ca-cert\") pod \"e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4\" (UID: \"037e1650-4608-4114-89bc-cb855bb8e67a\") " pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:12:58.955035 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:58.954941    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7ls4\" (UniqueName: \"kubernetes.io/projected/037e1650-4608-4114-89bc-cb855bb8e67a-kube-api-access-d7ls4\") pod \"e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4\" (UID: \"037e1650-4608-4114-89bc-cb855bb8e67a\") " pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:12:58.955035 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:58.955012    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/037e1650-4608-4114-89bc-cb855bb8e67a-istio-podinfo\") pod \"e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4\" (UID: \"037e1650-4608-4114-89bc-cb855bb8e67a\") " pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:12:58.955170 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:58.955096    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/037e1650-4608-4114-89bc-cb855bb8e67a-credential-socket\") pod \"e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4\" (UID: \"037e1650-4608-4114-89bc-cb855bb8e67a\") " pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:12:58.955170 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:58.955136    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/037e1650-4608-4114-89bc-cb855bb8e67a-istio-data\") pod \"e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4\" (UID: \"037e1650-4608-4114-89bc-cb855bb8e67a\") " pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:12:58.955170 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:58.955156    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/037e1650-4608-4114-89bc-cb855bb8e67a-workload-certs\") pod \"e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4\" (UID: \"037e1650-4608-4114-89bc-cb855bb8e67a\") " pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:12:58.955296 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:58.955210    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/037e1650-4608-4114-89bc-cb855bb8e67a-istio-token\") pod \"e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4\" (UID: \"037e1650-4608-4114-89bc-cb855bb8e67a\") " pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:12:58.955296 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:58.955237    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/037e1650-4608-4114-89bc-cb855bb8e67a-workload-socket\") pod \"e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4\" (UID: \"037e1650-4608-4114-89bc-cb855bb8e67a\") " pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:12:59.056143 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:59.056106    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/037e1650-4608-4114-89bc-cb855bb8e67a-istio-envoy\") pod \"e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4\" (UID: \"037e1650-4608-4114-89bc-cb855bb8e67a\") " pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:12:59.056325 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:59.056150    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/037e1650-4608-4114-89bc-cb855bb8e67a-istiod-ca-cert\") pod \"e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4\" (UID: \"037e1650-4608-4114-89bc-cb855bb8e67a\") " pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:12:59.056325 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:59.056280    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7ls4\" (UniqueName: \"kubernetes.io/projected/037e1650-4608-4114-89bc-cb855bb8e67a-kube-api-access-d7ls4\") pod \"e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4\" (UID: \"037e1650-4608-4114-89bc-cb855bb8e67a\") " pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:12:59.056465 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:59.056337    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/037e1650-4608-4114-89bc-cb855bb8e67a-istio-podinfo\") pod \"e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4\" (UID: \"037e1650-4608-4114-89bc-cb855bb8e67a\") " pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:12:59.056465 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:59.056431    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/037e1650-4608-4114-89bc-cb855bb8e67a-credential-socket\") pod \"e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4\" (UID: \"037e1650-4608-4114-89bc-cb855bb8e67a\") " pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:12:59.056577 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:59.056493    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/037e1650-4608-4114-89bc-cb855bb8e67a-istio-data\") pod \"e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4\" (UID: \"037e1650-4608-4114-89bc-cb855bb8e67a\") " pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:12:59.056577 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:59.056528    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/037e1650-4608-4114-89bc-cb855bb8e67a-workload-certs\") pod \"e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4\" (UID: \"037e1650-4608-4114-89bc-cb855bb8e67a\") " pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:12:59.056577 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:59.056562    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/037e1650-4608-4114-89bc-cb855bb8e67a-istio-token\") pod \"e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4\" (UID: \"037e1650-4608-4114-89bc-cb855bb8e67a\") " pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:12:59.056717 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:59.056600    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/037e1650-4608-4114-89bc-cb855bb8e67a-workload-socket\") pod \"e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4\" (UID: \"037e1650-4608-4114-89bc-cb855bb8e67a\") " pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:12:59.056805 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:59.056782    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/037e1650-4608-4114-89bc-cb855bb8e67a-credential-socket\") pod \"e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4\" (UID: \"037e1650-4608-4114-89bc-cb855bb8e67a\") " pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:12:59.056919 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:59.056892    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/037e1650-4608-4114-89bc-cb855bb8e67a-istiod-ca-cert\") pod \"e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4\" (UID: \"037e1650-4608-4114-89bc-cb855bb8e67a\") " pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:12:59.057067 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:59.056975    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/037e1650-4608-4114-89bc-cb855bb8e67a-istio-data\") pod \"e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4\" (UID: \"037e1650-4608-4114-89bc-cb855bb8e67a\") " pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:12:59.057067 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:59.057057    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/037e1650-4608-4114-89bc-cb855bb8e67a-workload-socket\") pod \"e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4\" (UID: \"037e1650-4608-4114-89bc-cb855bb8e67a\") " pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:12:59.057200 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:59.057113    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/037e1650-4608-4114-89bc-cb855bb8e67a-workload-certs\") pod \"e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4\" (UID: \"037e1650-4608-4114-89bc-cb855bb8e67a\") " pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:12:59.058564 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:59.058544    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/037e1650-4608-4114-89bc-cb855bb8e67a-istio-envoy\") pod \"e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4\" (UID: \"037e1650-4608-4114-89bc-cb855bb8e67a\") " pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:12:59.058848 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:59.058826    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/037e1650-4608-4114-89bc-cb855bb8e67a-istio-podinfo\") pod \"e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4\" (UID: \"037e1650-4608-4114-89bc-cb855bb8e67a\") " pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:12:59.063997 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:59.063975    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/037e1650-4608-4114-89bc-cb855bb8e67a-istio-token\") pod \"e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4\" (UID: \"037e1650-4608-4114-89bc-cb855bb8e67a\") " pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:12:59.064174 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:59.064157    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7ls4\" (UniqueName: \"kubernetes.io/projected/037e1650-4608-4114-89bc-cb855bb8e67a-kube-api-access-d7ls4\") pod \"e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4\" (UID: \"037e1650-4608-4114-89bc-cb855bb8e67a\") " pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:12:59.201130 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:59.201053    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:12:59.478899 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:59.478875    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"]
Sep 11 04:12:59.480449 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:12:59.480415    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod037e1650_4608_4114_89bc_cb855bb8e67a.slice/crio-ad44744f7fe08de389c6a342fcfb7b4b5a13f45bbf598a6745c6832786814613 WatchSource:0}: Error finding container ad44744f7fe08de389c6a342fcfb7b4b5a13f45bbf598a6745c6832786814613: Status 404 returned error can't find the container with id ad44744f7fe08de389c6a342fcfb7b4b5a13f45bbf598a6745c6832786814613
Sep 11 04:12:59.485780 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:59.485748    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:12:59.485859 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:59.485820    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:12:59.485859 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:59.485849    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:12:59.883801 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:59.883767    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl"
Sep 11 04:12:59.904060 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:59.904027    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4" event={"ID":"037e1650-4608-4114-89bc-cb855bb8e67a","Type":"ContainerStarted","Data":"952a206a149b7630a87cbf12c7c8e3f5cc124b402cc1e0874d08afb81103c015"}
Sep 11 04:12:59.904446 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:59.904079    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4" event={"ID":"037e1650-4608-4114-89bc-cb855bb8e67a","Type":"ContainerStarted","Data":"ad44744f7fe08de389c6a342fcfb7b4b5a13f45bbf598a6745c6832786814613"}
Sep 11 04:12:59.929985 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:12:59.929922    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4" podStartSLOduration=1.929898393 podStartE2EDuration="1.929898393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:12:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:12:59.927499163 +0000 UTC m=+1176.725588891" watchObservedRunningTime="2026-09-11 04:12:59.929898393 +0000 UTC m=+1176.727988122"
Sep 11 04:13:00.202030 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:00.201941    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:13:00.203186 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:00.203155    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 11 04:13:00.203321 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:00.203206    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4" podUID="037e1650-4608-4114-89bc-cb855bb8e67a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 11 04:13:01.206079 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:01.206047    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:13:01.915418 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:01.915376    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:13:01.916584 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:01.916566    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:13:03.197199 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:03.197168    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf"]
Sep 11 04:13:03.200966 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:03.200942    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf"
Sep 11 04:13:03.203418 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:03.203373    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-772e41-serving-cert\""
Sep 11 04:13:03.214607 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:03.214578    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf"]
Sep 11 04:13:03.297996 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:03.297955    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf\" (UID: \"f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf"
Sep 11 04:13:03.298333 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:03.298305    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vvgk\" (UniqueName: \"kubernetes.io/projected/f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e-kube-api-access-6vvgk\") pod \"maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf\" (UID: \"f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf"
Sep 11 04:13:03.298612 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:03.298592    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf\" (UID: \"f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf"
Sep 11 04:13:03.298786 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:03.298769    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf\" (UID: \"f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf"
Sep 11 04:13:03.399786 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:03.399746    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf\" (UID: \"f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf"
Sep 11 04:13:03.399952 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:03.399800    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf\" (UID: \"f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf"
Sep 11 04:13:03.399952 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:03.399850    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf\" (UID: \"f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf"
Sep 11 04:13:03.399952 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:03.399894    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vvgk\" (UniqueName: \"kubernetes.io/projected/f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e-kube-api-access-6vvgk\") pod \"maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf\" (UID: \"f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf"
Sep 11 04:13:03.399952 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:13:03.399903    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-772e41-serving-cert: secret "maas-api-e2e-shared-a-w2-772e41-serving-cert" not found
Sep 11 04:13:03.400182 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:13:03.399979    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e-maas-api-tls podName:f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e nodeName:}" failed. No retries permitted until 2026-09-11 04:13:03.899963331 +0000 UTC m=+1180.698053037 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e-maas-api-tls") pod "maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf" (UID: "f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e") : secret "maas-api-e2e-shared-a-w2-772e41-serving-cert" not found
Sep 11 04:13:03.400598 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:03.400576    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf\" (UID: \"f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf"
Sep 11 04:13:03.402244 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:03.402225    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf\" (UID: \"f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf"
Sep 11 04:13:03.413486 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:03.413455    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vvgk\" (UniqueName: \"kubernetes.io/projected/f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e-kube-api-access-6vvgk\") pod \"maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf\" (UID: \"f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf"
Sep 11 04:13:03.905414 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:03.905364    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf\" (UID: \"f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf"
Sep 11 04:13:03.907849 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:03.907822    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf\" (UID: \"f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf"
Sep 11 04:13:04.114011 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:04.113967    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf"
Sep 11 04:13:04.404254 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:04.404218    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf"]
Sep 11 04:13:04.406009 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:13:04.405984    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3d1e31a_21c7_4d55_bc80_1a3274f0cd4e.slice/crio-839103be095cd374343518a4da755fee0e85b01d36bb7c2eb91cc45c878bfa62 WatchSource:0}: Error finding container 839103be095cd374343518a4da755fee0e85b01d36bb7c2eb91cc45c878bfa62: Status 404 returned error can't find the container with id 839103be095cd374343518a4da755fee0e85b01d36bb7c2eb91cc45c878bfa62
Sep 11 04:13:04.932537 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:04.932495    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf" event={"ID":"f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e","Type":"ContainerStarted","Data":"839103be095cd374343518a4da755fee0e85b01d36bb7c2eb91cc45c878bfa62"}
Sep 11 04:13:05.939090 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:05.939045    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf" event={"ID":"f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e","Type":"ContainerStarted","Data":"78d12958fa4ad90fe910fbbe438816442f56c7e04c7c048691216314f1579e5c"}
Sep 11 04:13:05.939566 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:05.939214    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf"
Sep 11 04:13:05.957360 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:05.957307    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf" podStartSLOduration=2.385197009 podStartE2EDuration="2.957293564s" totalImagesPullingTime="572.096555ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:13:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:13:05.955624544 +0000 UTC m=+1182.753714271" watchObservedRunningTime="2026-09-11 04:13:05.957293564 +0000 UTC m=+1182.755383290"
Sep 11 04:13:07.404255 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:07.404222    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:13:11.949808 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:11.949771    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf"
Sep 11 04:13:17.149668 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:17.149613    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": read tcp 10.133.0.2:40648->10.133.0.62:15021: read: connection reset by peer" start-of-body=
Sep 11 04:13:17.150018 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:17.149681    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4" podUID="037e1650-4608-4114-89bc-cb855bb8e67a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": read tcp 10.133.0.2:40648->10.133.0.62:15021: read: connection reset by peer"
Sep 11 04:13:18.007851 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:18.007819    2558 generic.go:356] "Generic (PLEG): container finished" podID="037e1650-4608-4114-89bc-cb855bb8e67a" containerID="952a206a149b7630a87cbf12c7c8e3f5cc124b402cc1e0874d08afb81103c015" exitCode=0
Sep 11 04:13:18.008059 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:18.007899    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4" event={"ID":"037e1650-4608-4114-89bc-cb855bb8e67a","Type":"ContainerDied","Data":"952a206a149b7630a87cbf12c7c8e3f5cc124b402cc1e0874d08afb81103c015"}
Sep 11 04:13:18.008343 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:18.008327    2558 scope.go:117] "RemoveContainer" containerID="952a206a149b7630a87cbf12c7c8e3f5cc124b402cc1e0874d08afb81103c015"
Sep 11 04:13:18.009483 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:18.009454    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:13:18.009542 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:18.009518    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:13:18.009579 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:18.009547    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:13:19.015487 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:19.015423    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4" event={"ID":"037e1650-4608-4114-89bc-cb855bb8e67a","Type":"ContainerStarted","Data":"f0abc97e528c25580a59f73918778efbede5e8ca833f58913cec86f8bc512b7c"}
Sep 11 04:13:19.201969 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:19.201936    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:13:19.202142 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:19.202094    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 11 04:13:19.202188 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:19.202143    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4" podUID="037e1650-4608-4114-89bc-cb855bb8e67a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 11 04:13:20.201487 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:20.201452    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 11 04:13:20.201933 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:20.201524    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4" podUID="037e1650-4608-4114-89bc-cb855bb8e67a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 11 04:13:21.202325 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:21.202286    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 11 04:13:21.202747 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:21.202347    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4" podUID="037e1650-4608-4114-89bc-cb855bb8e67a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 11 04:13:22.201874 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:22.201839    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 11 04:13:22.202059 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:22.201893    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4" podUID="037e1650-4608-4114-89bc-cb855bb8e67a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 11 04:13:23.202410 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:23.202352    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 11 04:13:23.202974 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:23.202457    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4" podUID="037e1650-4608-4114-89bc-cb855bb8e67a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 11 04:13:23.811731 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:23.811701    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nfssn_c9add74a-5c51-4ccf-9edd-3b90a66b9ef9/ovn-acl-logging/0.log"
Sep 11 04:13:23.814326 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:23.814301    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nfssn_c9add74a-5c51-4ccf-9edd-3b90a66b9ef9/ovn-acl-logging/0.log"
Sep 11 04:13:24.202297 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:24.202253    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 11 04:13:24.202522 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:24.202324    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4" podUID="037e1650-4608-4114-89bc-cb855bb8e67a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 11 04:13:25.206079 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:25.206043    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:13:25.206580 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:25.206494    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:13:25.207478 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:25.207453    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:13:26.297467 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:26.297430    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:13:27.575029 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:27.574997    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"]
Sep 11 04:13:27.578154 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:27.578137    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:13:27.584288 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:27.584261    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-f8229c-openshift-default-dockercfg-mvpt4\""
Sep 11 04:13:27.593134 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:27.593107    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"]
Sep 11 04:13:27.651065 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:27.651021    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34c07f21-75ae-4f89-a262-aebdeacbb3e0-workload-socket\") pod \"e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf\" (UID: \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\") " pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:13:27.651267 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:27.651089    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34c07f21-75ae-4f89-a262-aebdeacbb3e0-istio-token\") pod \"e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf\" (UID: \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\") " pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:13:27.651267 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:27.651142    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34c07f21-75ae-4f89-a262-aebdeacbb3e0-istio-podinfo\") pod \"e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf\" (UID: \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\") " pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:13:27.651267 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:27.651169    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34c07f21-75ae-4f89-a262-aebdeacbb3e0-istiod-ca-cert\") pod \"e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf\" (UID: \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\") " pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:13:27.651267 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:27.651204    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34c07f21-75ae-4f89-a262-aebdeacbb3e0-istio-envoy\") pod \"e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf\" (UID: \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\") " pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:13:27.651510 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:27.651259    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6vrq\" (UniqueName: \"kubernetes.io/projected/34c07f21-75ae-4f89-a262-aebdeacbb3e0-kube-api-access-n6vrq\") pod \"e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf\" (UID: \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\") " pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:13:27.651510 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:27.651308    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34c07f21-75ae-4f89-a262-aebdeacbb3e0-workload-certs\") pod \"e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf\" (UID: \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\") " pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:13:27.651510 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:27.651353    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34c07f21-75ae-4f89-a262-aebdeacbb3e0-credential-socket\") pod \"e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf\" (UID: \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\") " pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:13:27.651510 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:27.651446    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34c07f21-75ae-4f89-a262-aebdeacbb3e0-istio-data\") pod \"e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf\" (UID: \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\") " pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:13:27.752626 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:27.752567    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34c07f21-75ae-4f89-a262-aebdeacbb3e0-istio-token\") pod \"e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf\" (UID: \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\") " pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:13:27.752856 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:27.752648    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34c07f21-75ae-4f89-a262-aebdeacbb3e0-istio-podinfo\") pod \"e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf\" (UID: \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\") " pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:13:27.752856 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:27.752687    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34c07f21-75ae-4f89-a262-aebdeacbb3e0-istiod-ca-cert\") pod \"e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf\" (UID: \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\") " pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:13:27.752856 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:27.752711    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34c07f21-75ae-4f89-a262-aebdeacbb3e0-istio-envoy\") pod \"e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf\" (UID: \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\") " pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:13:27.752856 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:27.752731    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6vrq\" (UniqueName: \"kubernetes.io/projected/34c07f21-75ae-4f89-a262-aebdeacbb3e0-kube-api-access-n6vrq\") pod \"e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf\" (UID: \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\") " pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:13:27.752856 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:27.752762    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34c07f21-75ae-4f89-a262-aebdeacbb3e0-workload-certs\") pod \"e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf\" (UID: \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\") " pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:13:27.752856 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:27.752813    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34c07f21-75ae-4f89-a262-aebdeacbb3e0-credential-socket\") pod \"e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf\" (UID: \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\") " pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:13:27.753155 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:27.752870    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34c07f21-75ae-4f89-a262-aebdeacbb3e0-istio-data\") pod \"e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf\" (UID: \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\") " pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:13:27.753155 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:27.752909    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34c07f21-75ae-4f89-a262-aebdeacbb3e0-workload-socket\") pod \"e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf\" (UID: \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\") " pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:13:27.753265 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:27.753199    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34c07f21-75ae-4f89-a262-aebdeacbb3e0-credential-socket\") pod \"e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf\" (UID: \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\") " pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:13:27.753265 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:27.753249    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34c07f21-75ae-4f89-a262-aebdeacbb3e0-workload-certs\") pod \"e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf\" (UID: \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\") " pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:13:27.753832 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:27.753465    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34c07f21-75ae-4f89-a262-aebdeacbb3e0-istiod-ca-cert\") pod \"e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf\" (UID: \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\") " pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:13:27.753832 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:27.753481    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34c07f21-75ae-4f89-a262-aebdeacbb3e0-istio-data\") pod \"e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf\" (UID: \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\") " pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:13:27.753832 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:27.753724    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34c07f21-75ae-4f89-a262-aebdeacbb3e0-workload-socket\") pod \"e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf\" (UID: \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\") " pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:13:27.755206 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:27.755179    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34c07f21-75ae-4f89-a262-aebdeacbb3e0-istio-envoy\") pod \"e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf\" (UID: \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\") " pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:13:27.755421 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:27.755405    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34c07f21-75ae-4f89-a262-aebdeacbb3e0-istio-podinfo\") pod \"e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf\" (UID: \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\") " pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:13:27.761345 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:27.761320    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34c07f21-75ae-4f89-a262-aebdeacbb3e0-istio-token\") pod \"e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf\" (UID: \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\") " pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:13:27.761511 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:27.761491    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6vrq\" (UniqueName: \"kubernetes.io/projected/34c07f21-75ae-4f89-a262-aebdeacbb3e0-kube-api-access-n6vrq\") pod \"e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf\" (UID: \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\") " pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:13:27.888708 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:27.888604    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:13:28.212553 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:28.208716    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"]
Sep 11 04:13:28.213449 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:28.213372    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:13:28.213655 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:28.213543    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:13:28.213655 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:28.213634    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:13:29.081053 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:29.081012    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf" event={"ID":"34c07f21-75ae-4f89-a262-aebdeacbb3e0","Type":"ContainerStarted","Data":"2addfb9b10e6dbdeb7f965833c3d2b7779423270a1eee57ad05d9d27c2f42bbe"}
Sep 11 04:13:29.081573 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:29.081073    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf" event={"ID":"34c07f21-75ae-4f89-a262-aebdeacbb3e0","Type":"ContainerStarted","Data":"19f00e618589dc2c13e277c5ced211bb79d3707864789fa4b7c6f87ceb637acb"}
Sep 11 04:13:29.105376 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:29.105317    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf" podStartSLOduration=2.105299048 podStartE2EDuration="2.105299048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:13:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:13:29.103440624 +0000 UTC m=+1205.901530351" watchObservedRunningTime="2026-09-11 04:13:29.105299048 +0000 UTC m=+1205.903388774"
Sep 11 04:13:29.889206 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:29.889172    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:13:29.894174 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:29.894142    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:13:30.087003 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:30.086972    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:13:30.087948 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:30.087925    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:13:40.606466 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:40.606434    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:13:51.202762 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:51.202728    2558 generic.go:356] "Generic (PLEG): container finished" podID="34c07f21-75ae-4f89-a262-aebdeacbb3e0" containerID="2addfb9b10e6dbdeb7f965833c3d2b7779423270a1eee57ad05d9d27c2f42bbe" exitCode=0
Sep 11 04:13:51.203247 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:51.202775    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf" event={"ID":"34c07f21-75ae-4f89-a262-aebdeacbb3e0","Type":"ContainerDied","Data":"2addfb9b10e6dbdeb7f965833c3d2b7779423270a1eee57ad05d9d27c2f42bbe"}
Sep 11 04:13:51.203247 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:51.203142    2558 scope.go:117] "RemoveContainer" containerID="2addfb9b10e6dbdeb7f965833c3d2b7779423270a1eee57ad05d9d27c2f42bbe"
Sep 11 04:13:51.204211 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:51.204181    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:13:51.204297 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:51.204251    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:13:51.204297 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:51.204284    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:13:52.216397 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:52.216350    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf" event={"ID":"34c07f21-75ae-4f89-a262-aebdeacbb3e0","Type":"ContainerStarted","Data":"84bb75dcd319ef5233c11c61fa40551bc587cb30f0ed5a3683a0f1289fa55514"}
Sep 11 04:13:52.889462 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:52.889423    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:13:52.889678 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:52.889655    2558 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 11 04:13:52.889729 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:52.889708    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf" podUID="34c07f21-75ae-4f89-a262-aebdeacbb3e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 11 04:13:53.890017 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:53.889974    2558 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 11 04:13:53.890564 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:53.890039    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf" podUID="34c07f21-75ae-4f89-a262-aebdeacbb3e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 11 04:13:54.889744 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:54.889709    2558 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 11 04:13:54.889892 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:54.889763    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf" podUID="34c07f21-75ae-4f89-a262-aebdeacbb3e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 11 04:13:55.889210 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:55.889169    2558 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 11 04:13:55.889623 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:55.889234    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf" podUID="34c07f21-75ae-4f89-a262-aebdeacbb3e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 11 04:13:56.889475 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:56.889438    2558 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 11 04:13:56.889859 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:56.889494    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf" podUID="34c07f21-75ae-4f89-a262-aebdeacbb3e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 11 04:13:57.893348 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:57.893313    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:13:57.893745 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:57.893604    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:13:57.894351 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:13:57.894331    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:14:05.233040 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:05.233006    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"]
Sep 11 04:14:05.236896 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:05.236875    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:14:05.240440 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:05.240415    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-354ac6fe-openshift-default-dockercfg-4cg4v\""
Sep 11 04:14:05.266422 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:05.266374    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"]
Sep 11 04:14:05.352499 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:05.352461    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/774da4e2-b15a-4165-af45-1b9107dbf0a0-istio-data\") pod \"e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg\" (UID: \"774da4e2-b15a-4165-af45-1b9107dbf0a0\") " pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:14:05.352683 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:05.352523    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/774da4e2-b15a-4165-af45-1b9107dbf0a0-istio-envoy\") pod \"e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg\" (UID: \"774da4e2-b15a-4165-af45-1b9107dbf0a0\") " pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:14:05.352683 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:05.352571    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/774da4e2-b15a-4165-af45-1b9107dbf0a0-istiod-ca-cert\") pod \"e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg\" (UID: \"774da4e2-b15a-4165-af45-1b9107dbf0a0\") " pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:14:05.352683 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:05.352597    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/774da4e2-b15a-4165-af45-1b9107dbf0a0-credential-socket\") pod \"e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg\" (UID: \"774da4e2-b15a-4165-af45-1b9107dbf0a0\") " pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:14:05.352683 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:05.352633    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtggz\" (UniqueName: \"kubernetes.io/projected/774da4e2-b15a-4165-af45-1b9107dbf0a0-kube-api-access-jtggz\") pod \"e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg\" (UID: \"774da4e2-b15a-4165-af45-1b9107dbf0a0\") " pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:14:05.352683 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:05.352651    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/774da4e2-b15a-4165-af45-1b9107dbf0a0-istio-podinfo\") pod \"e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg\" (UID: \"774da4e2-b15a-4165-af45-1b9107dbf0a0\") " pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:14:05.352683 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:05.352674    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/774da4e2-b15a-4165-af45-1b9107dbf0a0-istio-token\") pod \"e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg\" (UID: \"774da4e2-b15a-4165-af45-1b9107dbf0a0\") " pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:14:05.352964 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:05.352746    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/774da4e2-b15a-4165-af45-1b9107dbf0a0-workload-certs\") pod \"e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg\" (UID: \"774da4e2-b15a-4165-af45-1b9107dbf0a0\") " pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:14:05.352964 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:05.352828    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/774da4e2-b15a-4165-af45-1b9107dbf0a0-workload-socket\") pod \"e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg\" (UID: \"774da4e2-b15a-4165-af45-1b9107dbf0a0\") " pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:14:05.453588 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:05.453551    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/774da4e2-b15a-4165-af45-1b9107dbf0a0-istio-data\") pod \"e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg\" (UID: \"774da4e2-b15a-4165-af45-1b9107dbf0a0\") " pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:14:05.453760 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:05.453598    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/774da4e2-b15a-4165-af45-1b9107dbf0a0-istio-envoy\") pod \"e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg\" (UID: \"774da4e2-b15a-4165-af45-1b9107dbf0a0\") " pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:14:05.453760 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:05.453625    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/774da4e2-b15a-4165-af45-1b9107dbf0a0-istiod-ca-cert\") pod \"e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg\" (UID: \"774da4e2-b15a-4165-af45-1b9107dbf0a0\") " pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:14:05.453760 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:05.453659    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/774da4e2-b15a-4165-af45-1b9107dbf0a0-credential-socket\") pod \"e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg\" (UID: \"774da4e2-b15a-4165-af45-1b9107dbf0a0\") " pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:14:05.453760 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:05.453706    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtggz\" (UniqueName: \"kubernetes.io/projected/774da4e2-b15a-4165-af45-1b9107dbf0a0-kube-api-access-jtggz\") pod \"e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg\" (UID: \"774da4e2-b15a-4165-af45-1b9107dbf0a0\") " pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:14:05.453760 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:05.453731    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/774da4e2-b15a-4165-af45-1b9107dbf0a0-istio-podinfo\") pod \"e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg\" (UID: \"774da4e2-b15a-4165-af45-1b9107dbf0a0\") " pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:14:05.454299 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:05.453952    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/774da4e2-b15a-4165-af45-1b9107dbf0a0-istio-token\") pod \"e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg\" (UID: \"774da4e2-b15a-4165-af45-1b9107dbf0a0\") " pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:14:05.454443 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:05.453993    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/774da4e2-b15a-4165-af45-1b9107dbf0a0-istio-data\") pod \"e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg\" (UID: \"774da4e2-b15a-4165-af45-1b9107dbf0a0\") " pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:14:05.454443 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:05.454408    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/774da4e2-b15a-4165-af45-1b9107dbf0a0-workload-certs\") pod \"e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg\" (UID: \"774da4e2-b15a-4165-af45-1b9107dbf0a0\") " pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:14:05.454443 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:05.454126    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/774da4e2-b15a-4165-af45-1b9107dbf0a0-credential-socket\") pod \"e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg\" (UID: \"774da4e2-b15a-4165-af45-1b9107dbf0a0\") " pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:14:05.454443 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:05.454425    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/774da4e2-b15a-4165-af45-1b9107dbf0a0-istiod-ca-cert\") pod \"e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg\" (UID: \"774da4e2-b15a-4165-af45-1b9107dbf0a0\") " pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:14:05.454613 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:05.454476    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/774da4e2-b15a-4165-af45-1b9107dbf0a0-workload-socket\") pod \"e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg\" (UID: \"774da4e2-b15a-4165-af45-1b9107dbf0a0\") " pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:14:05.454710 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:05.454676    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/774da4e2-b15a-4165-af45-1b9107dbf0a0-workload-certs\") pod \"e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg\" (UID: \"774da4e2-b15a-4165-af45-1b9107dbf0a0\") " pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:14:05.454838 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:05.454753    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/774da4e2-b15a-4165-af45-1b9107dbf0a0-workload-socket\") pod \"e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg\" (UID: \"774da4e2-b15a-4165-af45-1b9107dbf0a0\") " pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:14:05.455916 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:05.455897    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/774da4e2-b15a-4165-af45-1b9107dbf0a0-istio-envoy\") pod \"e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg\" (UID: \"774da4e2-b15a-4165-af45-1b9107dbf0a0\") " pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:14:05.456246 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:05.456229    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/774da4e2-b15a-4165-af45-1b9107dbf0a0-istio-podinfo\") pod \"e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg\" (UID: \"774da4e2-b15a-4165-af45-1b9107dbf0a0\") " pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:14:05.465069 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:05.465041    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/774da4e2-b15a-4165-af45-1b9107dbf0a0-istio-token\") pod \"e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg\" (UID: \"774da4e2-b15a-4165-af45-1b9107dbf0a0\") " pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:14:05.465410 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:05.465369    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtggz\" (UniqueName: \"kubernetes.io/projected/774da4e2-b15a-4165-af45-1b9107dbf0a0-kube-api-access-jtggz\") pod \"e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg\" (UID: \"774da4e2-b15a-4165-af45-1b9107dbf0a0\") " pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:14:05.507209 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:05.507131    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:14:05.547872 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:05.547841    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:14:05.824968 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:05.824938    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"]
Sep 11 04:14:05.826203 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:14:05.826175    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod774da4e2_b15a_4165_af45_1b9107dbf0a0.slice/crio-bd0497b5efb8c295672fa0f4d8a9e057f16513181c292dca2fbe506cb6ca3729 WatchSource:0}: Error finding container bd0497b5efb8c295672fa0f4d8a9e057f16513181c292dca2fbe506cb6ca3729: Status 404 returned error can't find the container with id bd0497b5efb8c295672fa0f4d8a9e057f16513181c292dca2fbe506cb6ca3729
Sep 11 04:14:05.828164 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:05.828135    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:14:05.828242 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:05.828197    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:14:05.828242 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:05.828224    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:14:06.320339 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:06.320302    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg" event={"ID":"774da4e2-b15a-4165-af45-1b9107dbf0a0","Type":"ContainerStarted","Data":"71e76e1f301952941ff2c48b4fe16bba74dc88a32a10b1d8595f5636bce395f3"}
Sep 11 04:14:06.320744 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:06.320366    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg" event={"ID":"774da4e2-b15a-4165-af45-1b9107dbf0a0","Type":"ContainerStarted","Data":"bd0497b5efb8c295672fa0f4d8a9e057f16513181c292dca2fbe506cb6ca3729"}
Sep 11 04:14:06.342338 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:06.342280    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg" podStartSLOduration=1.342263756 podStartE2EDuration="1.342263756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:14:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:14:06.340428432 +0000 UTC m=+1243.138518175" watchObservedRunningTime="2026-09-11 04:14:06.342263756 +0000 UTC m=+1243.140353482"
Sep 11 04:14:06.548364 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:06.548329    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:14:06.554138 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:06.554115    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:14:07.326541 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:07.326511    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:14:07.327581 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:07.327563    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:14:23.368541 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:23.368498    2558 patch_prober.go:28] interesting pod/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 04:14:23.369004 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:23.368571    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg" podUID="774da4e2-b15a-4165-af45-1b9107dbf0a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 04:14:23.513916 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:23.513887    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:14:24.422644 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:24.422608    2558 generic.go:356] "Generic (PLEG): container finished" podID="774da4e2-b15a-4165-af45-1b9107dbf0a0" containerID="71e76e1f301952941ff2c48b4fe16bba74dc88a32a10b1d8595f5636bce395f3" exitCode=0
Sep 11 04:14:24.423047 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:24.422680    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg" event={"ID":"774da4e2-b15a-4165-af45-1b9107dbf0a0","Type":"ContainerDied","Data":"71e76e1f301952941ff2c48b4fe16bba74dc88a32a10b1d8595f5636bce395f3"}
Sep 11 04:14:24.423122 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:24.423108    2558 scope.go:117] "RemoveContainer" containerID="71e76e1f301952941ff2c48b4fe16bba74dc88a32a10b1d8595f5636bce395f3"
Sep 11 04:14:24.424300 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:24.424269    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:14:24.424447 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:24.424348    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:14:24.424521 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:24.424454    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:14:25.435234 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:25.435195    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg" event={"ID":"774da4e2-b15a-4165-af45-1b9107dbf0a0","Type":"ContainerStarted","Data":"ff42cf8a9aa16b4e046ae4d999f6cc89b85de2c20c33b41e643eddae75e6f570"}
Sep 11 04:14:25.548811 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:25.548766    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:14:25.549021 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:25.548974    2558 patch_prober.go:28] interesting pod/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 11 04:14:25.549102 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:25.549032    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg" podUID="774da4e2-b15a-4165-af45-1b9107dbf0a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 11 04:14:26.548517 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:26.548477    2558 patch_prober.go:28] interesting pod/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 11 04:14:26.548903 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:26.548542    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg" podUID="774da4e2-b15a-4165-af45-1b9107dbf0a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 11 04:14:27.548939 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:27.548892    2558 patch_prober.go:28] interesting pod/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 11 04:14:27.549325 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:27.548953    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg" podUID="774da4e2-b15a-4165-af45-1b9107dbf0a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 11 04:14:28.549096 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:28.549057    2558 patch_prober.go:28] interesting pod/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 11 04:14:28.549517 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:28.549134    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg" podUID="774da4e2-b15a-4165-af45-1b9107dbf0a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 11 04:14:29.549108 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:29.549068    2558 patch_prober.go:28] interesting pod/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 11 04:14:29.549532 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:29.549137    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg" podUID="774da4e2-b15a-4165-af45-1b9107dbf0a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 11 04:14:30.576625 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:30.576591    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:14:30.577057 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:30.576999    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:14:30.577712 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:30.577689    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:14:39.092846 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:39.092803    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f"]
Sep 11 04:14:39.096250 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:39.096228    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f"
Sep 11 04:14:39.100059 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:39.100034    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-354ac6fe\"/\"default-dockercfg-lslwq\""
Sep 11 04:14:39.100212 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:39.100057    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-354ac6fe\"/\"kube-root-ca.crt\""
Sep 11 04:14:39.100212 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:39.100066    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-354ac6fe\"/\"openshift-service-ca.crt\""
Sep 11 04:14:39.100212 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:39.100076    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-354ac6fe\"/\"e2e-lifecycle-model-354ac6fe-kserve-self-signed-certs\""
Sep 11 04:14:39.106911 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:39.106886    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f"]
Sep 11 04:14:39.176174 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:39.176141    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b69520ba-e5e7-43de-abb4-098bbdae999e-home\") pod \"e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f\" (UID: \"b69520ba-e5e7-43de-abb4-098bbdae999e\") " pod="ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f"
Sep 11 04:14:39.176174 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:39.176179    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b69520ba-e5e7-43de-abb4-098bbdae999e-tmp-dir\") pod \"e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f\" (UID: \"b69520ba-e5e7-43de-abb4-098bbdae999e\") " pod="ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f"
Sep 11 04:14:39.176376 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:39.176219    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b69520ba-e5e7-43de-abb4-098bbdae999e-model-cache\") pod \"e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f\" (UID: \"b69520ba-e5e7-43de-abb4-098bbdae999e\") " pod="ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f"
Sep 11 04:14:39.176376 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:39.176271    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b69520ba-e5e7-43de-abb4-098bbdae999e-tls-certs\") pod \"e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f\" (UID: \"b69520ba-e5e7-43de-abb4-098bbdae999e\") " pod="ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f"
Sep 11 04:14:39.176376 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:39.176292    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b69520ba-e5e7-43de-abb4-098bbdae999e-dshm\") pod \"e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f\" (UID: \"b69520ba-e5e7-43de-abb4-098bbdae999e\") " pod="ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f"
Sep 11 04:14:39.176376 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:39.176319    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb6tv\" (UniqueName: \"kubernetes.io/projected/b69520ba-e5e7-43de-abb4-098bbdae999e-kube-api-access-mb6tv\") pod \"e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f\" (UID: \"b69520ba-e5e7-43de-abb4-098bbdae999e\") " pod="ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f"
Sep 11 04:14:39.277593 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:39.277556    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b69520ba-e5e7-43de-abb4-098bbdae999e-tls-certs\") pod \"e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f\" (UID: \"b69520ba-e5e7-43de-abb4-098bbdae999e\") " pod="ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f"
Sep 11 04:14:39.278313 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:39.278287    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b69520ba-e5e7-43de-abb4-098bbdae999e-dshm\") pod \"e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f\" (UID: \"b69520ba-e5e7-43de-abb4-098bbdae999e\") " pod="ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f"
Sep 11 04:14:39.278863 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:39.278842    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb6tv\" (UniqueName: \"kubernetes.io/projected/b69520ba-e5e7-43de-abb4-098bbdae999e-kube-api-access-mb6tv\") pod \"e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f\" (UID: \"b69520ba-e5e7-43de-abb4-098bbdae999e\") " pod="ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f"
Sep 11 04:14:39.279118 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:39.279101    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b69520ba-e5e7-43de-abb4-098bbdae999e-home\") pod \"e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f\" (UID: \"b69520ba-e5e7-43de-abb4-098bbdae999e\") " pod="ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f"
Sep 11 04:14:39.279266 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:39.279249    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b69520ba-e5e7-43de-abb4-098bbdae999e-tmp-dir\") pod \"e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f\" (UID: \"b69520ba-e5e7-43de-abb4-098bbdae999e\") " pod="ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f"
Sep 11 04:14:39.279450 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:39.279432    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b69520ba-e5e7-43de-abb4-098bbdae999e-model-cache\") pod \"e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f\" (UID: \"b69520ba-e5e7-43de-abb4-098bbdae999e\") " pod="ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f"
Sep 11 04:14:39.279618 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:39.279594    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b69520ba-e5e7-43de-abb4-098bbdae999e-home\") pod \"e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f\" (UID: \"b69520ba-e5e7-43de-abb4-098bbdae999e\") " pod="ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f"
Sep 11 04:14:39.279772 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:39.279730    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b69520ba-e5e7-43de-abb4-098bbdae999e-model-cache\") pod \"e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f\" (UID: \"b69520ba-e5e7-43de-abb4-098bbdae999e\") " pod="ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f"
Sep 11 04:14:39.279994 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:39.279978    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b69520ba-e5e7-43de-abb4-098bbdae999e-tmp-dir\") pod \"e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f\" (UID: \"b69520ba-e5e7-43de-abb4-098bbdae999e\") " pod="ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f"
Sep 11 04:14:39.282082 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:39.282055    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b69520ba-e5e7-43de-abb4-098bbdae999e-tls-certs\") pod \"e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f\" (UID: \"b69520ba-e5e7-43de-abb4-098bbdae999e\") " pod="ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f"
Sep 11 04:14:39.282284 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:39.282256    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b69520ba-e5e7-43de-abb4-098bbdae999e-dshm\") pod \"e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f\" (UID: \"b69520ba-e5e7-43de-abb4-098bbdae999e\") " pod="ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f"
Sep 11 04:14:39.287195 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:39.287170    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb6tv\" (UniqueName: \"kubernetes.io/projected/b69520ba-e5e7-43de-abb4-098bbdae999e-kube-api-access-mb6tv\") pod \"e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f\" (UID: \"b69520ba-e5e7-43de-abb4-098bbdae999e\") " pod="ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f"
Sep 11 04:14:39.406541 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:39.406443    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f"
Sep 11 04:14:39.680499 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:39.680466    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f"]
Sep 11 04:14:39.681162 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:14:39.681135    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb69520ba_e5e7_43de_abb4_098bbdae999e.slice/crio-78041a2eb424e191ec81606dacc1e4531b45186a59b33c2ec91ce96beb7c2e8c WatchSource:0}: Error finding container 78041a2eb424e191ec81606dacc1e4531b45186a59b33c2ec91ce96beb7c2e8c: Status 404 returned error can't find the container with id 78041a2eb424e191ec81606dacc1e4531b45186a59b33c2ec91ce96beb7c2e8c
Sep 11 04:14:40.508764 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:40.508724    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:14:40.523643 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:40.523609    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f" event={"ID":"b69520ba-e5e7-43de-abb4-098bbdae999e","Type":"ContainerStarted","Data":"b3543f65c124560464378623f9b51f1f0b2d8dffe552db02ef9fee62ddd3c625"}
Sep 11 04:14:40.523792 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:40.523652    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f" event={"ID":"b69520ba-e5e7-43de-abb4-098bbdae999e","Type":"ContainerStarted","Data":"78041a2eb424e191ec81606dacc1e4531b45186a59b33c2ec91ce96beb7c2e8c"}
Sep 11 04:14:40.542780 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:40.542730    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f" podStartSLOduration=1.5427129800000001 podStartE2EDuration="1.54271298s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:14:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:14:40.541897979 +0000 UTC m=+1277.339987707" watchObservedRunningTime="2026-09-11 04:14:40.54271298 +0000 UTC m=+1277.340802706"
Sep 11 04:14:49.407252 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:49.407197    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f"
Sep 11 04:14:49.407252 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:49.407259    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f"
Sep 11 04:14:49.419226 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:49.419199    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f"
Sep 11 04:14:49.585185 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:49.585162    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f"
Sep 11 04:14:59.395402 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:14:59.395350    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:15:00.201449 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:00.198438    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-354ac6fe-29818335-dbp2k"]
Sep 11 04:15:00.204529 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:00.204504    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-354ac6fe-29818335-dbp2k"
Sep 11 04:15:00.211788 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:00.211763    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6brsr\""
Sep 11 04:15:00.216739 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:00.216564    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-354ac6fe-29818335-dbp2k"]
Sep 11 04:15:00.224517 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:00.224483    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-354ac6fe-29818335-dbp2k"
Sep 11 04:15:00.501711 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:00.501681    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-354ac6fe-29818335-dbp2k"]
Sep 11 04:15:00.502655 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:15:00.502629    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4f6112f_d23b_41b7_aac9_df156ca6f001.slice/crio-5d9587250515ce52f44b0a7cd25713ffccee5be0ab6a073da849dc5a53b9805c WatchSource:0}: Error finding container 5d9587250515ce52f44b0a7cd25713ffccee5be0ab6a073da849dc5a53b9805c: Status 404 returned error can't find the container with id 5d9587250515ce52f44b0a7cd25713ffccee5be0ab6a073da849dc5a53b9805c
Sep 11 04:15:00.504615 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:00.504593    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 04:15:00.635393 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:00.635363    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-354ac6fe-29818335-dbp2k" event={"ID":"d4f6112f-d23b-41b7-aac9-df156ca6f001","Type":"ContainerStarted","Data":"5d9587250515ce52f44b0a7cd25713ffccee5be0ab6a073da849dc5a53b9805c"}
Sep 11 04:15:03.654505 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:03.654477    2558 generic.go:356] "Generic (PLEG): container finished" podID="d4f6112f-d23b-41b7-aac9-df156ca6f001" containerID="4257a2d7bd6a50ed8d6fa19498709c9d37e7368e6be59471e5bcd0e0450e61c2" exitCode=0
Sep 11 04:15:03.654855 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:03.654557    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-354ac6fe-29818335-dbp2k" event={"ID":"d4f6112f-d23b-41b7-aac9-df156ca6f001","Type":"ContainerDied","Data":"4257a2d7bd6a50ed8d6fa19498709c9d37e7368e6be59471e5bcd0e0450e61c2"}
Sep 11 04:15:04.799946 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:04.799919    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-354ac6fe-29818335-dbp2k"
Sep 11 04:15:05.666486 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:05.666450    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-354ac6fe-29818335-dbp2k"
Sep 11 04:15:05.666486 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:05.666477    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-354ac6fe-29818335-dbp2k" event={"ID":"d4f6112f-d23b-41b7-aac9-df156ca6f001","Type":"ContainerDied","Data":"5d9587250515ce52f44b0a7cd25713ffccee5be0ab6a073da849dc5a53b9805c"}
Sep 11 04:15:05.666701 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:05.666547    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d9587250515ce52f44b0a7cd25713ffccee5be0ab6a073da849dc5a53b9805c"
Sep 11 04:15:16.807758 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:16.807725    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:15:23.834578 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:23.834545    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-354ac6fe-29818335-dbp2k"]
Sep 11 04:15:23.836597 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:23.836571    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-354ac6fe-29818335-dbp2k"]
Sep 11 04:15:25.809776 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:25.809738    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4f6112f-d23b-41b7-aac9-df156ca6f001" path="/var/lib/kubelet/pods/d4f6112f-d23b-41b7-aac9-df156ca6f001/volumes"
Sep 11 04:15:32.385627 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:32.385592    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f"]
Sep 11 04:15:38.694713 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:38.694675    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:15:47.405410 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:47.405286    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f" podUID="b69520ba-e5e7-43de-abb4-098bbdae999e" containerName="main" containerID="cri-o://b3543f65c124560464378623f9b51f1f0b2d8dffe552db02ef9fee62ddd3c625" gracePeriod=45
Sep 11 04:15:47.661577 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:47.661523    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f"
Sep 11 04:15:47.797966 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:47.797934    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b69520ba-e5e7-43de-abb4-098bbdae999e-dshm\") pod \"b69520ba-e5e7-43de-abb4-098bbdae999e\" (UID: \"b69520ba-e5e7-43de-abb4-098bbdae999e\") "
Sep 11 04:15:47.798133 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:47.797986    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mb6tv\" (UniqueName: \"kubernetes.io/projected/b69520ba-e5e7-43de-abb4-098bbdae999e-kube-api-access-mb6tv\") pod \"b69520ba-e5e7-43de-abb4-098bbdae999e\" (UID: \"b69520ba-e5e7-43de-abb4-098bbdae999e\") "
Sep 11 04:15:47.798133 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:47.798021    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b69520ba-e5e7-43de-abb4-098bbdae999e-tmp-dir\") pod \"b69520ba-e5e7-43de-abb4-098bbdae999e\" (UID: \"b69520ba-e5e7-43de-abb4-098bbdae999e\") "
Sep 11 04:15:47.798133 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:47.798039    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b69520ba-e5e7-43de-abb4-098bbdae999e-tls-certs\") pod \"b69520ba-e5e7-43de-abb4-098bbdae999e\" (UID: \"b69520ba-e5e7-43de-abb4-098bbdae999e\") "
Sep 11 04:15:47.798133 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:47.798056    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b69520ba-e5e7-43de-abb4-098bbdae999e-home\") pod \"b69520ba-e5e7-43de-abb4-098bbdae999e\" (UID: \"b69520ba-e5e7-43de-abb4-098bbdae999e\") "
Sep 11 04:15:47.798335 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:47.798188    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b69520ba-e5e7-43de-abb4-098bbdae999e-model-cache\") pod \"b69520ba-e5e7-43de-abb4-098bbdae999e\" (UID: \"b69520ba-e5e7-43de-abb4-098bbdae999e\") "
Sep 11 04:15:47.798335 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:47.798278    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b69520ba-e5e7-43de-abb4-098bbdae999e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b69520ba-e5e7-43de-abb4-098bbdae999e" (UID: "b69520ba-e5e7-43de-abb4-098bbdae999e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:15:47.798478 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:47.798380    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b69520ba-e5e7-43de-abb4-098bbdae999e-home" (OuterVolumeSpecName: "home") pod "b69520ba-e5e7-43de-abb4-098bbdae999e" (UID: "b69520ba-e5e7-43de-abb4-098bbdae999e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:15:47.798531 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:47.798473    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b69520ba-e5e7-43de-abb4-098bbdae999e-model-cache" (OuterVolumeSpecName: "model-cache") pod "b69520ba-e5e7-43de-abb4-098bbdae999e" (UID: "b69520ba-e5e7-43de-abb4-098bbdae999e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:15:47.798611 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:47.798591    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b69520ba-e5e7-43de-abb4-098bbdae999e-model-cache\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:15:47.798683 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:47.798618    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b69520ba-e5e7-43de-abb4-098bbdae999e-tmp-dir\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:15:47.798683 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:47.798632    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b69520ba-e5e7-43de-abb4-098bbdae999e-home\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:15:47.800229 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:47.800206    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b69520ba-e5e7-43de-abb4-098bbdae999e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b69520ba-e5e7-43de-abb4-098bbdae999e" (UID: "b69520ba-e5e7-43de-abb4-098bbdae999e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:15:47.800331 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:47.800233    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b69520ba-e5e7-43de-abb4-098bbdae999e-dshm" (OuterVolumeSpecName: "dshm") pod "b69520ba-e5e7-43de-abb4-098bbdae999e" (UID: "b69520ba-e5e7-43de-abb4-098bbdae999e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:15:47.800331 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:47.800252    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b69520ba-e5e7-43de-abb4-098bbdae999e-kube-api-access-mb6tv" (OuterVolumeSpecName: "kube-api-access-mb6tv") pod "b69520ba-e5e7-43de-abb4-098bbdae999e" (UID: "b69520ba-e5e7-43de-abb4-098bbdae999e"). InnerVolumeSpecName "kube-api-access-mb6tv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:15:47.900042 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:47.900010    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b69520ba-e5e7-43de-abb4-098bbdae999e-dshm\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:15:47.900042 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:47.900037    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mb6tv\" (UniqueName: \"kubernetes.io/projected/b69520ba-e5e7-43de-abb4-098bbdae999e-kube-api-access-mb6tv\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:15:47.900220 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:47.900052    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b69520ba-e5e7-43de-abb4-098bbdae999e-tls-certs\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:15:47.906904 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:47.906865    2558 generic.go:356] "Generic (PLEG): container finished" podID="b69520ba-e5e7-43de-abb4-098bbdae999e" containerID="b3543f65c124560464378623f9b51f1f0b2d8dffe552db02ef9fee62ddd3c625" exitCode=0
Sep 11 04:15:47.907024 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:47.906907    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f"
Sep 11 04:15:47.907024 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:47.906946    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f" event={"ID":"b69520ba-e5e7-43de-abb4-098bbdae999e","Type":"ContainerDied","Data":"b3543f65c124560464378623f9b51f1f0b2d8dffe552db02ef9fee62ddd3c625"}
Sep 11 04:15:47.907024 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:47.906999    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f" event={"ID":"b69520ba-e5e7-43de-abb4-098bbdae999e","Type":"ContainerDied","Data":"78041a2eb424e191ec81606dacc1e4531b45186a59b33c2ec91ce96beb7c2e8c"}
Sep 11 04:15:47.907024 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:47.907017    2558 scope.go:117] "RemoveContainer" containerID="b3543f65c124560464378623f9b51f1f0b2d8dffe552db02ef9fee62ddd3c625"
Sep 11 04:15:47.915852 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:47.915824    2558 scope.go:117] "RemoveContainer" containerID="b3543f65c124560464378623f9b51f1f0b2d8dffe552db02ef9fee62ddd3c625"
Sep 11 04:15:47.916105 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:15:47.916086    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3543f65c124560464378623f9b51f1f0b2d8dffe552db02ef9fee62ddd3c625\": container with ID starting with b3543f65c124560464378623f9b51f1f0b2d8dffe552db02ef9fee62ddd3c625 not found: ID does not exist" containerID="b3543f65c124560464378623f9b51f1f0b2d8dffe552db02ef9fee62ddd3c625"
Sep 11 04:15:47.916188 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:47.916118    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3543f65c124560464378623f9b51f1f0b2d8dffe552db02ef9fee62ddd3c625"} err="failed to get container status \"b3543f65c124560464378623f9b51f1f0b2d8dffe552db02ef9fee62ddd3c625\": rpc error: code = NotFound desc = could not find container \"b3543f65c124560464378623f9b51f1f0b2d8dffe552db02ef9fee62ddd3c625\": container with ID starting with b3543f65c124560464378623f9b51f1f0b2d8dffe552db02ef9fee62ddd3c625 not found: ID does not exist"
Sep 11 04:15:47.925320 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:47.925268    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f"]
Sep 11 04:15:47.930479 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:47.930460    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-354ac6fe/e2e-lifecycle-model-354ac6fe-kserve-65768cb48c-bb29f"]
Sep 11 04:15:49.810761 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:49.810724    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b69520ba-e5e7-43de-abb4-098bbdae999e" path="/var/lib/kubelet/pods/b69520ba-e5e7-43de-abb4-098bbdae999e/volumes"
Sep 11 04:15:54.705560 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:15:54.705523    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:16:08.704283 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:08.704241    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:16:21.000535 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:21.000500    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:16:30.143840 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:30.143807    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"]
Sep 11 04:16:30.144256 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:30.144065    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg" podUID="774da4e2-b15a-4165-af45-1b9107dbf0a0" containerName="istio-proxy" containerID="cri-o://ff42cf8a9aa16b4e046ae4d999f6cc89b85de2c20c33b41e643eddae75e6f570" gracePeriod=30
Sep 11 04:16:30.579770 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:30.579727    2558 patch_prober.go:28] interesting pod/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 04:16:30.579952 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:30.579819    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg" podUID="774da4e2-b15a-4165-af45-1b9107dbf0a0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 04:16:35.407360 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:35.407302    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:16:35.472619 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:35.472580    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/774da4e2-b15a-4165-af45-1b9107dbf0a0-istiod-ca-cert\") pod \"774da4e2-b15a-4165-af45-1b9107dbf0a0\" (UID: \"774da4e2-b15a-4165-af45-1b9107dbf0a0\") "
Sep 11 04:16:35.472619 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:35.472629    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtggz\" (UniqueName: \"kubernetes.io/projected/774da4e2-b15a-4165-af45-1b9107dbf0a0-kube-api-access-jtggz\") pod \"774da4e2-b15a-4165-af45-1b9107dbf0a0\" (UID: \"774da4e2-b15a-4165-af45-1b9107dbf0a0\") "
Sep 11 04:16:35.472809 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:35.472673    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/774da4e2-b15a-4165-af45-1b9107dbf0a0-istio-podinfo\") pod \"774da4e2-b15a-4165-af45-1b9107dbf0a0\" (UID: \"774da4e2-b15a-4165-af45-1b9107dbf0a0\") "
Sep 11 04:16:35.472809 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:35.472699    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/774da4e2-b15a-4165-af45-1b9107dbf0a0-credential-socket\") pod \"774da4e2-b15a-4165-af45-1b9107dbf0a0\" (UID: \"774da4e2-b15a-4165-af45-1b9107dbf0a0\") "
Sep 11 04:16:35.472809 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:35.472721    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/774da4e2-b15a-4165-af45-1b9107dbf0a0-istio-token\") pod \"774da4e2-b15a-4165-af45-1b9107dbf0a0\" (UID: \"774da4e2-b15a-4165-af45-1b9107dbf0a0\") "
Sep 11 04:16:35.472966 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:35.472818    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/774da4e2-b15a-4165-af45-1b9107dbf0a0-workload-certs\") pod \"774da4e2-b15a-4165-af45-1b9107dbf0a0\" (UID: \"774da4e2-b15a-4165-af45-1b9107dbf0a0\") "
Sep 11 04:16:35.472966 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:35.472909    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/774da4e2-b15a-4165-af45-1b9107dbf0a0-workload-socket\") pod \"774da4e2-b15a-4165-af45-1b9107dbf0a0\" (UID: \"774da4e2-b15a-4165-af45-1b9107dbf0a0\") "
Sep 11 04:16:35.472966 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:35.472947    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/774da4e2-b15a-4165-af45-1b9107dbf0a0-istio-data\") pod \"774da4e2-b15a-4165-af45-1b9107dbf0a0\" (UID: \"774da4e2-b15a-4165-af45-1b9107dbf0a0\") "
Sep 11 04:16:35.473114 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:35.472973    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/774da4e2-b15a-4165-af45-1b9107dbf0a0-istio-envoy\") pod \"774da4e2-b15a-4165-af45-1b9107dbf0a0\" (UID: \"774da4e2-b15a-4165-af45-1b9107dbf0a0\") "
Sep 11 04:16:35.473114 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:35.473018    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/774da4e2-b15a-4165-af45-1b9107dbf0a0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "774da4e2-b15a-4165-af45-1b9107dbf0a0" (UID: "774da4e2-b15a-4165-af45-1b9107dbf0a0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:16:35.473114 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:35.473063    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/774da4e2-b15a-4165-af45-1b9107dbf0a0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "774da4e2-b15a-4165-af45-1b9107dbf0a0" (UID: "774da4e2-b15a-4165-af45-1b9107dbf0a0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:16:35.473259 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:35.473215    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/774da4e2-b15a-4165-af45-1b9107dbf0a0-istio-data" (OuterVolumeSpecName: "istio-data") pod "774da4e2-b15a-4165-af45-1b9107dbf0a0" (UID: "774da4e2-b15a-4165-af45-1b9107dbf0a0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:16:35.473259 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:35.473230    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/774da4e2-b15a-4165-af45-1b9107dbf0a0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "774da4e2-b15a-4165-af45-1b9107dbf0a0" (UID: "774da4e2-b15a-4165-af45-1b9107dbf0a0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:16:35.473478 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:35.473458    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/774da4e2-b15a-4165-af45-1b9107dbf0a0-workload-socket\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:16:35.473556 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:35.473484    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/774da4e2-b15a-4165-af45-1b9107dbf0a0-istio-data\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:16:35.473556 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:35.473500    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/774da4e2-b15a-4165-af45-1b9107dbf0a0-credential-socket\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:16:35.473556 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:35.473514    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/774da4e2-b15a-4165-af45-1b9107dbf0a0-workload-certs\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:16:35.473556 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:35.472930    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/774da4e2-b15a-4165-af45-1b9107dbf0a0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "774da4e2-b15a-4165-af45-1b9107dbf0a0" (UID: "774da4e2-b15a-4165-af45-1b9107dbf0a0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:16:35.474837 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:35.474807    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/774da4e2-b15a-4165-af45-1b9107dbf0a0-istio-token" (OuterVolumeSpecName: "istio-token") pod "774da4e2-b15a-4165-af45-1b9107dbf0a0" (UID: "774da4e2-b15a-4165-af45-1b9107dbf0a0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:16:35.474951 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:35.474883    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/774da4e2-b15a-4165-af45-1b9107dbf0a0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "774da4e2-b15a-4165-af45-1b9107dbf0a0" (UID: "774da4e2-b15a-4165-af45-1b9107dbf0a0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 04:16:35.474951 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:35.474927    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/774da4e2-b15a-4165-af45-1b9107dbf0a0-kube-api-access-jtggz" (OuterVolumeSpecName: "kube-api-access-jtggz") pod "774da4e2-b15a-4165-af45-1b9107dbf0a0" (UID: "774da4e2-b15a-4165-af45-1b9107dbf0a0"). InnerVolumeSpecName "kube-api-access-jtggz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:16:35.475039 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:35.475010    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/774da4e2-b15a-4165-af45-1b9107dbf0a0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "774da4e2-b15a-4165-af45-1b9107dbf0a0" (UID: "774da4e2-b15a-4165-af45-1b9107dbf0a0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:16:35.574934 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:35.574899    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/774da4e2-b15a-4165-af45-1b9107dbf0a0-istiod-ca-cert\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:16:35.574934 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:35.574934    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtggz\" (UniqueName: \"kubernetes.io/projected/774da4e2-b15a-4165-af45-1b9107dbf0a0-kube-api-access-jtggz\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:16:35.575102 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:35.574944    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/774da4e2-b15a-4165-af45-1b9107dbf0a0-istio-podinfo\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:16:35.575102 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:35.574965    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/774da4e2-b15a-4165-af45-1b9107dbf0a0-istio-token\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:16:35.575102 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:35.574974    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/774da4e2-b15a-4165-af45-1b9107dbf0a0-istio-envoy\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:16:36.192008 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:36.191911    2558 generic.go:356] "Generic (PLEG): container finished" podID="774da4e2-b15a-4165-af45-1b9107dbf0a0" containerID="ff42cf8a9aa16b4e046ae4d999f6cc89b85de2c20c33b41e643eddae75e6f570" exitCode=0
Sep 11 04:16:36.192008 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:36.191964    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"
Sep 11 04:16:36.192254 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:36.192003    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg" event={"ID":"774da4e2-b15a-4165-af45-1b9107dbf0a0","Type":"ContainerDied","Data":"ff42cf8a9aa16b4e046ae4d999f6cc89b85de2c20c33b41e643eddae75e6f570"}
Sep 11 04:16:36.192254 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:36.192069    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg" event={"ID":"774da4e2-b15a-4165-af45-1b9107dbf0a0","Type":"ContainerDied","Data":"bd0497b5efb8c295672fa0f4d8a9e057f16513181c292dca2fbe506cb6ca3729"}
Sep 11 04:16:36.192254 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:36.192101    2558 scope.go:117] "RemoveContainer" containerID="ff42cf8a9aa16b4e046ae4d999f6cc89b85de2c20c33b41e643eddae75e6f570"
Sep 11 04:16:36.201435 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:36.201414    2558 scope.go:117] "RemoveContainer" containerID="71e76e1f301952941ff2c48b4fe16bba74dc88a32a10b1d8595f5636bce395f3"
Sep 11 04:16:36.210584 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:36.210551    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"]
Sep 11 04:16:36.210815 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:36.210800    2558 scope.go:117] "RemoveContainer" containerID="ff42cf8a9aa16b4e046ae4d999f6cc89b85de2c20c33b41e643eddae75e6f570"
Sep 11 04:16:36.211150 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:16:36.211129    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff42cf8a9aa16b4e046ae4d999f6cc89b85de2c20c33b41e643eddae75e6f570\": container with ID starting with ff42cf8a9aa16b4e046ae4d999f6cc89b85de2c20c33b41e643eddae75e6f570 not found: ID does not exist" containerID="ff42cf8a9aa16b4e046ae4d999f6cc89b85de2c20c33b41e643eddae75e6f570"
Sep 11 04:16:36.211210 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:36.211159    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff42cf8a9aa16b4e046ae4d999f6cc89b85de2c20c33b41e643eddae75e6f570"} err="failed to get container status \"ff42cf8a9aa16b4e046ae4d999f6cc89b85de2c20c33b41e643eddae75e6f570\": rpc error: code = NotFound desc = could not find container \"ff42cf8a9aa16b4e046ae4d999f6cc89b85de2c20c33b41e643eddae75e6f570\": container with ID starting with ff42cf8a9aa16b4e046ae4d999f6cc89b85de2c20c33b41e643eddae75e6f570 not found: ID does not exist"
Sep 11 04:16:36.211210 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:36.211178    2558 scope.go:117] "RemoveContainer" containerID="71e76e1f301952941ff2c48b4fe16bba74dc88a32a10b1d8595f5636bce395f3"
Sep 11 04:16:36.211412 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:16:36.211379    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71e76e1f301952941ff2c48b4fe16bba74dc88a32a10b1d8595f5636bce395f3\": container with ID starting with 71e76e1f301952941ff2c48b4fe16bba74dc88a32a10b1d8595f5636bce395f3 not found: ID does not exist" containerID="71e76e1f301952941ff2c48b4fe16bba74dc88a32a10b1d8595f5636bce395f3"
Sep 11 04:16:36.211468 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:36.211416    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71e76e1f301952941ff2c48b4fe16bba74dc88a32a10b1d8595f5636bce395f3"} err="failed to get container status \"71e76e1f301952941ff2c48b4fe16bba74dc88a32a10b1d8595f5636bce395f3\": rpc error: code = NotFound desc = could not find container \"71e76e1f301952941ff2c48b4fe16bba74dc88a32a10b1d8595f5636bce395f3\": container with ID starting with 71e76e1f301952941ff2c48b4fe16bba74dc88a32a10b1d8595f5636bce395f3 not found: ID does not exist"
Sep 11 04:16:36.217147 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:36.217120    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg"]
Sep 11 04:16:36.405982 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:36.405935    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:16:37.810234 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:37.810199    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="774da4e2-b15a-4165-af45-1b9107dbf0a0" path="/var/lib/kubelet/pods/774da4e2-b15a-4165-af45-1b9107dbf0a0/volumes"
Sep 11 04:16:51.992992 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:16:51.992952    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:17:26.075403 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.075349    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"]
Sep 11 04:17:26.076021 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.076001    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="774da4e2-b15a-4165-af45-1b9107dbf0a0" containerName="istio-proxy"
Sep 11 04:17:26.076124 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.076025    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="774da4e2-b15a-4165-af45-1b9107dbf0a0" containerName="istio-proxy"
Sep 11 04:17:26.076124 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.076042    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="774da4e2-b15a-4165-af45-1b9107dbf0a0" containerName="istio-proxy"
Sep 11 04:17:26.076124 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.076057    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="774da4e2-b15a-4165-af45-1b9107dbf0a0" containerName="istio-proxy"
Sep 11 04:17:26.076124 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.076073    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4f6112f-d23b-41b7-aac9-df156ca6f001" containerName="cleanup"
Sep 11 04:17:26.076124 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.076082    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4f6112f-d23b-41b7-aac9-df156ca6f001" containerName="cleanup"
Sep 11 04:17:26.076124 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.076109    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b69520ba-e5e7-43de-abb4-098bbdae999e" containerName="main"
Sep 11 04:17:26.076124 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.076117    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b69520ba-e5e7-43de-abb4-098bbdae999e" containerName="main"
Sep 11 04:17:26.076500 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.076214    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="774da4e2-b15a-4165-af45-1b9107dbf0a0" containerName="istio-proxy"
Sep 11 04:17:26.076500 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.076228    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="774da4e2-b15a-4165-af45-1b9107dbf0a0" containerName="istio-proxy"
Sep 11 04:17:26.076500 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.076238    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4f6112f-d23b-41b7-aac9-df156ca6f001" containerName="cleanup"
Sep 11 04:17:26.076500 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.076250    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b69520ba-e5e7-43de-abb4-098bbdae999e" containerName="main"
Sep 11 04:17:26.080590 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.080568    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:17:26.084268 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.084248    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-bf30f8-openshift-default-dockercfg-vqwdt\""
Sep 11 04:17:26.097067 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.097042    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"]
Sep 11 04:17:26.172091 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.172059    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d10d560-9503-4fce-be96-79cee6ef45e2-istio-token\") pod \"e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx\" (UID: \"3d10d560-9503-4fce-be96-79cee6ef45e2\") " pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:17:26.172091 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.172108    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d10d560-9503-4fce-be96-79cee6ef45e2-istio-data\") pod \"e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx\" (UID: \"3d10d560-9503-4fce-be96-79cee6ef45e2\") " pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:17:26.172322 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.172129    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c86fd\" (UniqueName: \"kubernetes.io/projected/3d10d560-9503-4fce-be96-79cee6ef45e2-kube-api-access-c86fd\") pod \"e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx\" (UID: \"3d10d560-9503-4fce-be96-79cee6ef45e2\") " pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:17:26.172322 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.172194    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d10d560-9503-4fce-be96-79cee6ef45e2-credential-socket\") pod \"e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx\" (UID: \"3d10d560-9503-4fce-be96-79cee6ef45e2\") " pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:17:26.172322 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.172272    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d10d560-9503-4fce-be96-79cee6ef45e2-workload-socket\") pod \"e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx\" (UID: \"3d10d560-9503-4fce-be96-79cee6ef45e2\") " pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:17:26.172483 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.172353    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d10d560-9503-4fce-be96-79cee6ef45e2-workload-certs\") pod \"e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx\" (UID: \"3d10d560-9503-4fce-be96-79cee6ef45e2\") " pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:17:26.172483 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.172381    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d10d560-9503-4fce-be96-79cee6ef45e2-istio-envoy\") pod \"e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx\" (UID: \"3d10d560-9503-4fce-be96-79cee6ef45e2\") " pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:17:26.172483 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.172417    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d10d560-9503-4fce-be96-79cee6ef45e2-istio-podinfo\") pod \"e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx\" (UID: \"3d10d560-9503-4fce-be96-79cee6ef45e2\") " pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:17:26.172483 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.172450    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d10d560-9503-4fce-be96-79cee6ef45e2-istiod-ca-cert\") pod \"e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx\" (UID: \"3d10d560-9503-4fce-be96-79cee6ef45e2\") " pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:17:26.273659 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.273629    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d10d560-9503-4fce-be96-79cee6ef45e2-istio-data\") pod \"e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx\" (UID: \"3d10d560-9503-4fce-be96-79cee6ef45e2\") " pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:17:26.273856 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.273666    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c86fd\" (UniqueName: \"kubernetes.io/projected/3d10d560-9503-4fce-be96-79cee6ef45e2-kube-api-access-c86fd\") pod \"e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx\" (UID: \"3d10d560-9503-4fce-be96-79cee6ef45e2\") " pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:17:26.273856 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.273690    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d10d560-9503-4fce-be96-79cee6ef45e2-credential-socket\") pod \"e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx\" (UID: \"3d10d560-9503-4fce-be96-79cee6ef45e2\") " pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:17:26.273856 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.273757    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d10d560-9503-4fce-be96-79cee6ef45e2-workload-socket\") pod \"e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx\" (UID: \"3d10d560-9503-4fce-be96-79cee6ef45e2\") " pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:17:26.273856 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.273808    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d10d560-9503-4fce-be96-79cee6ef45e2-workload-certs\") pod \"e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx\" (UID: \"3d10d560-9503-4fce-be96-79cee6ef45e2\") " pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:17:26.273856 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.273835    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d10d560-9503-4fce-be96-79cee6ef45e2-istio-envoy\") pod \"e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx\" (UID: \"3d10d560-9503-4fce-be96-79cee6ef45e2\") " pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:17:26.274135 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.273869    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d10d560-9503-4fce-be96-79cee6ef45e2-istio-podinfo\") pod \"e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx\" (UID: \"3d10d560-9503-4fce-be96-79cee6ef45e2\") " pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:17:26.274135 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.273892    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d10d560-9503-4fce-be96-79cee6ef45e2-istiod-ca-cert\") pod \"e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx\" (UID: \"3d10d560-9503-4fce-be96-79cee6ef45e2\") " pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:17:26.274135 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.273926    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d10d560-9503-4fce-be96-79cee6ef45e2-istio-token\") pod \"e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx\" (UID: \"3d10d560-9503-4fce-be96-79cee6ef45e2\") " pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:17:26.274135 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.274087    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d10d560-9503-4fce-be96-79cee6ef45e2-istio-data\") pod \"e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx\" (UID: \"3d10d560-9503-4fce-be96-79cee6ef45e2\") " pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:17:26.274350 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.274135    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d10d560-9503-4fce-be96-79cee6ef45e2-credential-socket\") pod \"e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx\" (UID: \"3d10d560-9503-4fce-be96-79cee6ef45e2\") " pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:17:26.274350 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.274167    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d10d560-9503-4fce-be96-79cee6ef45e2-workload-socket\") pod \"e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx\" (UID: \"3d10d560-9503-4fce-be96-79cee6ef45e2\") " pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:17:26.274350 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.274251    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d10d560-9503-4fce-be96-79cee6ef45e2-workload-certs\") pod \"e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx\" (UID: \"3d10d560-9503-4fce-be96-79cee6ef45e2\") " pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:17:26.274673 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.274654    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d10d560-9503-4fce-be96-79cee6ef45e2-istiod-ca-cert\") pod \"e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx\" (UID: \"3d10d560-9503-4fce-be96-79cee6ef45e2\") " pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:17:26.276213 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.276192    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d10d560-9503-4fce-be96-79cee6ef45e2-istio-envoy\") pod \"e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx\" (UID: \"3d10d560-9503-4fce-be96-79cee6ef45e2\") " pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:17:26.276499 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.276482    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d10d560-9503-4fce-be96-79cee6ef45e2-istio-podinfo\") pod \"e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx\" (UID: \"3d10d560-9503-4fce-be96-79cee6ef45e2\") " pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:17:26.281989 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.281969    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c86fd\" (UniqueName: \"kubernetes.io/projected/3d10d560-9503-4fce-be96-79cee6ef45e2-kube-api-access-c86fd\") pod \"e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx\" (UID: \"3d10d560-9503-4fce-be96-79cee6ef45e2\") " pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:17:26.282118 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.282096    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d10d560-9503-4fce-be96-79cee6ef45e2-istio-token\") pod \"e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx\" (UID: \"3d10d560-9503-4fce-be96-79cee6ef45e2\") " pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:17:26.391527 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.391446    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:17:26.671517 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.671496    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"]
Sep 11 04:17:26.673717 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:17:26.673691    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d10d560_9503_4fce_be96_79cee6ef45e2.slice/crio-0bc65f79a8e8a715bb9f0db54666c62e118ee5a7c5ec9c1465e98466246ae5a5 WatchSource:0}: Error finding container 0bc65f79a8e8a715bb9f0db54666c62e118ee5a7c5ec9c1465e98466246ae5a5: Status 404 returned error can't find the container with id 0bc65f79a8e8a715bb9f0db54666c62e118ee5a7c5ec9c1465e98466246ae5a5
Sep 11 04:17:26.675955 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.675920    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:17:26.676075 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.675986    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:17:26.676075 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:26.676018    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:17:27.492110 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:27.492075    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx" event={"ID":"3d10d560-9503-4fce-be96-79cee6ef45e2","Type":"ContainerStarted","Data":"146ccfc8ccd6362721eadd5fadc1ac7d986544f1ac80c73dc7e45014bd7e61e8"}
Sep 11 04:17:27.492554 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:27.492132    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx" event={"ID":"3d10d560-9503-4fce-be96-79cee6ef45e2","Type":"ContainerStarted","Data":"0bc65f79a8e8a715bb9f0db54666c62e118ee5a7c5ec9c1465e98466246ae5a5"}
Sep 11 04:17:27.515535 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:27.515503    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:17:27.518292 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:27.518250    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx" podStartSLOduration=1.5182341830000001 podStartE2EDuration="1.518234183s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:17:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:17:27.515490506 +0000 UTC m=+1444.313580237" watchObservedRunningTime="2026-09-11 04:17:27.518234183 +0000 UTC m=+1444.316323909"
Sep 11 04:17:28.391643 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:28.391608    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:17:28.397068 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:28.397040    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:17:28.497911 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:28.497871    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:17:28.498876 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:28.498857    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:17:44.539537 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:44.539498    2558 patch_prober.go:28] interesting pod/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 04:17:44.540043 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:44.539561    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx" podUID="3d10d560-9503-4fce-be96-79cee6ef45e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 04:17:46.403228 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:46.403141    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:17:46.600024 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:46.599989    2558 generic.go:356] "Generic (PLEG): container finished" podID="3d10d560-9503-4fce-be96-79cee6ef45e2" containerID="146ccfc8ccd6362721eadd5fadc1ac7d986544f1ac80c73dc7e45014bd7e61e8" exitCode=0
Sep 11 04:17:46.600228 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:46.600054    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx" event={"ID":"3d10d560-9503-4fce-be96-79cee6ef45e2","Type":"ContainerDied","Data":"146ccfc8ccd6362721eadd5fadc1ac7d986544f1ac80c73dc7e45014bd7e61e8"}
Sep 11 04:17:46.600568 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:46.600551    2558 scope.go:117] "RemoveContainer" containerID="146ccfc8ccd6362721eadd5fadc1ac7d986544f1ac80c73dc7e45014bd7e61e8"
Sep 11 04:17:46.601805 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:46.601780    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:17:46.601867 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:46.601845    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:17:46.601903 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:46.601877    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:17:47.607993 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:47.607955    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx" event={"ID":"3d10d560-9503-4fce-be96-79cee6ef45e2","Type":"ContainerStarted","Data":"7ebad129561634fdd30c336494dad625af13ce8298801ef8eba3389e353e6100"}
Sep 11 04:17:48.392574 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:48.392541    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:17:48.392802 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:48.392778    2558 patch_prober.go:28] interesting pod/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 11 04:17:48.392886 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:48.392845    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx" podUID="3d10d560-9503-4fce-be96-79cee6ef45e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 11 04:17:49.392748 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:49.392707    2558 patch_prober.go:28] interesting pod/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 11 04:17:49.393154 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:49.392771    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx" podUID="3d10d560-9503-4fce-be96-79cee6ef45e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 11 04:17:50.392000 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:50.391962    2558 patch_prober.go:28] interesting pod/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 11 04:17:50.392183 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:50.392026    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx" podUID="3d10d560-9503-4fce-be96-79cee6ef45e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 11 04:17:51.392363 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:51.392326    2558 patch_prober.go:28] interesting pod/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 11 04:17:51.392789 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:51.392403    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx" podUID="3d10d560-9503-4fce-be96-79cee6ef45e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 11 04:17:52.391945 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:52.391904    2558 patch_prober.go:28] interesting pod/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 11 04:17:52.392146 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:52.391981    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx" podUID="3d10d560-9503-4fce-be96-79cee6ef45e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 11 04:17:53.398359 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:53.398318    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:17:53.398840 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:53.398602    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:17:53.399480 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:53.399455    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:17:55.283639 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:55.283604    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"]
Sep 11 04:17:55.286043 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:55.286025    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:17:55.288738 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:55.288715    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-599baf-openshift-default-dockercfg-smd2b\""
Sep 11 04:17:55.302242 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:55.302205    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"]
Sep 11 04:17:55.380029 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:55.379996    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1585e0c5-40f9-4bc0-a3b4-a7b943073744-istio-token\") pod \"e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45\" (UID: \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\") " pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:17:55.380325 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:55.380295    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1585e0c5-40f9-4bc0-a3b4-a7b943073744-istio-podinfo\") pod \"e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45\" (UID: \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\") " pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:17:55.380522 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:55.380501    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1585e0c5-40f9-4bc0-a3b4-a7b943073744-istio-data\") pod \"e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45\" (UID: \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\") " pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:17:55.380650 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:55.380632    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1585e0c5-40f9-4bc0-a3b4-a7b943073744-istio-envoy\") pod \"e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45\" (UID: \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\") " pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:17:55.380798 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:55.380780    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1585e0c5-40f9-4bc0-a3b4-a7b943073744-workload-certs\") pod \"e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45\" (UID: \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\") " pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:17:55.380950 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:55.380932    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1585e0c5-40f9-4bc0-a3b4-a7b943073744-credential-socket\") pod \"e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45\" (UID: \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\") " pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:17:55.381075 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:55.381054    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2ctz\" (UniqueName: \"kubernetes.io/projected/1585e0c5-40f9-4bc0-a3b4-a7b943073744-kube-api-access-g2ctz\") pod \"e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45\" (UID: \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\") " pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:17:55.381159 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:55.381094    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1585e0c5-40f9-4bc0-a3b4-a7b943073744-istiod-ca-cert\") pod \"e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45\" (UID: \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\") " pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:17:55.381159 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:55.381139    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1585e0c5-40f9-4bc0-a3b4-a7b943073744-workload-socket\") pod \"e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45\" (UID: \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\") " pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:17:55.481934 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:55.481897    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1585e0c5-40f9-4bc0-a3b4-a7b943073744-istio-token\") pod \"e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45\" (UID: \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\") " pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:17:55.482142 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:55.481956    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1585e0c5-40f9-4bc0-a3b4-a7b943073744-istio-podinfo\") pod \"e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45\" (UID: \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\") " pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:17:55.482142 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:55.481989    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1585e0c5-40f9-4bc0-a3b4-a7b943073744-istio-data\") pod \"e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45\" (UID: \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\") " pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:17:55.482142 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:55.482008    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1585e0c5-40f9-4bc0-a3b4-a7b943073744-istio-envoy\") pod \"e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45\" (UID: \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\") " pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:17:55.482142 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:55.482045    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1585e0c5-40f9-4bc0-a3b4-a7b943073744-workload-certs\") pod \"e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45\" (UID: \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\") " pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:17:55.482142 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:55.482078    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1585e0c5-40f9-4bc0-a3b4-a7b943073744-credential-socket\") pod \"e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45\" (UID: \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\") " pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:17:55.482142 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:55.482116    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2ctz\" (UniqueName: \"kubernetes.io/projected/1585e0c5-40f9-4bc0-a3b4-a7b943073744-kube-api-access-g2ctz\") pod \"e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45\" (UID: \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\") " pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:17:55.482142 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:55.482141    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1585e0c5-40f9-4bc0-a3b4-a7b943073744-istiod-ca-cert\") pod \"e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45\" (UID: \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\") " pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:17:55.482584 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:55.482183    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1585e0c5-40f9-4bc0-a3b4-a7b943073744-workload-socket\") pod \"e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45\" (UID: \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\") " pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:17:55.482584 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:55.482457    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1585e0c5-40f9-4bc0-a3b4-a7b943073744-istio-data\") pod \"e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45\" (UID: \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\") " pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:17:55.482584 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:55.482473    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1585e0c5-40f9-4bc0-a3b4-a7b943073744-credential-socket\") pod \"e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45\" (UID: \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\") " pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:17:55.482584 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:55.482562    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1585e0c5-40f9-4bc0-a3b4-a7b943073744-workload-socket\") pod \"e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45\" (UID: \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\") " pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:17:55.482736 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:55.482670    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1585e0c5-40f9-4bc0-a3b4-a7b943073744-workload-certs\") pod \"e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45\" (UID: \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\") " pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:17:55.483118 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:55.483093    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1585e0c5-40f9-4bc0-a3b4-a7b943073744-istiod-ca-cert\") pod \"e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45\" (UID: \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\") " pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:17:55.484560 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:55.484536    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1585e0c5-40f9-4bc0-a3b4-a7b943073744-istio-envoy\") pod \"e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45\" (UID: \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\") " pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:17:55.484680 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:55.484663    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1585e0c5-40f9-4bc0-a3b4-a7b943073744-istio-podinfo\") pod \"e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45\" (UID: \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\") " pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:17:55.489630 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:55.489603    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1585e0c5-40f9-4bc0-a3b4-a7b943073744-istio-token\") pod \"e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45\" (UID: \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\") " pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:17:55.489719 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:55.489673    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2ctz\" (UniqueName: \"kubernetes.io/projected/1585e0c5-40f9-4bc0-a3b4-a7b943073744-kube-api-access-g2ctz\") pod \"e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45\" (UID: \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\") " pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:17:55.602310 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:55.602275    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:17:55.878575 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:55.878547    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"]
Sep 11 04:17:55.879434 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:17:55.879409    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1585e0c5_40f9_4bc0_a3b4_a7b943073744.slice/crio-f3b1193cea58946a665f221c9cc1e342b622c14cfde0ebc8068b2b2cbb562582 WatchSource:0}: Error finding container f3b1193cea58946a665f221c9cc1e342b622c14cfde0ebc8068b2b2cbb562582: Status 404 returned error can't find the container with id f3b1193cea58946a665f221c9cc1e342b622c14cfde0ebc8068b2b2cbb562582
Sep 11 04:17:55.882063 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:55.882031    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:17:55.882143 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:55.882092    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:17:55.882143 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:55.882122    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:17:56.676725 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:56.676691    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45" event={"ID":"1585e0c5-40f9-4bc0-a3b4-a7b943073744","Type":"ContainerStarted","Data":"cfb71db966eef9cb13118940e953bd23bdc09eef81cce81b2678188f39383d17"}
Sep 11 04:17:56.677205 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:56.676753    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45" event={"ID":"1585e0c5-40f9-4bc0-a3b4-a7b943073744","Type":"ContainerStarted","Data":"f3b1193cea58946a665f221c9cc1e342b622c14cfde0ebc8068b2b2cbb562582"}
Sep 11 04:17:56.702331 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:56.702281    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45" podStartSLOduration=1.702263863 podStartE2EDuration="1.702263863s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:17:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:17:56.700891602 +0000 UTC m=+1473.498981331" watchObservedRunningTime="2026-09-11 04:17:56.702263863 +0000 UTC m=+1473.500353590"
Sep 11 04:17:57.602412 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:57.602371    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:17:57.607536 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:57.607514    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:17:57.683003 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:57.682975    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:17:57.683978 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:17:57.683959    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:18:06.000316 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:06.000281    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:18:17.810791 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:17.810618    2558 generic.go:356] "Generic (PLEG): container finished" podID="1585e0c5-40f9-4bc0-a3b4-a7b943073744" containerID="cfb71db966eef9cb13118940e953bd23bdc09eef81cce81b2678188f39383d17" exitCode=0
Sep 11 04:18:17.817673 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:17.817643    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45" event={"ID":"1585e0c5-40f9-4bc0-a3b4-a7b943073744","Type":"ContainerDied","Data":"cfb71db966eef9cb13118940e953bd23bdc09eef81cce81b2678188f39383d17"}
Sep 11 04:18:17.818010 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:17.817994    2558 scope.go:117] "RemoveContainer" containerID="cfb71db966eef9cb13118940e953bd23bdc09eef81cce81b2678188f39383d17"
Sep 11 04:18:17.819041 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:17.819014    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:18:17.819111 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:17.819080    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:18:17.819163 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:17.819108    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:18:18.818572 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:18.818528    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45" event={"ID":"1585e0c5-40f9-4bc0-a3b4-a7b943073744","Type":"ContainerStarted","Data":"75fed075781bb24e7e7e407e1646f28e24ae599f265e3c3c62c9f657aa30716d"}
Sep 11 04:18:19.603405 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:19.603364    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:18:19.603592 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:19.603561    2558 patch_prober.go:28] interesting pod/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 11 04:18:19.603647 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:19.603606    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45" podUID="1585e0c5-40f9-4bc0-a3b4-a7b943073744" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 11 04:18:20.602658 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:20.602622    2558 patch_prober.go:28] interesting pod/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 11 04:18:20.603051 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:20.602687    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45" podUID="1585e0c5-40f9-4bc0-a3b4-a7b943073744" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 11 04:18:21.602968 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:21.602928    2558 patch_prober.go:28] interesting pod/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 11 04:18:21.603462 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:21.602993    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45" podUID="1585e0c5-40f9-4bc0-a3b4-a7b943073744" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 11 04:18:22.603237 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:22.603197    2558 patch_prober.go:28] interesting pod/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 11 04:18:22.603623 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:22.603268    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45" podUID="1585e0c5-40f9-4bc0-a3b4-a7b943073744" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 11 04:18:23.603303 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:23.603264    2558 patch_prober.go:28] interesting pod/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 11 04:18:23.603723 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:23.603323    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45" podUID="1585e0c5-40f9-4bc0-a3b4-a7b943073744" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 11 04:18:23.870107 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:23.870027    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nfssn_c9add74a-5c51-4ccf-9edd-3b90a66b9ef9/ovn-acl-logging/0.log"
Sep 11 04:18:23.872419 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:23.872398    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nfssn_c9add74a-5c51-4ccf-9edd-3b90a66b9ef9/ovn-acl-logging/0.log"
Sep 11 04:18:24.607082 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:24.607047    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:18:24.607556 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:24.607486    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:18:24.608143 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:24.608122    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:18:29.397904 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:29.397873    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:18:42.199764 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:42.199730    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:18:49.178724 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:49.178636    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"]
Sep 11 04:18:49.179184 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:49.178909    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx" podUID="3d10d560-9503-4fce-be96-79cee6ef45e2" containerName="istio-proxy" containerID="cri-o://7ebad129561634fdd30c336494dad625af13ce8298801ef8eba3389e353e6100" gracePeriod=30
Sep 11 04:18:53.401580 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:53.401538    2558 patch_prober.go:28] interesting pod/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 04:18:53.401951 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:53.401611    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx" podUID="3d10d560-9503-4fce-be96-79cee6ef45e2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 04:18:54.297475 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:54.297449    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:18:54.432183 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:54.432161    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:18:54.484198 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:54.484137    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d10d560-9503-4fce-be96-79cee6ef45e2-istio-envoy\") pod \"3d10d560-9503-4fce-be96-79cee6ef45e2\" (UID: \"3d10d560-9503-4fce-be96-79cee6ef45e2\") "
Sep 11 04:18:54.484198 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:54.484176    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d10d560-9503-4fce-be96-79cee6ef45e2-workload-socket\") pod \"3d10d560-9503-4fce-be96-79cee6ef45e2\" (UID: \"3d10d560-9503-4fce-be96-79cee6ef45e2\") "
Sep 11 04:18:54.484362 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:54.484216    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d10d560-9503-4fce-be96-79cee6ef45e2-credential-socket\") pod \"3d10d560-9503-4fce-be96-79cee6ef45e2\" (UID: \"3d10d560-9503-4fce-be96-79cee6ef45e2\") "
Sep 11 04:18:54.484362 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:54.484273    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d10d560-9503-4fce-be96-79cee6ef45e2-istio-token\") pod \"3d10d560-9503-4fce-be96-79cee6ef45e2\" (UID: \"3d10d560-9503-4fce-be96-79cee6ef45e2\") "
Sep 11 04:18:54.484362 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:54.484296    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d10d560-9503-4fce-be96-79cee6ef45e2-istiod-ca-cert\") pod \"3d10d560-9503-4fce-be96-79cee6ef45e2\" (UID: \"3d10d560-9503-4fce-be96-79cee6ef45e2\") "
Sep 11 04:18:54.484362 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:54.484325    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d10d560-9503-4fce-be96-79cee6ef45e2-workload-certs\") pod \"3d10d560-9503-4fce-be96-79cee6ef45e2\" (UID: \"3d10d560-9503-4fce-be96-79cee6ef45e2\") "
Sep 11 04:18:54.484599 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:54.484377    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d10d560-9503-4fce-be96-79cee6ef45e2-istio-data\") pod \"3d10d560-9503-4fce-be96-79cee6ef45e2\" (UID: \"3d10d560-9503-4fce-be96-79cee6ef45e2\") "
Sep 11 04:18:54.484599 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:54.484495    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d10d560-9503-4fce-be96-79cee6ef45e2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3d10d560-9503-4fce-be96-79cee6ef45e2" (UID: "3d10d560-9503-4fce-be96-79cee6ef45e2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:18:54.485087 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:54.484883    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d10d560-9503-4fce-be96-79cee6ef45e2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3d10d560-9503-4fce-be96-79cee6ef45e2" (UID: "3d10d560-9503-4fce-be96-79cee6ef45e2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:18:54.485182 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:54.485110    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d10d560-9503-4fce-be96-79cee6ef45e2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3d10d560-9503-4fce-be96-79cee6ef45e2" (UID: "3d10d560-9503-4fce-be96-79cee6ef45e2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:18:54.485182 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:54.485157    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d10d560-9503-4fce-be96-79cee6ef45e2-istio-data" (OuterVolumeSpecName: "istio-data") pod "3d10d560-9503-4fce-be96-79cee6ef45e2" (UID: "3d10d560-9503-4fce-be96-79cee6ef45e2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:18:54.485307 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:54.485216    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d10d560-9503-4fce-be96-79cee6ef45e2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3d10d560-9503-4fce-be96-79cee6ef45e2" (UID: "3d10d560-9503-4fce-be96-79cee6ef45e2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:18:54.485307 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:54.485264    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d10d560-9503-4fce-be96-79cee6ef45e2-istio-podinfo\") pod \"3d10d560-9503-4fce-be96-79cee6ef45e2\" (UID: \"3d10d560-9503-4fce-be96-79cee6ef45e2\") "
Sep 11 04:18:54.485574 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:54.485540    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c86fd\" (UniqueName: \"kubernetes.io/projected/3d10d560-9503-4fce-be96-79cee6ef45e2-kube-api-access-c86fd\") pod \"3d10d560-9503-4fce-be96-79cee6ef45e2\" (UID: \"3d10d560-9503-4fce-be96-79cee6ef45e2\") "
Sep 11 04:18:54.487764 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:54.486603    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d10d560-9503-4fce-be96-79cee6ef45e2-workload-socket\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:18:54.487764 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:54.486637    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d10d560-9503-4fce-be96-79cee6ef45e2-credential-socket\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:18:54.487764 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:54.486654    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d10d560-9503-4fce-be96-79cee6ef45e2-istiod-ca-cert\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:18:54.487764 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:54.486668    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d10d560-9503-4fce-be96-79cee6ef45e2-workload-certs\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:18:54.487764 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:54.486680    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d10d560-9503-4fce-be96-79cee6ef45e2-istio-data\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:18:54.487764 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:54.487585    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d10d560-9503-4fce-be96-79cee6ef45e2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3d10d560-9503-4fce-be96-79cee6ef45e2" (UID: "3d10d560-9503-4fce-be96-79cee6ef45e2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:18:54.488209 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:54.488183    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d10d560-9503-4fce-be96-79cee6ef45e2-istio-token" (OuterVolumeSpecName: "istio-token") pod "3d10d560-9503-4fce-be96-79cee6ef45e2" (UID: "3d10d560-9503-4fce-be96-79cee6ef45e2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:18:54.494010 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:54.493981    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d10d560-9503-4fce-be96-79cee6ef45e2-kube-api-access-c86fd" (OuterVolumeSpecName: "kube-api-access-c86fd") pod "3d10d560-9503-4fce-be96-79cee6ef45e2" (UID: "3d10d560-9503-4fce-be96-79cee6ef45e2"). InnerVolumeSpecName "kube-api-access-c86fd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:18:54.494010 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:54.493992    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3d10d560-9503-4fce-be96-79cee6ef45e2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3d10d560-9503-4fce-be96-79cee6ef45e2" (UID: "3d10d560-9503-4fce-be96-79cee6ef45e2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 04:18:54.587491 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:54.587455    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d10d560-9503-4fce-be96-79cee6ef45e2-istio-token\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:18:54.587491 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:54.587485    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d10d560-9503-4fce-be96-79cee6ef45e2-istio-podinfo\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:18:54.587491 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:54.587497    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c86fd\" (UniqueName: \"kubernetes.io/projected/3d10d560-9503-4fce-be96-79cee6ef45e2-kube-api-access-c86fd\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:18:54.587722 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:54.587511    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d10d560-9503-4fce-be96-79cee6ef45e2-istio-envoy\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:18:55.042533 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:55.042498    2558 generic.go:356] "Generic (PLEG): container finished" podID="3d10d560-9503-4fce-be96-79cee6ef45e2" containerID="7ebad129561634fdd30c336494dad625af13ce8298801ef8eba3389e353e6100" exitCode=0
Sep 11 04:18:55.042533 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:55.042536    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx" event={"ID":"3d10d560-9503-4fce-be96-79cee6ef45e2","Type":"ContainerDied","Data":"7ebad129561634fdd30c336494dad625af13ce8298801ef8eba3389e353e6100"}
Sep 11 04:18:55.042754 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:55.042561    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"
Sep 11 04:18:55.042754 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:55.042581    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx" event={"ID":"3d10d560-9503-4fce-be96-79cee6ef45e2","Type":"ContainerDied","Data":"0bc65f79a8e8a715bb9f0db54666c62e118ee5a7c5ec9c1465e98466246ae5a5"}
Sep 11 04:18:55.042754 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:55.042604    2558 scope.go:117] "RemoveContainer" containerID="7ebad129561634fdd30c336494dad625af13ce8298801ef8eba3389e353e6100"
Sep 11 04:18:55.052294 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:55.052275    2558 scope.go:117] "RemoveContainer" containerID="146ccfc8ccd6362721eadd5fadc1ac7d986544f1ac80c73dc7e45014bd7e61e8"
Sep 11 04:18:55.060326 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:55.060306    2558 scope.go:117] "RemoveContainer" containerID="7ebad129561634fdd30c336494dad625af13ce8298801ef8eba3389e353e6100"
Sep 11 04:18:55.060598 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:18:55.060578    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ebad129561634fdd30c336494dad625af13ce8298801ef8eba3389e353e6100\": container with ID starting with 7ebad129561634fdd30c336494dad625af13ce8298801ef8eba3389e353e6100 not found: ID does not exist" containerID="7ebad129561634fdd30c336494dad625af13ce8298801ef8eba3389e353e6100"
Sep 11 04:18:55.060644 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:55.060606    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ebad129561634fdd30c336494dad625af13ce8298801ef8eba3389e353e6100"} err="failed to get container status \"7ebad129561634fdd30c336494dad625af13ce8298801ef8eba3389e353e6100\": rpc error: code = NotFound desc = could not find container \"7ebad129561634fdd30c336494dad625af13ce8298801ef8eba3389e353e6100\": container with ID starting with 7ebad129561634fdd30c336494dad625af13ce8298801ef8eba3389e353e6100 not found: ID does not exist"
Sep 11 04:18:55.060644 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:55.060623    2558 scope.go:117] "RemoveContainer" containerID="146ccfc8ccd6362721eadd5fadc1ac7d986544f1ac80c73dc7e45014bd7e61e8"
Sep 11 04:18:55.060864 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:18:55.060845    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"146ccfc8ccd6362721eadd5fadc1ac7d986544f1ac80c73dc7e45014bd7e61e8\": container with ID starting with 146ccfc8ccd6362721eadd5fadc1ac7d986544f1ac80c73dc7e45014bd7e61e8 not found: ID does not exist" containerID="146ccfc8ccd6362721eadd5fadc1ac7d986544f1ac80c73dc7e45014bd7e61e8"
Sep 11 04:18:55.060923 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:55.060875    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"146ccfc8ccd6362721eadd5fadc1ac7d986544f1ac80c73dc7e45014bd7e61e8"} err="failed to get container status \"146ccfc8ccd6362721eadd5fadc1ac7d986544f1ac80c73dc7e45014bd7e61e8\": rpc error: code = NotFound desc = could not find container \"146ccfc8ccd6362721eadd5fadc1ac7d986544f1ac80c73dc7e45014bd7e61e8\": container with ID starting with 146ccfc8ccd6362721eadd5fadc1ac7d986544f1ac80c73dc7e45014bd7e61e8 not found: ID does not exist"
Sep 11 04:18:55.065523 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:55.065494    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"]
Sep 11 04:18:55.069304 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:55.069285    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx"]
Sep 11 04:18:55.810953 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:18:55.810912    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d10d560-9503-4fce-be96-79cee6ef45e2" path="/var/lib/kubelet/pods/3d10d560-9503-4fce-be96-79cee6ef45e2/volumes"
Sep 11 04:19:03.797491 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:03.797457    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:19:12.327570 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:12.327533    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"]
Sep 11 04:19:12.327968 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:12.327808    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45" podUID="1585e0c5-40f9-4bc0-a3b4-a7b943073744" containerName="istio-proxy" containerID="cri-o://75fed075781bb24e7e7e407e1646f28e24ae599f265e3c3c62c9f657aa30716d" gracePeriod=30
Sep 11 04:19:17.099915 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:17.099876    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:19:17.585948 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:17.585926    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:19:17.722600 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:17.722517    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1585e0c5-40f9-4bc0-a3b4-a7b943073744-istio-envoy\") pod \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\" (UID: \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\") "
Sep 11 04:19:17.722600 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:17.722552    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1585e0c5-40f9-4bc0-a3b4-a7b943073744-credential-socket\") pod \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\" (UID: \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\") "
Sep 11 04:19:17.722600 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:17.722571    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1585e0c5-40f9-4bc0-a3b4-a7b943073744-istiod-ca-cert\") pod \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\" (UID: \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\") "
Sep 11 04:19:17.722600 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:17.722589    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1585e0c5-40f9-4bc0-a3b4-a7b943073744-istio-data\") pod \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\" (UID: \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\") "
Sep 11 04:19:17.722935 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:17.722622    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1585e0c5-40f9-4bc0-a3b4-a7b943073744-workload-certs\") pod \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\" (UID: \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\") "
Sep 11 04:19:17.722935 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:17.722655    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2ctz\" (UniqueName: \"kubernetes.io/projected/1585e0c5-40f9-4bc0-a3b4-a7b943073744-kube-api-access-g2ctz\") pod \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\" (UID: \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\") "
Sep 11 04:19:17.722935 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:17.722701    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1585e0c5-40f9-4bc0-a3b4-a7b943073744-workload-socket\") pod \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\" (UID: \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\") "
Sep 11 04:19:17.722935 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:17.722741    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1585e0c5-40f9-4bc0-a3b4-a7b943073744-istio-podinfo\") pod \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\" (UID: \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\") "
Sep 11 04:19:17.722935 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:17.722794    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1585e0c5-40f9-4bc0-a3b4-a7b943073744-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1585e0c5-40f9-4bc0-a3b4-a7b943073744" (UID: "1585e0c5-40f9-4bc0-a3b4-a7b943073744"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:19:17.722935 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:17.722814    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1585e0c5-40f9-4bc0-a3b4-a7b943073744-istio-token\") pod \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\" (UID: \"1585e0c5-40f9-4bc0-a3b4-a7b943073744\") "
Sep 11 04:19:17.723237 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:17.722946    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1585e0c5-40f9-4bc0-a3b4-a7b943073744-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1585e0c5-40f9-4bc0-a3b4-a7b943073744" (UID: "1585e0c5-40f9-4bc0-a3b4-a7b943073744"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:19:17.723237 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:17.722972    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1585e0c5-40f9-4bc0-a3b4-a7b943073744-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1585e0c5-40f9-4bc0-a3b4-a7b943073744" (UID: "1585e0c5-40f9-4bc0-a3b4-a7b943073744"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:19:17.723237 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:17.723025    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1585e0c5-40f9-4bc0-a3b4-a7b943073744-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1585e0c5-40f9-4bc0-a3b4-a7b943073744" (UID: "1585e0c5-40f9-4bc0-a3b4-a7b943073744"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:19:17.723237 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:17.723174    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1585e0c5-40f9-4bc0-a3b4-a7b943073744-credential-socket\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:19:17.723237 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:17.723191    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1585e0c5-40f9-4bc0-a3b4-a7b943073744-istiod-ca-cert\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:19:17.723237 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:17.723205    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1585e0c5-40f9-4bc0-a3b4-a7b943073744-workload-certs\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:19:17.723237 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:17.723217    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1585e0c5-40f9-4bc0-a3b4-a7b943073744-workload-socket\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:19:17.723637 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:17.723245    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1585e0c5-40f9-4bc0-a3b4-a7b943073744-istio-data" (OuterVolumeSpecName: "istio-data") pod "1585e0c5-40f9-4bc0-a3b4-a7b943073744" (UID: "1585e0c5-40f9-4bc0-a3b4-a7b943073744"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:19:17.724833 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:17.724803    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1585e0c5-40f9-4bc0-a3b4-a7b943073744-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1585e0c5-40f9-4bc0-a3b4-a7b943073744" (UID: "1585e0c5-40f9-4bc0-a3b4-a7b943073744"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 04:19:17.724951 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:17.724853    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1585e0c5-40f9-4bc0-a3b4-a7b943073744-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1585e0c5-40f9-4bc0-a3b4-a7b943073744" (UID: "1585e0c5-40f9-4bc0-a3b4-a7b943073744"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:19:17.725173 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:17.725156    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1585e0c5-40f9-4bc0-a3b4-a7b943073744-istio-token" (OuterVolumeSpecName: "istio-token") pod "1585e0c5-40f9-4bc0-a3b4-a7b943073744" (UID: "1585e0c5-40f9-4bc0-a3b4-a7b943073744"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:19:17.725221 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:17.725200    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1585e0c5-40f9-4bc0-a3b4-a7b943073744-kube-api-access-g2ctz" (OuterVolumeSpecName: "kube-api-access-g2ctz") pod "1585e0c5-40f9-4bc0-a3b4-a7b943073744" (UID: "1585e0c5-40f9-4bc0-a3b4-a7b943073744"). InnerVolumeSpecName "kube-api-access-g2ctz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:19:17.824518 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:17.824486    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1585e0c5-40f9-4bc0-a3b4-a7b943073744-istio-envoy\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:19:17.824518 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:17.824520    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1585e0c5-40f9-4bc0-a3b4-a7b943073744-istio-data\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:19:17.824680 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:17.824529    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2ctz\" (UniqueName: \"kubernetes.io/projected/1585e0c5-40f9-4bc0-a3b4-a7b943073744-kube-api-access-g2ctz\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:19:17.824680 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:17.824537    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1585e0c5-40f9-4bc0-a3b4-a7b943073744-istio-podinfo\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:19:17.824680 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:17.824545    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1585e0c5-40f9-4bc0-a3b4-a7b943073744-istio-token\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:19:18.167690 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:18.167658    2558 generic.go:356] "Generic (PLEG): container finished" podID="1585e0c5-40f9-4bc0-a3b4-a7b943073744" containerID="75fed075781bb24e7e7e407e1646f28e24ae599f265e3c3c62c9f657aa30716d" exitCode=0
Sep 11 04:19:18.168156 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:18.167706    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"
Sep 11 04:19:18.168156 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:18.167744    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45" event={"ID":"1585e0c5-40f9-4bc0-a3b4-a7b943073744","Type":"ContainerDied","Data":"75fed075781bb24e7e7e407e1646f28e24ae599f265e3c3c62c9f657aa30716d"}
Sep 11 04:19:18.168156 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:18.167813    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45" event={"ID":"1585e0c5-40f9-4bc0-a3b4-a7b943073744","Type":"ContainerDied","Data":"f3b1193cea58946a665f221c9cc1e342b622c14cfde0ebc8068b2b2cbb562582"}
Sep 11 04:19:18.168156 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:18.167850    2558 scope.go:117] "RemoveContainer" containerID="75fed075781bb24e7e7e407e1646f28e24ae599f265e3c3c62c9f657aa30716d"
Sep 11 04:19:18.178752 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:18.178733    2558 scope.go:117] "RemoveContainer" containerID="cfb71db966eef9cb13118940e953bd23bdc09eef81cce81b2678188f39383d17"
Sep 11 04:19:18.186841 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:18.186804    2558 scope.go:117] "RemoveContainer" containerID="75fed075781bb24e7e7e407e1646f28e24ae599f265e3c3c62c9f657aa30716d"
Sep 11 04:19:18.187077 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:19:18.187058    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75fed075781bb24e7e7e407e1646f28e24ae599f265e3c3c62c9f657aa30716d\": container with ID starting with 75fed075781bb24e7e7e407e1646f28e24ae599f265e3c3c62c9f657aa30716d not found: ID does not exist" containerID="75fed075781bb24e7e7e407e1646f28e24ae599f265e3c3c62c9f657aa30716d"
Sep 11 04:19:18.187163 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:18.187084    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75fed075781bb24e7e7e407e1646f28e24ae599f265e3c3c62c9f657aa30716d"} err="failed to get container status \"75fed075781bb24e7e7e407e1646f28e24ae599f265e3c3c62c9f657aa30716d\": rpc error: code = NotFound desc = could not find container \"75fed075781bb24e7e7e407e1646f28e24ae599f265e3c3c62c9f657aa30716d\": container with ID starting with 75fed075781bb24e7e7e407e1646f28e24ae599f265e3c3c62c9f657aa30716d not found: ID does not exist"
Sep 11 04:19:18.187163 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:18.187102    2558 scope.go:117] "RemoveContainer" containerID="cfb71db966eef9cb13118940e953bd23bdc09eef81cce81b2678188f39383d17"
Sep 11 04:19:18.187406 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:19:18.187365    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfb71db966eef9cb13118940e953bd23bdc09eef81cce81b2678188f39383d17\": container with ID starting with cfb71db966eef9cb13118940e953bd23bdc09eef81cce81b2678188f39383d17 not found: ID does not exist" containerID="cfb71db966eef9cb13118940e953bd23bdc09eef81cce81b2678188f39383d17"
Sep 11 04:19:18.187502 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:18.187408    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfb71db966eef9cb13118940e953bd23bdc09eef81cce81b2678188f39383d17"} err="failed to get container status \"cfb71db966eef9cb13118940e953bd23bdc09eef81cce81b2678188f39383d17\": rpc error: code = NotFound desc = could not find container \"cfb71db966eef9cb13118940e953bd23bdc09eef81cce81b2678188f39383d17\": container with ID starting with cfb71db966eef9cb13118940e953bd23bdc09eef81cce81b2678188f39383d17 not found: ID does not exist"
Sep 11 04:19:18.189901 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:18.189881    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"]
Sep 11 04:19:18.192285 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:18.192266    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45"]
Sep 11 04:19:19.810460 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:19.810428    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1585e0c5-40f9-4bc0-a3b4-a7b943073744" path="/var/lib/kubelet/pods/1585e0c5-40f9-4bc0-a3b4-a7b943073744/volumes"
Sep 11 04:19:23.747316 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:23.747279    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf"]
Sep 11 04:19:23.747742 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:23.747581    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf" podUID="f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e" containerName="maas-api" containerID="cri-o://78d12958fa4ad90fe910fbbe438816442f56c7e04c7c048691216314f1579e5c" gracePeriod=30
Sep 11 04:19:23.996375 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:23.996352    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf"
Sep 11 04:19:24.080819 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:24.080797    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e-openshift-service-ca\") pod \"f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e\" (UID: \"f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e\") "
Sep 11 04:19:24.080993 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:24.080866    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e-maas-api-tls\") pod \"f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e\" (UID: \"f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e\") "
Sep 11 04:19:24.080993 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:24.080889    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e-metrics-certs\") pod \"f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e\" (UID: \"f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e\") "
Sep 11 04:19:24.080993 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:24.080959    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vvgk\" (UniqueName: \"kubernetes.io/projected/f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e-kube-api-access-6vvgk\") pod \"f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e\" (UID: \"f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e\") "
Sep 11 04:19:24.081226 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:24.081196    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e" (UID: "f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:19:24.082843 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:24.082812    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e" (UID: "f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:19:24.082935 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:24.082895    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e-kube-api-access-6vvgk" (OuterVolumeSpecName: "kube-api-access-6vvgk") pod "f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e" (UID: "f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e"). InnerVolumeSpecName "kube-api-access-6vvgk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:19:24.083025 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:24.083002    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e" (UID: "f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:19:24.181886 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:24.181851    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vvgk\" (UniqueName: \"kubernetes.io/projected/f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e-kube-api-access-6vvgk\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:19:24.181886 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:24.181882    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e-openshift-service-ca\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:19:24.181886 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:24.181893    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e-maas-api-tls\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:19:24.182150 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:24.181902    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e-metrics-certs\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:19:24.202252 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:24.202215    2558 generic.go:356] "Generic (PLEG): container finished" podID="f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e" containerID="78d12958fa4ad90fe910fbbe438816442f56c7e04c7c048691216314f1579e5c" exitCode=0
Sep 11 04:19:24.202378 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:24.202255    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf" event={"ID":"f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e","Type":"ContainerDied","Data":"78d12958fa4ad90fe910fbbe438816442f56c7e04c7c048691216314f1579e5c"}
Sep 11 04:19:24.202378 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:24.202265    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf"
Sep 11 04:19:24.202378 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:24.202303    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf" event={"ID":"f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e","Type":"ContainerDied","Data":"839103be095cd374343518a4da755fee0e85b01d36bb7c2eb91cc45c878bfa62"}
Sep 11 04:19:24.202378 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:24.202332    2558 scope.go:117] "RemoveContainer" containerID="78d12958fa4ad90fe910fbbe438816442f56c7e04c7c048691216314f1579e5c"
Sep 11 04:19:24.211605 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:24.211589    2558 scope.go:117] "RemoveContainer" containerID="78d12958fa4ad90fe910fbbe438816442f56c7e04c7c048691216314f1579e5c"
Sep 11 04:19:24.211866 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:19:24.211845    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78d12958fa4ad90fe910fbbe438816442f56c7e04c7c048691216314f1579e5c\": container with ID starting with 78d12958fa4ad90fe910fbbe438816442f56c7e04c7c048691216314f1579e5c not found: ID does not exist" containerID="78d12958fa4ad90fe910fbbe438816442f56c7e04c7c048691216314f1579e5c"
Sep 11 04:19:24.211939 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:24.211878    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78d12958fa4ad90fe910fbbe438816442f56c7e04c7c048691216314f1579e5c"} err="failed to get container status \"78d12958fa4ad90fe910fbbe438816442f56c7e04c7c048691216314f1579e5c\": rpc error: code = NotFound desc = could not find container \"78d12958fa4ad90fe910fbbe438816442f56c7e04c7c048691216314f1579e5c\": container with ID starting with 78d12958fa4ad90fe910fbbe438816442f56c7e04c7c048691216314f1579e5c not found: ID does not exist"
Sep 11 04:19:24.223702 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:24.223676    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf"]
Sep 11 04:19:24.225952 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:24.225934    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-772e41-85c5cf86b9-m9jvf"]
Sep 11 04:19:25.810094 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:25.810059    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e" path="/var/lib/kubelet/pods/f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e/volumes"
Sep 11 04:19:30.308379 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:30.308347    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:19:30.337000 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:30.336971    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"]
Sep 11 04:19:30.337189 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:30.337167    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4" podUID="037e1650-4608-4114-89bc-cb855bb8e67a" containerName="istio-proxy" containerID="cri-o://f0abc97e528c25580a59f73918778efbede5e8ca833f58913cec86f8bc512b7c" gracePeriod=30
Sep 11 04:19:35.582337 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:35.582311    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:19:35.685377 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:35.685300    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/037e1650-4608-4114-89bc-cb855bb8e67a-istiod-ca-cert\") pod \"037e1650-4608-4114-89bc-cb855bb8e67a\" (UID: \"037e1650-4608-4114-89bc-cb855bb8e67a\") "
Sep 11 04:19:35.685377 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:35.685361    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/037e1650-4608-4114-89bc-cb855bb8e67a-istio-data\") pod \"037e1650-4608-4114-89bc-cb855bb8e67a\" (UID: \"037e1650-4608-4114-89bc-cb855bb8e67a\") "
Sep 11 04:19:35.685610 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:35.685404    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/037e1650-4608-4114-89bc-cb855bb8e67a-workload-socket\") pod \"037e1650-4608-4114-89bc-cb855bb8e67a\" (UID: \"037e1650-4608-4114-89bc-cb855bb8e67a\") "
Sep 11 04:19:35.685610 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:35.685458    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/037e1650-4608-4114-89bc-cb855bb8e67a-workload-certs\") pod \"037e1650-4608-4114-89bc-cb855bb8e67a\" (UID: \"037e1650-4608-4114-89bc-cb855bb8e67a\") "
Sep 11 04:19:35.685610 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:35.685476    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7ls4\" (UniqueName: \"kubernetes.io/projected/037e1650-4608-4114-89bc-cb855bb8e67a-kube-api-access-d7ls4\") pod \"037e1650-4608-4114-89bc-cb855bb8e67a\" (UID: \"037e1650-4608-4114-89bc-cb855bb8e67a\") "
Sep 11 04:19:35.685610 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:35.685504    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/037e1650-4608-4114-89bc-cb855bb8e67a-credential-socket\") pod \"037e1650-4608-4114-89bc-cb855bb8e67a\" (UID: \"037e1650-4608-4114-89bc-cb855bb8e67a\") "
Sep 11 04:19:35.685610 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:35.685522    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/037e1650-4608-4114-89bc-cb855bb8e67a-istio-podinfo\") pod \"037e1650-4608-4114-89bc-cb855bb8e67a\" (UID: \"037e1650-4608-4114-89bc-cb855bb8e67a\") "
Sep 11 04:19:35.685610 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:35.685556    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/037e1650-4608-4114-89bc-cb855bb8e67a-istio-token\") pod \"037e1650-4608-4114-89bc-cb855bb8e67a\" (UID: \"037e1650-4608-4114-89bc-cb855bb8e67a\") "
Sep 11 04:19:35.685610 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:35.685593    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/037e1650-4608-4114-89bc-cb855bb8e67a-istio-envoy\") pod \"037e1650-4608-4114-89bc-cb855bb8e67a\" (UID: \"037e1650-4608-4114-89bc-cb855bb8e67a\") "
Sep 11 04:19:35.685967 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:35.685685    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/037e1650-4608-4114-89bc-cb855bb8e67a-istio-data" (OuterVolumeSpecName: "istio-data") pod "037e1650-4608-4114-89bc-cb855bb8e67a" (UID: "037e1650-4608-4114-89bc-cb855bb8e67a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:19:35.685967 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:35.685811    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/037e1650-4608-4114-89bc-cb855bb8e67a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "037e1650-4608-4114-89bc-cb855bb8e67a" (UID: "037e1650-4608-4114-89bc-cb855bb8e67a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:19:35.685967 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:35.685826    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/037e1650-4608-4114-89bc-cb855bb8e67a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "037e1650-4608-4114-89bc-cb855bb8e67a" (UID: "037e1650-4608-4114-89bc-cb855bb8e67a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:19:35.685967 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:35.685720    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/037e1650-4608-4114-89bc-cb855bb8e67a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "037e1650-4608-4114-89bc-cb855bb8e67a" (UID: "037e1650-4608-4114-89bc-cb855bb8e67a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:19:35.686158 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:35.686008    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/037e1650-4608-4114-89bc-cb855bb8e67a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "037e1650-4608-4114-89bc-cb855bb8e67a" (UID: "037e1650-4608-4114-89bc-cb855bb8e67a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:19:35.686158 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:35.686028    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/037e1650-4608-4114-89bc-cb855bb8e67a-istio-data\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:19:35.686158 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:35.686051    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/037e1650-4608-4114-89bc-cb855bb8e67a-workload-socket\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:19:35.686158 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:35.686065    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/037e1650-4608-4114-89bc-cb855bb8e67a-credential-socket\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:19:35.686158 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:35.686079    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/037e1650-4608-4114-89bc-cb855bb8e67a-istiod-ca-cert\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:19:35.687823 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:35.687786    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/037e1650-4608-4114-89bc-cb855bb8e67a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "037e1650-4608-4114-89bc-cb855bb8e67a" (UID: "037e1650-4608-4114-89bc-cb855bb8e67a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 04:19:35.687939 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:35.687885    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/037e1650-4608-4114-89bc-cb855bb8e67a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "037e1650-4608-4114-89bc-cb855bb8e67a" (UID: "037e1650-4608-4114-89bc-cb855bb8e67a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:19:35.687984 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:35.687938    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/037e1650-4608-4114-89bc-cb855bb8e67a-kube-api-access-d7ls4" (OuterVolumeSpecName: "kube-api-access-d7ls4") pod "037e1650-4608-4114-89bc-cb855bb8e67a" (UID: "037e1650-4608-4114-89bc-cb855bb8e67a"). InnerVolumeSpecName "kube-api-access-d7ls4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:19:35.687984 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:35.687953    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/037e1650-4608-4114-89bc-cb855bb8e67a-istio-token" (OuterVolumeSpecName: "istio-token") pod "037e1650-4608-4114-89bc-cb855bb8e67a" (UID: "037e1650-4608-4114-89bc-cb855bb8e67a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:19:35.786823 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:35.786788    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/037e1650-4608-4114-89bc-cb855bb8e67a-workload-certs\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:19:35.786823 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:35.786817    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7ls4\" (UniqueName: \"kubernetes.io/projected/037e1650-4608-4114-89bc-cb855bb8e67a-kube-api-access-d7ls4\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:19:35.786823 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:35.786827    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/037e1650-4608-4114-89bc-cb855bb8e67a-istio-podinfo\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:19:35.787039 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:35.786836    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/037e1650-4608-4114-89bc-cb855bb8e67a-istio-token\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:19:35.787039 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:35.786844    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/037e1650-4608-4114-89bc-cb855bb8e67a-istio-envoy\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:19:36.265287 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:36.265253    2558 generic.go:356] "Generic (PLEG): container finished" podID="037e1650-4608-4114-89bc-cb855bb8e67a" containerID="f0abc97e528c25580a59f73918778efbede5e8ca833f58913cec86f8bc512b7c" exitCode=0
Sep 11 04:19:36.265474 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:36.265296    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"
Sep 11 04:19:36.265474 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:36.265316    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4" event={"ID":"037e1650-4608-4114-89bc-cb855bb8e67a","Type":"ContainerDied","Data":"f0abc97e528c25580a59f73918778efbede5e8ca833f58913cec86f8bc512b7c"}
Sep 11 04:19:36.265474 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:36.265364    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4" event={"ID":"037e1650-4608-4114-89bc-cb855bb8e67a","Type":"ContainerDied","Data":"ad44744f7fe08de389c6a342fcfb7b4b5a13f45bbf598a6745c6832786814613"}
Sep 11 04:19:36.265474 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:36.265419    2558 scope.go:117] "RemoveContainer" containerID="f0abc97e528c25580a59f73918778efbede5e8ca833f58913cec86f8bc512b7c"
Sep 11 04:19:36.274479 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:36.274368    2558 scope.go:117] "RemoveContainer" containerID="952a206a149b7630a87cbf12c7c8e3f5cc124b402cc1e0874d08afb81103c015"
Sep 11 04:19:36.282860 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:36.282841    2558 scope.go:117] "RemoveContainer" containerID="f0abc97e528c25580a59f73918778efbede5e8ca833f58913cec86f8bc512b7c"
Sep 11 04:19:36.283189 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:19:36.283166    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0abc97e528c25580a59f73918778efbede5e8ca833f58913cec86f8bc512b7c\": container with ID starting with f0abc97e528c25580a59f73918778efbede5e8ca833f58913cec86f8bc512b7c not found: ID does not exist" containerID="f0abc97e528c25580a59f73918778efbede5e8ca833f58913cec86f8bc512b7c"
Sep 11 04:19:36.283260 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:36.283198    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0abc97e528c25580a59f73918778efbede5e8ca833f58913cec86f8bc512b7c"} err="failed to get container status \"f0abc97e528c25580a59f73918778efbede5e8ca833f58913cec86f8bc512b7c\": rpc error: code = NotFound desc = could not find container \"f0abc97e528c25580a59f73918778efbede5e8ca833f58913cec86f8bc512b7c\": container with ID starting with f0abc97e528c25580a59f73918778efbede5e8ca833f58913cec86f8bc512b7c not found: ID does not exist"
Sep 11 04:19:36.283260 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:36.283220    2558 scope.go:117] "RemoveContainer" containerID="952a206a149b7630a87cbf12c7c8e3f5cc124b402cc1e0874d08afb81103c015"
Sep 11 04:19:36.283512 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:19:36.283487    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"952a206a149b7630a87cbf12c7c8e3f5cc124b402cc1e0874d08afb81103c015\": container with ID starting with 952a206a149b7630a87cbf12c7c8e3f5cc124b402cc1e0874d08afb81103c015 not found: ID does not exist" containerID="952a206a149b7630a87cbf12c7c8e3f5cc124b402cc1e0874d08afb81103c015"
Sep 11 04:19:36.283590 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:36.283517    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"952a206a149b7630a87cbf12c7c8e3f5cc124b402cc1e0874d08afb81103c015"} err="failed to get container status \"952a206a149b7630a87cbf12c7c8e3f5cc124b402cc1e0874d08afb81103c015\": rpc error: code = NotFound desc = could not find container \"952a206a149b7630a87cbf12c7c8e3f5cc124b402cc1e0874d08afb81103c015\": container with ID starting with 952a206a149b7630a87cbf12c7c8e3f5cc124b402cc1e0874d08afb81103c015 not found: ID does not exist"
Sep 11 04:19:36.285772 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:36.285747    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"]
Sep 11 04:19:36.291337 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:36.291313    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4"]
Sep 11 04:19:37.813324 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:37.813289    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="037e1650-4608-4114-89bc-cb855bb8e67a" path="/var/lib/kubelet/pods/037e1650-4608-4114-89bc-cb855bb8e67a/volumes"
Sep 11 04:19:38.834367 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:38.834326    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"]
Sep 11 04:19:38.834871 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:38.834852    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1585e0c5-40f9-4bc0-a3b4-a7b943073744" containerName="istio-proxy"
Sep 11 04:19:38.834943 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:38.834875    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1585e0c5-40f9-4bc0-a3b4-a7b943073744" containerName="istio-proxy"
Sep 11 04:19:38.834943 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:38.834904    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1585e0c5-40f9-4bc0-a3b4-a7b943073744" containerName="istio-proxy"
Sep 11 04:19:38.834943 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:38.834913    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1585e0c5-40f9-4bc0-a3b4-a7b943073744" containerName="istio-proxy"
Sep 11 04:19:38.834943 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:38.834925    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d10d560-9503-4fce-be96-79cee6ef45e2" containerName="istio-proxy"
Sep 11 04:19:38.834943 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:38.834932    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d10d560-9503-4fce-be96-79cee6ef45e2" containerName="istio-proxy"
Sep 11 04:19:38.834943 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:38.834943    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="037e1650-4608-4114-89bc-cb855bb8e67a" containerName="istio-proxy"
Sep 11 04:19:38.835239 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:38.834951    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="037e1650-4608-4114-89bc-cb855bb8e67a" containerName="istio-proxy"
Sep 11 04:19:38.835239 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:38.834961    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e" containerName="maas-api"
Sep 11 04:19:38.835239 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:38.834968    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e" containerName="maas-api"
Sep 11 04:19:38.835239 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:38.834985    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="037e1650-4608-4114-89bc-cb855bb8e67a" containerName="istio-proxy"
Sep 11 04:19:38.835239 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:38.834993    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="037e1650-4608-4114-89bc-cb855bb8e67a" containerName="istio-proxy"
Sep 11 04:19:38.835239 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:38.835085    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3d1e31a-21c7-4d55-bc80-1a3274f0cd4e" containerName="maas-api"
Sep 11 04:19:38.835239 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:38.835094    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="037e1650-4608-4114-89bc-cb855bb8e67a" containerName="istio-proxy"
Sep 11 04:19:38.835239 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:38.835104    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1585e0c5-40f9-4bc0-a3b4-a7b943073744" containerName="istio-proxy"
Sep 11 04:19:38.835239 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:38.835113    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d10d560-9503-4fce-be96-79cee6ef45e2" containerName="istio-proxy"
Sep 11 04:19:38.835239 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:38.835123    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1585e0c5-40f9-4bc0-a3b4-a7b943073744" containerName="istio-proxy"
Sep 11 04:19:38.839770 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:38.839749    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:19:38.847123 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:38.847102    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-fdc690-openshift-default-dockercfg-7c7mz\""
Sep 11 04:19:38.867018 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:38.866988    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"]
Sep 11 04:19:38.921452 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:38.919249    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/387ef80d-efa3-4e99-9183-0d4deb7f4239-istiod-ca-cert\") pod \"e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb\" (UID: \"387ef80d-efa3-4e99-9183-0d4deb7f4239\") " pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:19:38.921452 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:38.919305    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/387ef80d-efa3-4e99-9183-0d4deb7f4239-workload-socket\") pod \"e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb\" (UID: \"387ef80d-efa3-4e99-9183-0d4deb7f4239\") " pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:19:38.921452 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:38.919326    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/387ef80d-efa3-4e99-9183-0d4deb7f4239-istio-token\") pod \"e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb\" (UID: \"387ef80d-efa3-4e99-9183-0d4deb7f4239\") " pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:19:38.921452 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:38.919358    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/387ef80d-efa3-4e99-9183-0d4deb7f4239-credential-socket\") pod \"e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb\" (UID: \"387ef80d-efa3-4e99-9183-0d4deb7f4239\") " pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:19:38.921452 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:38.919466    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/387ef80d-efa3-4e99-9183-0d4deb7f4239-istio-envoy\") pod \"e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb\" (UID: \"387ef80d-efa3-4e99-9183-0d4deb7f4239\") " pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:19:38.921452 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:38.919542    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/387ef80d-efa3-4e99-9183-0d4deb7f4239-workload-certs\") pod \"e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb\" (UID: \"387ef80d-efa3-4e99-9183-0d4deb7f4239\") " pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:19:38.921452 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:38.919596    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fgvw\" (UniqueName: \"kubernetes.io/projected/387ef80d-efa3-4e99-9183-0d4deb7f4239-kube-api-access-4fgvw\") pod \"e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb\" (UID: \"387ef80d-efa3-4e99-9183-0d4deb7f4239\") " pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:19:38.921452 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:38.919622    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/387ef80d-efa3-4e99-9183-0d4deb7f4239-istio-data\") pod \"e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb\" (UID: \"387ef80d-efa3-4e99-9183-0d4deb7f4239\") " pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:19:38.921452 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:38.919666    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/387ef80d-efa3-4e99-9183-0d4deb7f4239-istio-podinfo\") pod \"e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb\" (UID: \"387ef80d-efa3-4e99-9183-0d4deb7f4239\") " pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:19:39.020968 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:39.020929    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/387ef80d-efa3-4e99-9183-0d4deb7f4239-workload-certs\") pod \"e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb\" (UID: \"387ef80d-efa3-4e99-9183-0d4deb7f4239\") " pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:19:39.021163 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:39.020979    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fgvw\" (UniqueName: \"kubernetes.io/projected/387ef80d-efa3-4e99-9183-0d4deb7f4239-kube-api-access-4fgvw\") pod \"e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb\" (UID: \"387ef80d-efa3-4e99-9183-0d4deb7f4239\") " pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:19:39.021163 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:39.021000    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/387ef80d-efa3-4e99-9183-0d4deb7f4239-istio-data\") pod \"e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb\" (UID: \"387ef80d-efa3-4e99-9183-0d4deb7f4239\") " pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:19:39.021283 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:39.021178    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/387ef80d-efa3-4e99-9183-0d4deb7f4239-istio-podinfo\") pod \"e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb\" (UID: \"387ef80d-efa3-4e99-9183-0d4deb7f4239\") " pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:19:39.021283 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:39.021260    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/387ef80d-efa3-4e99-9183-0d4deb7f4239-istiod-ca-cert\") pod \"e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb\" (UID: \"387ef80d-efa3-4e99-9183-0d4deb7f4239\") " pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:19:39.021415 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:39.021297    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/387ef80d-efa3-4e99-9183-0d4deb7f4239-workload-socket\") pod \"e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb\" (UID: \"387ef80d-efa3-4e99-9183-0d4deb7f4239\") " pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:19:39.021415 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:39.021324    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/387ef80d-efa3-4e99-9183-0d4deb7f4239-istio-token\") pod \"e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb\" (UID: \"387ef80d-efa3-4e99-9183-0d4deb7f4239\") " pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:19:39.021415 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:39.021362    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/387ef80d-efa3-4e99-9183-0d4deb7f4239-istio-data\") pod \"e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb\" (UID: \"387ef80d-efa3-4e99-9183-0d4deb7f4239\") " pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:19:39.021415 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:39.021380    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/387ef80d-efa3-4e99-9183-0d4deb7f4239-workload-certs\") pod \"e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb\" (UID: \"387ef80d-efa3-4e99-9183-0d4deb7f4239\") " pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:19:39.021633 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:39.021441    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/387ef80d-efa3-4e99-9183-0d4deb7f4239-credential-socket\") pod \"e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb\" (UID: \"387ef80d-efa3-4e99-9183-0d4deb7f4239\") " pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:19:39.021633 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:39.021507    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/387ef80d-efa3-4e99-9183-0d4deb7f4239-istio-envoy\") pod \"e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb\" (UID: \"387ef80d-efa3-4e99-9183-0d4deb7f4239\") " pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:19:39.021741 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:39.021627    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/387ef80d-efa3-4e99-9183-0d4deb7f4239-workload-socket\") pod \"e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb\" (UID: \"387ef80d-efa3-4e99-9183-0d4deb7f4239\") " pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:19:39.021798 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:39.021765    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/387ef80d-efa3-4e99-9183-0d4deb7f4239-credential-socket\") pod \"e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb\" (UID: \"387ef80d-efa3-4e99-9183-0d4deb7f4239\") " pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:19:39.021984 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:39.021967    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/387ef80d-efa3-4e99-9183-0d4deb7f4239-istiod-ca-cert\") pod \"e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb\" (UID: \"387ef80d-efa3-4e99-9183-0d4deb7f4239\") " pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:19:39.023983 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:39.023951    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/387ef80d-efa3-4e99-9183-0d4deb7f4239-istio-envoy\") pod \"e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb\" (UID: \"387ef80d-efa3-4e99-9183-0d4deb7f4239\") " pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:19:39.024137 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:39.024122    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/387ef80d-efa3-4e99-9183-0d4deb7f4239-istio-podinfo\") pod \"e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb\" (UID: \"387ef80d-efa3-4e99-9183-0d4deb7f4239\") " pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:19:39.029520 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:39.029497    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/387ef80d-efa3-4e99-9183-0d4deb7f4239-istio-token\") pod \"e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb\" (UID: \"387ef80d-efa3-4e99-9183-0d4deb7f4239\") " pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:19:39.029651 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:39.029633    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fgvw\" (UniqueName: \"kubernetes.io/projected/387ef80d-efa3-4e99-9183-0d4deb7f4239-kube-api-access-4fgvw\") pod \"e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb\" (UID: \"387ef80d-efa3-4e99-9183-0d4deb7f4239\") " pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:19:39.149430 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:39.149316    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:19:39.428487 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:39.428454    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"]
Sep 11 04:19:39.429868 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:19:39.429835    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod387ef80d_efa3_4e99_9183_0d4deb7f4239.slice/crio-915fb0f6244d658bf8fb3eb4d0fb1e80fb55aae0c788d2317e21ddc5f74dffe9 WatchSource:0}: Error finding container 915fb0f6244d658bf8fb3eb4d0fb1e80fb55aae0c788d2317e21ddc5f74dffe9: Status 404 returned error can't find the container with id 915fb0f6244d658bf8fb3eb4d0fb1e80fb55aae0c788d2317e21ddc5f74dffe9
Sep 11 04:19:39.432019 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:39.431985    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:19:39.432130 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:39.432049    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:19:39.432130 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:39.432076    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:19:40.294904 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:40.294863    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb" event={"ID":"387ef80d-efa3-4e99-9183-0d4deb7f4239","Type":"ContainerStarted","Data":"e01b81ee7e0a916bc3b88df8a5d79460f5f1f960caa4a5d7d552b614f2bf28be"}
Sep 11 04:19:40.295270 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:40.294926    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb" event={"ID":"387ef80d-efa3-4e99-9183-0d4deb7f4239","Type":"ContainerStarted","Data":"915fb0f6244d658bf8fb3eb4d0fb1e80fb55aae0c788d2317e21ddc5f74dffe9"}
Sep 11 04:19:40.316928 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:40.316882    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb" podStartSLOduration=2.316866913 podStartE2EDuration="2.316866913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:19:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:19:40.313581133 +0000 UTC m=+1577.111670859" watchObservedRunningTime="2026-09-11 04:19:40.316866913 +0000 UTC m=+1577.114956639"
Sep 11 04:19:41.150186 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:41.150154    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:19:41.155498 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:41.155467    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:19:41.301286 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:41.301253    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:19:41.302127 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:41.302101    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:19:45.709099 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:45.709053    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:19:47.820129 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:47.820096    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"]
Sep 11 04:19:47.820616 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:47.820282    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf" podUID="34c07f21-75ae-4f89-a262-aebdeacbb3e0" containerName="istio-proxy" containerID="cri-o://84bb75dcd319ef5233c11c61fa40551bc587cb30f0ed5a3683a0f1289fa55514" gracePeriod=30
Sep 11 04:19:53.102342 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.102269    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:19:53.261675 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.261637    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6vrq\" (UniqueName: \"kubernetes.io/projected/34c07f21-75ae-4f89-a262-aebdeacbb3e0-kube-api-access-n6vrq\") pod \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\" (UID: \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\") "
Sep 11 04:19:53.261865 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.261705    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34c07f21-75ae-4f89-a262-aebdeacbb3e0-workload-socket\") pod \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\" (UID: \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\") "
Sep 11 04:19:53.261865 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.261724    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34c07f21-75ae-4f89-a262-aebdeacbb3e0-workload-certs\") pod \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\" (UID: \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\") "
Sep 11 04:19:53.261865 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.261751    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34c07f21-75ae-4f89-a262-aebdeacbb3e0-credential-socket\") pod \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\" (UID: \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\") "
Sep 11 04:19:53.261865 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.261773    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34c07f21-75ae-4f89-a262-aebdeacbb3e0-istiod-ca-cert\") pod \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\" (UID: \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\") "
Sep 11 04:19:53.261865 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.261814    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34c07f21-75ae-4f89-a262-aebdeacbb3e0-istio-envoy\") pod \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\" (UID: \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\") "
Sep 11 04:19:53.261865 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.261857    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34c07f21-75ae-4f89-a262-aebdeacbb3e0-istio-data\") pod \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\" (UID: \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\") "
Sep 11 04:19:53.262191 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.261886    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34c07f21-75ae-4f89-a262-aebdeacbb3e0-istio-podinfo\") pod \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\" (UID: \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\") "
Sep 11 04:19:53.262191 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.261923    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34c07f21-75ae-4f89-a262-aebdeacbb3e0-istio-token\") pod \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\" (UID: \"34c07f21-75ae-4f89-a262-aebdeacbb3e0\") "
Sep 11 04:19:53.262191 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.261982    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34c07f21-75ae-4f89-a262-aebdeacbb3e0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "34c07f21-75ae-4f89-a262-aebdeacbb3e0" (UID: "34c07f21-75ae-4f89-a262-aebdeacbb3e0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:19:53.262191 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.262057    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34c07f21-75ae-4f89-a262-aebdeacbb3e0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "34c07f21-75ae-4f89-a262-aebdeacbb3e0" (UID: "34c07f21-75ae-4f89-a262-aebdeacbb3e0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:19:53.262191 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.262150    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34c07f21-75ae-4f89-a262-aebdeacbb3e0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "34c07f21-75ae-4f89-a262-aebdeacbb3e0" (UID: "34c07f21-75ae-4f89-a262-aebdeacbb3e0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:19:53.262475 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.262287    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34c07f21-75ae-4f89-a262-aebdeacbb3e0-workload-socket\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:19:53.262475 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.262308    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34c07f21-75ae-4f89-a262-aebdeacbb3e0-workload-certs\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:19:53.262475 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.262329    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34c07f21-75ae-4f89-a262-aebdeacbb3e0-credential-socket\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:19:53.262475 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.262299    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34c07f21-75ae-4f89-a262-aebdeacbb3e0-istio-data" (OuterVolumeSpecName: "istio-data") pod "34c07f21-75ae-4f89-a262-aebdeacbb3e0" (UID: "34c07f21-75ae-4f89-a262-aebdeacbb3e0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:19:53.262475 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.262325    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34c07f21-75ae-4f89-a262-aebdeacbb3e0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "34c07f21-75ae-4f89-a262-aebdeacbb3e0" (UID: "34c07f21-75ae-4f89-a262-aebdeacbb3e0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:19:53.263995 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.263969    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34c07f21-75ae-4f89-a262-aebdeacbb3e0-kube-api-access-n6vrq" (OuterVolumeSpecName: "kube-api-access-n6vrq") pod "34c07f21-75ae-4f89-a262-aebdeacbb3e0" (UID: "34c07f21-75ae-4f89-a262-aebdeacbb3e0"). InnerVolumeSpecName "kube-api-access-n6vrq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:19:53.264422 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.264380    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/34c07f21-75ae-4f89-a262-aebdeacbb3e0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "34c07f21-75ae-4f89-a262-aebdeacbb3e0" (UID: "34c07f21-75ae-4f89-a262-aebdeacbb3e0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 04:19:53.264517 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.264498    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34c07f21-75ae-4f89-a262-aebdeacbb3e0-istio-token" (OuterVolumeSpecName: "istio-token") pod "34c07f21-75ae-4f89-a262-aebdeacbb3e0" (UID: "34c07f21-75ae-4f89-a262-aebdeacbb3e0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:19:53.264564 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.264512    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34c07f21-75ae-4f89-a262-aebdeacbb3e0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "34c07f21-75ae-4f89-a262-aebdeacbb3e0" (UID: "34c07f21-75ae-4f89-a262-aebdeacbb3e0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:19:53.363469 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.363347    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34c07f21-75ae-4f89-a262-aebdeacbb3e0-istio-envoy\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:19:53.363469 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.363382    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34c07f21-75ae-4f89-a262-aebdeacbb3e0-istio-data\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:19:53.363469 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.363420    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34c07f21-75ae-4f89-a262-aebdeacbb3e0-istio-podinfo\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:19:53.363469 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.363429    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34c07f21-75ae-4f89-a262-aebdeacbb3e0-istio-token\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:19:53.363469 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.363438    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6vrq\" (UniqueName: \"kubernetes.io/projected/34c07f21-75ae-4f89-a262-aebdeacbb3e0-kube-api-access-n6vrq\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:19:53.363469 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.363448    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34c07f21-75ae-4f89-a262-aebdeacbb3e0-istiod-ca-cert\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:19:53.377042 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.377009    2558 generic.go:356] "Generic (PLEG): container finished" podID="34c07f21-75ae-4f89-a262-aebdeacbb3e0" containerID="84bb75dcd319ef5233c11c61fa40551bc587cb30f0ed5a3683a0f1289fa55514" exitCode=0
Sep 11 04:19:53.377240 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.377061    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf" event={"ID":"34c07f21-75ae-4f89-a262-aebdeacbb3e0","Type":"ContainerDied","Data":"84bb75dcd319ef5233c11c61fa40551bc587cb30f0ed5a3683a0f1289fa55514"}
Sep 11 04:19:53.377240 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.377104    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf" event={"ID":"34c07f21-75ae-4f89-a262-aebdeacbb3e0","Type":"ContainerDied","Data":"19f00e618589dc2c13e277c5ced211bb79d3707864789fa4b7c6f87ceb637acb"}
Sep 11 04:19:53.377240 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.377125    2558 scope.go:117] "RemoveContainer" containerID="84bb75dcd319ef5233c11c61fa40551bc587cb30f0ed5a3683a0f1289fa55514"
Sep 11 04:19:53.377240 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.377066    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"
Sep 11 04:19:53.387269 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.387243    2558 scope.go:117] "RemoveContainer" containerID="2addfb9b10e6dbdeb7f965833c3d2b7779423270a1eee57ad05d9d27c2f42bbe"
Sep 11 04:19:53.396340 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.396315    2558 scope.go:117] "RemoveContainer" containerID="84bb75dcd319ef5233c11c61fa40551bc587cb30f0ed5a3683a0f1289fa55514"
Sep 11 04:19:53.396737 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:19:53.396709    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84bb75dcd319ef5233c11c61fa40551bc587cb30f0ed5a3683a0f1289fa55514\": container with ID starting with 84bb75dcd319ef5233c11c61fa40551bc587cb30f0ed5a3683a0f1289fa55514 not found: ID does not exist" containerID="84bb75dcd319ef5233c11c61fa40551bc587cb30f0ed5a3683a0f1289fa55514"
Sep 11 04:19:53.396814 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.396749    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84bb75dcd319ef5233c11c61fa40551bc587cb30f0ed5a3683a0f1289fa55514"} err="failed to get container status \"84bb75dcd319ef5233c11c61fa40551bc587cb30f0ed5a3683a0f1289fa55514\": rpc error: code = NotFound desc = could not find container \"84bb75dcd319ef5233c11c61fa40551bc587cb30f0ed5a3683a0f1289fa55514\": container with ID starting with 84bb75dcd319ef5233c11c61fa40551bc587cb30f0ed5a3683a0f1289fa55514 not found: ID does not exist"
Sep 11 04:19:53.396814 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.396776    2558 scope.go:117] "RemoveContainer" containerID="2addfb9b10e6dbdeb7f965833c3d2b7779423270a1eee57ad05d9d27c2f42bbe"
Sep 11 04:19:53.397069 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:19:53.397049    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2addfb9b10e6dbdeb7f965833c3d2b7779423270a1eee57ad05d9d27c2f42bbe\": container with ID starting with 2addfb9b10e6dbdeb7f965833c3d2b7779423270a1eee57ad05d9d27c2f42bbe not found: ID does not exist" containerID="2addfb9b10e6dbdeb7f965833c3d2b7779423270a1eee57ad05d9d27c2f42bbe"
Sep 11 04:19:53.397112 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.397074    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2addfb9b10e6dbdeb7f965833c3d2b7779423270a1eee57ad05d9d27c2f42bbe"} err="failed to get container status \"2addfb9b10e6dbdeb7f965833c3d2b7779423270a1eee57ad05d9d27c2f42bbe\": rpc error: code = NotFound desc = could not find container \"2addfb9b10e6dbdeb7f965833c3d2b7779423270a1eee57ad05d9d27c2f42bbe\": container with ID starting with 2addfb9b10e6dbdeb7f965833c3d2b7779423270a1eee57ad05d9d27c2f42bbe not found: ID does not exist"
Sep 11 04:19:53.402231 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.402204    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"]
Sep 11 04:19:53.408141 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.408117    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf"]
Sep 11 04:19:53.810405 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:53.810305    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34c07f21-75ae-4f89-a262-aebdeacbb3e0" path="/var/lib/kubelet/pods/34c07f21-75ae-4f89-a262-aebdeacbb3e0/volumes"
Sep 11 04:19:56.793171 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:19:56.793121    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:20:01.424743 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:01.424708    2558 generic.go:356] "Generic (PLEG): container finished" podID="387ef80d-efa3-4e99-9183-0d4deb7f4239" containerID="e01b81ee7e0a916bc3b88df8a5d79460f5f1f960caa4a5d7d552b614f2bf28be" exitCode=0
Sep 11 04:20:01.425267 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:01.424785    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb" event={"ID":"387ef80d-efa3-4e99-9183-0d4deb7f4239","Type":"ContainerDied","Data":"e01b81ee7e0a916bc3b88df8a5d79460f5f1f960caa4a5d7d552b614f2bf28be"}
Sep 11 04:20:01.425334 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:01.425318    2558 scope.go:117] "RemoveContainer" containerID="e01b81ee7e0a916bc3b88df8a5d79460f5f1f960caa4a5d7d552b614f2bf28be"
Sep 11 04:20:01.426438 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:01.426409    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:20:01.426539 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:01.426477    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:20:01.426539 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:01.426509    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:20:02.440462 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:02.440415    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb" event={"ID":"387ef80d-efa3-4e99-9183-0d4deb7f4239","Type":"ContainerStarted","Data":"c732dc7884c86d806f7a48f63891eb959bf3c4ab20e8c61e3ee0c90c8bb2fc85"}
Sep 11 04:20:03.149745 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:03.149700    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:20:03.149994 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:03.149974    2558 patch_prober.go:28] interesting pod/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 11 04:20:03.150046 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:03.150022    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb" podUID="387ef80d-efa3-4e99-9183-0d4deb7f4239" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 11 04:20:04.150313 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:04.150275    2558 patch_prober.go:28] interesting pod/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 11 04:20:04.150715 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:04.150331    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb" podUID="387ef80d-efa3-4e99-9183-0d4deb7f4239" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 11 04:20:05.150311 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:05.150274    2558 patch_prober.go:28] interesting pod/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 11 04:20:05.150536 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:05.150353    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb" podUID="387ef80d-efa3-4e99-9183-0d4deb7f4239" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 11 04:20:06.150140 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:06.150105    2558 patch_prober.go:28] interesting pod/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 11 04:20:06.150353 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:06.150170    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb" podUID="387ef80d-efa3-4e99-9183-0d4deb7f4239" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 11 04:20:07.150436 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:07.150367    2558 patch_prober.go:28] interesting pod/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 11 04:20:07.150893 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:07.150466    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb" podUID="387ef80d-efa3-4e99-9183-0d4deb7f4239" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 11 04:20:08.153941 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.153908    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:20:08.154346 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.154197    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:20:08.154840 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.154823    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:20:08.406474 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.406366    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"]
Sep 11 04:20:08.406940 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.406924    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34c07f21-75ae-4f89-a262-aebdeacbb3e0" containerName="istio-proxy"
Sep 11 04:20:08.407104 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.406942    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="34c07f21-75ae-4f89-a262-aebdeacbb3e0" containerName="istio-proxy"
Sep 11 04:20:08.407104 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.406979    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d10d560-9503-4fce-be96-79cee6ef45e2" containerName="istio-proxy"
Sep 11 04:20:08.407104 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.406989    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d10d560-9503-4fce-be96-79cee6ef45e2" containerName="istio-proxy"
Sep 11 04:20:08.407104 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.407003    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34c07f21-75ae-4f89-a262-aebdeacbb3e0" containerName="istio-proxy"
Sep 11 04:20:08.407104 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.407014    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="34c07f21-75ae-4f89-a262-aebdeacbb3e0" containerName="istio-proxy"
Sep 11 04:20:08.407104 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.407101    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d10d560-9503-4fce-be96-79cee6ef45e2" containerName="istio-proxy"
Sep 11 04:20:08.407295 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.407114    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="34c07f21-75ae-4f89-a262-aebdeacbb3e0" containerName="istio-proxy"
Sep 11 04:20:08.407295 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.407127    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="037e1650-4608-4114-89bc-cb855bb8e67a" containerName="istio-proxy"
Sep 11 04:20:08.409646 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.409613    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:20:08.412491 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.412470    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-7a5a85-openshift-default-dockercfg-9rw8b\""
Sep 11 04:20:08.427878 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.427848    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"]
Sep 11 04:20:08.513501 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.513450    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c089ec66-cfe2-47cb-b56f-bd390109f572-credential-socket\") pod \"e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4\" (UID: \"c089ec66-cfe2-47cb-b56f-bd390109f572\") " pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:20:08.513693 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.513507    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c089ec66-cfe2-47cb-b56f-bd390109f572-istio-data\") pod \"e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4\" (UID: \"c089ec66-cfe2-47cb-b56f-bd390109f572\") " pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:20:08.513693 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.513572    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c089ec66-cfe2-47cb-b56f-bd390109f572-istio-podinfo\") pod \"e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4\" (UID: \"c089ec66-cfe2-47cb-b56f-bd390109f572\") " pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:20:08.513693 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.513655    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvvsd\" (UniqueName: \"kubernetes.io/projected/c089ec66-cfe2-47cb-b56f-bd390109f572-kube-api-access-bvvsd\") pod \"e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4\" (UID: \"c089ec66-cfe2-47cb-b56f-bd390109f572\") " pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:20:08.513874 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.513734    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c089ec66-cfe2-47cb-b56f-bd390109f572-istio-token\") pod \"e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4\" (UID: \"c089ec66-cfe2-47cb-b56f-bd390109f572\") " pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:20:08.513874 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.513763    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c089ec66-cfe2-47cb-b56f-bd390109f572-istio-envoy\") pod \"e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4\" (UID: \"c089ec66-cfe2-47cb-b56f-bd390109f572\") " pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:20:08.513874 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.513795    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c089ec66-cfe2-47cb-b56f-bd390109f572-workload-certs\") pod \"e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4\" (UID: \"c089ec66-cfe2-47cb-b56f-bd390109f572\") " pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:20:08.513874 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.513855    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c089ec66-cfe2-47cb-b56f-bd390109f572-workload-socket\") pod \"e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4\" (UID: \"c089ec66-cfe2-47cb-b56f-bd390109f572\") " pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:20:08.514078 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.513908    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c089ec66-cfe2-47cb-b56f-bd390109f572-istiod-ca-cert\") pod \"e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4\" (UID: \"c089ec66-cfe2-47cb-b56f-bd390109f572\") " pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:20:08.614557 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.614519    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c089ec66-cfe2-47cb-b56f-bd390109f572-credential-socket\") pod \"e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4\" (UID: \"c089ec66-cfe2-47cb-b56f-bd390109f572\") " pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:20:08.614557 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.614559    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c089ec66-cfe2-47cb-b56f-bd390109f572-istio-data\") pod \"e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4\" (UID: \"c089ec66-cfe2-47cb-b56f-bd390109f572\") " pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:20:08.614790 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.614584    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c089ec66-cfe2-47cb-b56f-bd390109f572-istio-podinfo\") pod \"e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4\" (UID: \"c089ec66-cfe2-47cb-b56f-bd390109f572\") " pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:20:08.614790 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.614706    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvvsd\" (UniqueName: \"kubernetes.io/projected/c089ec66-cfe2-47cb-b56f-bd390109f572-kube-api-access-bvvsd\") pod \"e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4\" (UID: \"c089ec66-cfe2-47cb-b56f-bd390109f572\") " pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:20:08.614790 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.614785    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c089ec66-cfe2-47cb-b56f-bd390109f572-istio-token\") pod \"e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4\" (UID: \"c089ec66-cfe2-47cb-b56f-bd390109f572\") " pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:20:08.614954 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.614812    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c089ec66-cfe2-47cb-b56f-bd390109f572-istio-envoy\") pod \"e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4\" (UID: \"c089ec66-cfe2-47cb-b56f-bd390109f572\") " pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:20:08.614954 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.614862    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c089ec66-cfe2-47cb-b56f-bd390109f572-workload-certs\") pod \"e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4\" (UID: \"c089ec66-cfe2-47cb-b56f-bd390109f572\") " pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:20:08.614954 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.614914    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c089ec66-cfe2-47cb-b56f-bd390109f572-workload-socket\") pod \"e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4\" (UID: \"c089ec66-cfe2-47cb-b56f-bd390109f572\") " pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:20:08.615100 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.614955    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c089ec66-cfe2-47cb-b56f-bd390109f572-istio-data\") pod \"e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4\" (UID: \"c089ec66-cfe2-47cb-b56f-bd390109f572\") " pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:20:08.615100 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.614974    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c089ec66-cfe2-47cb-b56f-bd390109f572-istiod-ca-cert\") pod \"e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4\" (UID: \"c089ec66-cfe2-47cb-b56f-bd390109f572\") " pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:20:08.615468 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.615447    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c089ec66-cfe2-47cb-b56f-bd390109f572-credential-socket\") pod \"e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4\" (UID: \"c089ec66-cfe2-47cb-b56f-bd390109f572\") " pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:20:08.615566 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.615483    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c089ec66-cfe2-47cb-b56f-bd390109f572-workload-certs\") pod \"e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4\" (UID: \"c089ec66-cfe2-47cb-b56f-bd390109f572\") " pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:20:08.615631 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.615600    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c089ec66-cfe2-47cb-b56f-bd390109f572-istiod-ca-cert\") pod \"e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4\" (UID: \"c089ec66-cfe2-47cb-b56f-bd390109f572\") " pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:20:08.615694 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.615644    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c089ec66-cfe2-47cb-b56f-bd390109f572-workload-socket\") pod \"e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4\" (UID: \"c089ec66-cfe2-47cb-b56f-bd390109f572\") " pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:20:08.617370 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.617351    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c089ec66-cfe2-47cb-b56f-bd390109f572-istio-envoy\") pod \"e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4\" (UID: \"c089ec66-cfe2-47cb-b56f-bd390109f572\") " pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:20:08.617614 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.617598    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c089ec66-cfe2-47cb-b56f-bd390109f572-istio-podinfo\") pod \"e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4\" (UID: \"c089ec66-cfe2-47cb-b56f-bd390109f572\") " pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:20:08.624200 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.624177    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c089ec66-cfe2-47cb-b56f-bd390109f572-istio-token\") pod \"e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4\" (UID: \"c089ec66-cfe2-47cb-b56f-bd390109f572\") " pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:20:08.624544 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.624523    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvvsd\" (UniqueName: \"kubernetes.io/projected/c089ec66-cfe2-47cb-b56f-bd390109f572-kube-api-access-bvvsd\") pod \"e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4\" (UID: \"c089ec66-cfe2-47cb-b56f-bd390109f572\") " pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:20:08.727155 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:08.727058    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:20:09.003898 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:09.003865    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"]
Sep 11 04:20:09.005267 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:20:09.005236    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc089ec66_cfe2_47cb_b56f_bd390109f572.slice/crio-6bafec16a5af367ffb28b43f2fcf24ca4909a9ebe781e6f6ceb9187a37cf14ae WatchSource:0}: Error finding container 6bafec16a5af367ffb28b43f2fcf24ca4909a9ebe781e6f6ceb9187a37cf14ae: Status 404 returned error can't find the container with id 6bafec16a5af367ffb28b43f2fcf24ca4909a9ebe781e6f6ceb9187a37cf14ae
Sep 11 04:20:09.007581 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:09.007550    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:20:09.007672 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:09.007615    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:20:09.007672 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:09.007647    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:20:09.484124 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:09.484084    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4" event={"ID":"c089ec66-cfe2-47cb-b56f-bd390109f572","Type":"ContainerStarted","Data":"53a785fa280c7c0667dbaf959298eb96f34941a54ab9cb810433a99dd3090ef6"}
Sep 11 04:20:09.484643 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:09.484137    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4" event={"ID":"c089ec66-cfe2-47cb-b56f-bd390109f572","Type":"ContainerStarted","Data":"6bafec16a5af367ffb28b43f2fcf24ca4909a9ebe781e6f6ceb9187a37cf14ae"}
Sep 11 04:20:09.508781 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:09.508727    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4" podStartSLOduration=1.508711698 podStartE2EDuration="1.508711698s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:20:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:20:09.505902269 +0000 UTC m=+1606.303991997" watchObservedRunningTime="2026-09-11 04:20:09.508711698 +0000 UTC m=+1606.306801490"
Sep 11 04:20:09.727353 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:09.727316    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:20:10.732349 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:10.732313    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:20:11.496065 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:11.496033    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:20:11.497149 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:11.497128    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:20:19.293221 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:19.293135    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:20:27.537598 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:27.537555    2558 patch_prober.go:28] interesting pod/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 04:20:27.537993 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:27.537624    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4" podUID="c089ec66-cfe2-47cb-b56f-bd390109f572" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 04:20:29.600406 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:29.600357    2558 generic.go:356] "Generic (PLEG): container finished" podID="c089ec66-cfe2-47cb-b56f-bd390109f572" containerID="53a785fa280c7c0667dbaf959298eb96f34941a54ab9cb810433a99dd3090ef6" exitCode=0
Sep 11 04:20:29.600828 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:29.600431    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4" event={"ID":"c089ec66-cfe2-47cb-b56f-bd390109f572","Type":"ContainerDied","Data":"53a785fa280c7c0667dbaf959298eb96f34941a54ab9cb810433a99dd3090ef6"}
Sep 11 04:20:29.600888 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:29.600842    2558 scope.go:117] "RemoveContainer" containerID="53a785fa280c7c0667dbaf959298eb96f34941a54ab9cb810433a99dd3090ef6"
Sep 11 04:20:29.601935 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:29.601910    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:20:29.601996 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:29.601979    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:20:29.602041 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:29.602008    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:20:30.608050 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:30.608013    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4" event={"ID":"c089ec66-cfe2-47cb-b56f-bd390109f572","Type":"ContainerStarted","Data":"29dbc15c504814b84dc4e13c9faa8f853ca8290d975cabdc5946301de0f9bd7b"}
Sep 11 04:20:30.728635 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:30.728590    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:20:30.728849 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:30.728751    2558 patch_prober.go:28] interesting pod/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 11 04:20:30.728849 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:30.728815    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4" podUID="c089ec66-cfe2-47cb-b56f-bd390109f572" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 11 04:20:31.727775 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:31.727735    2558 patch_prober.go:28] interesting pod/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 11 04:20:31.728377 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:31.728341    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4" podUID="c089ec66-cfe2-47cb-b56f-bd390109f572" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 11 04:20:32.728123 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:32.728080    2558 patch_prober.go:28] interesting pod/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 11 04:20:32.728733 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:32.728700    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4" podUID="c089ec66-cfe2-47cb-b56f-bd390109f572" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 11 04:20:33.727563 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:33.727522    2558 patch_prober.go:28] interesting pod/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 11 04:20:33.727882 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:33.727851    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4" podUID="c089ec66-cfe2-47cb-b56f-bd390109f572" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 11 04:20:34.728141 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:34.728091    2558 patch_prober.go:28] interesting pod/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 11 04:20:34.728686 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:34.728169    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4" podUID="c089ec66-cfe2-47cb-b56f-bd390109f572" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 11 04:20:35.727908 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:35.727865    2558 patch_prober.go:28] interesting pod/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 11 04:20:35.728222 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:35.728192    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4" podUID="c089ec66-cfe2-47cb-b56f-bd390109f572" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 11 04:20:36.731775 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:36.731745    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:20:36.732255 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:36.732138    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:20:36.732850 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:36.732834    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:20:47.152961 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:47.152930    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc"]
Sep 11 04:20:47.153494 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:47.153476    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="34c07f21-75ae-4f89-a262-aebdeacbb3e0" containerName="istio-proxy"
Sep 11 04:20:47.157618 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:47.157601    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc"
Sep 11 04:20:47.160404 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:47.160364    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-fdc690\"/\"kube-root-ca.crt\""
Sep 11 04:20:47.161691 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:47.161671    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-fdc690\"/\"ipp-route-fdc690-kserve-self-signed-certs\""
Sep 11 04:20:47.161691 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:47.161686    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-fdc690\"/\"openshift-service-ca.crt\""
Sep 11 04:20:47.161862 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:47.161735    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-fdc690\"/\"default-dockercfg-bhlpm\""
Sep 11 04:20:47.171526 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:47.171503    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc"]
Sep 11 04:20:47.196499 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:47.196464    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f810f44-97ba-4c7a-9323-946419e488d1-model-cache\") pod \"ipp-route-fdc690-kserve-5f644568bc-npzgc\" (UID: \"9f810f44-97ba-4c7a-9323-946419e488d1\") " pod="ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc"
Sep 11 04:20:47.196499 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:47.196505    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f810f44-97ba-4c7a-9323-946419e488d1-dshm\") pod \"ipp-route-fdc690-kserve-5f644568bc-npzgc\" (UID: \"9f810f44-97ba-4c7a-9323-946419e488d1\") " pod="ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc"
Sep 11 04:20:47.196714 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:47.196578    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f810f44-97ba-4c7a-9323-946419e488d1-home\") pod \"ipp-route-fdc690-kserve-5f644568bc-npzgc\" (UID: \"9f810f44-97ba-4c7a-9323-946419e488d1\") " pod="ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc"
Sep 11 04:20:47.196714 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:47.196616    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f810f44-97ba-4c7a-9323-946419e488d1-tls-certs\") pod \"ipp-route-fdc690-kserve-5f644568bc-npzgc\" (UID: \"9f810f44-97ba-4c7a-9323-946419e488d1\") " pod="ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc"
Sep 11 04:20:47.196714 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:47.196635    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f810f44-97ba-4c7a-9323-946419e488d1-tmp-dir\") pod \"ipp-route-fdc690-kserve-5f644568bc-npzgc\" (UID: \"9f810f44-97ba-4c7a-9323-946419e488d1\") " pod="ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc"
Sep 11 04:20:47.196714 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:47.196703    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mtjz\" (UniqueName: \"kubernetes.io/projected/9f810f44-97ba-4c7a-9323-946419e488d1-kube-api-access-9mtjz\") pod \"ipp-route-fdc690-kserve-5f644568bc-npzgc\" (UID: \"9f810f44-97ba-4c7a-9323-946419e488d1\") " pod="ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc"
Sep 11 04:20:47.297175 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:47.297141    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f810f44-97ba-4c7a-9323-946419e488d1-model-cache\") pod \"ipp-route-fdc690-kserve-5f644568bc-npzgc\" (UID: \"9f810f44-97ba-4c7a-9323-946419e488d1\") " pod="ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc"
Sep 11 04:20:47.297355 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:47.297178    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f810f44-97ba-4c7a-9323-946419e488d1-dshm\") pod \"ipp-route-fdc690-kserve-5f644568bc-npzgc\" (UID: \"9f810f44-97ba-4c7a-9323-946419e488d1\") " pod="ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc"
Sep 11 04:20:47.297355 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:47.297246    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f810f44-97ba-4c7a-9323-946419e488d1-home\") pod \"ipp-route-fdc690-kserve-5f644568bc-npzgc\" (UID: \"9f810f44-97ba-4c7a-9323-946419e488d1\") " pod="ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc"
Sep 11 04:20:47.297355 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:47.297285    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f810f44-97ba-4c7a-9323-946419e488d1-tls-certs\") pod \"ipp-route-fdc690-kserve-5f644568bc-npzgc\" (UID: \"9f810f44-97ba-4c7a-9323-946419e488d1\") " pod="ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc"
Sep 11 04:20:47.297355 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:47.297308    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f810f44-97ba-4c7a-9323-946419e488d1-tmp-dir\") pod \"ipp-route-fdc690-kserve-5f644568bc-npzgc\" (UID: \"9f810f44-97ba-4c7a-9323-946419e488d1\") " pod="ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc"
Sep 11 04:20:47.297355 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:47.297337    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mtjz\" (UniqueName: \"kubernetes.io/projected/9f810f44-97ba-4c7a-9323-946419e488d1-kube-api-access-9mtjz\") pod \"ipp-route-fdc690-kserve-5f644568bc-npzgc\" (UID: \"9f810f44-97ba-4c7a-9323-946419e488d1\") " pod="ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc"
Sep 11 04:20:47.297671 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:47.297610    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f810f44-97ba-4c7a-9323-946419e488d1-model-cache\") pod \"ipp-route-fdc690-kserve-5f644568bc-npzgc\" (UID: \"9f810f44-97ba-4c7a-9323-946419e488d1\") " pod="ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc"
Sep 11 04:20:47.297743 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:47.297684    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f810f44-97ba-4c7a-9323-946419e488d1-home\") pod \"ipp-route-fdc690-kserve-5f644568bc-npzgc\" (UID: \"9f810f44-97ba-4c7a-9323-946419e488d1\") " pod="ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc"
Sep 11 04:20:47.297743 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:47.297711    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f810f44-97ba-4c7a-9323-946419e488d1-tmp-dir\") pod \"ipp-route-fdc690-kserve-5f644568bc-npzgc\" (UID: \"9f810f44-97ba-4c7a-9323-946419e488d1\") " pod="ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc"
Sep 11 04:20:47.299463 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:47.299436    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f810f44-97ba-4c7a-9323-946419e488d1-dshm\") pod \"ipp-route-fdc690-kserve-5f644568bc-npzgc\" (UID: \"9f810f44-97ba-4c7a-9323-946419e488d1\") " pod="ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc"
Sep 11 04:20:47.299760 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:47.299739    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f810f44-97ba-4c7a-9323-946419e488d1-tls-certs\") pod \"ipp-route-fdc690-kserve-5f644568bc-npzgc\" (UID: \"9f810f44-97ba-4c7a-9323-946419e488d1\") " pod="ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc"
Sep 11 04:20:47.306069 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:47.306046    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mtjz\" (UniqueName: \"kubernetes.io/projected/9f810f44-97ba-4c7a-9323-946419e488d1-kube-api-access-9mtjz\") pod \"ipp-route-fdc690-kserve-5f644568bc-npzgc\" (UID: \"9f810f44-97ba-4c7a-9323-946419e488d1\") " pod="ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc"
Sep 11 04:20:47.466690 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:47.466603    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc"
Sep 11 04:20:47.740046 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:47.740019    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc"]
Sep 11 04:20:47.741313 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:20:47.741285    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f810f44_97ba_4c7a_9323_946419e488d1.slice/crio-69db4cc6f700f510ae6e47de944c26f26e1d70490db277c77d79bb0bbbfebc89 WatchSource:0}: Error finding container 69db4cc6f700f510ae6e47de944c26f26e1d70490db277c77d79bb0bbbfebc89: Status 404 returned error can't find the container with id 69db4cc6f700f510ae6e47de944c26f26e1d70490db277c77d79bb0bbbfebc89
Sep 11 04:20:48.712825 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:48.712786    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc" event={"ID":"9f810f44-97ba-4c7a-9323-946419e488d1","Type":"ContainerStarted","Data":"7ed9dd26588135214a7450d77af7dc4c91b77a5e58a6cf603c511a9f2bae2da0"}
Sep 11 04:20:48.712825 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:48.712831    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc" event={"ID":"9f810f44-97ba-4c7a-9323-946419e488d1","Type":"ContainerStarted","Data":"69db4cc6f700f510ae6e47de944c26f26e1d70490db277c77d79bb0bbbfebc89"}
Sep 11 04:20:48.731860 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:48.731815    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc" podStartSLOduration=1.731800871 podStartE2EDuration="1.731800871s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:20:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:20:48.729605736 +0000 UTC m=+1645.527695465" watchObservedRunningTime="2026-09-11 04:20:48.731800871 +0000 UTC m=+1645.529890575"
Sep 11 04:20:50.717170 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:50.717124    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:20:57.467320 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:57.467282    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc"
Sep 11 04:20:57.467723 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:57.467368    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc"
Sep 11 04:20:57.479978 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:57.479955    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc"
Sep 11 04:20:57.776056 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:20:57.775971    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc"
Sep 11 04:21:06.203934 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:06.203892    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:21:13.358083 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:13.358051    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"]
Sep 11 04:21:13.362152 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:13.362130    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:21:13.364980 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:13.364961    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-84b423-openshift-default-dockercfg-bj8f9\""
Sep 11 04:21:13.375221 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:13.375190    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"]
Sep 11 04:21:13.454113 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:13.454067    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9bd58d6-2292-4751-a941-07b2f4d4355f-istio-podinfo\") pod \"e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz\" (UID: \"b9bd58d6-2292-4751-a941-07b2f4d4355f\") " pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:21:13.454286 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:13.454138    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bd58d6-2292-4751-a941-07b2f4d4355f-credential-socket\") pod \"e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz\" (UID: \"b9bd58d6-2292-4751-a941-07b2f4d4355f\") " pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:21:13.454286 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:13.454204    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9bd58d6-2292-4751-a941-07b2f4d4355f-istio-token\") pod \"e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz\" (UID: \"b9bd58d6-2292-4751-a941-07b2f4d4355f\") " pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:21:13.454403 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:13.454302    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9bd58d6-2292-4751-a941-07b2f4d4355f-workload-certs\") pod \"e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz\" (UID: \"b9bd58d6-2292-4751-a941-07b2f4d4355f\") " pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:21:13.454403 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:13.454371    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9bd58d6-2292-4751-a941-07b2f4d4355f-istiod-ca-cert\") pod \"e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz\" (UID: \"b9bd58d6-2292-4751-a941-07b2f4d4355f\") " pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:21:13.454499 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:13.454415    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9bd58d6-2292-4751-a941-07b2f4d4355f-istio-data\") pod \"e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz\" (UID: \"b9bd58d6-2292-4751-a941-07b2f4d4355f\") " pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:21:13.454499 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:13.454476    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48gpw\" (UniqueName: \"kubernetes.io/projected/b9bd58d6-2292-4751-a941-07b2f4d4355f-kube-api-access-48gpw\") pod \"e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz\" (UID: \"b9bd58d6-2292-4751-a941-07b2f4d4355f\") " pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:21:13.454586 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:13.454528    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9bd58d6-2292-4751-a941-07b2f4d4355f-istio-envoy\") pod \"e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz\" (UID: \"b9bd58d6-2292-4751-a941-07b2f4d4355f\") " pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:21:13.454586 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:13.454570    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bd58d6-2292-4751-a941-07b2f4d4355f-workload-socket\") pod \"e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz\" (UID: \"b9bd58d6-2292-4751-a941-07b2f4d4355f\") " pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:21:13.556064 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:13.556031    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9bd58d6-2292-4751-a941-07b2f4d4355f-workload-certs\") pod \"e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz\" (UID: \"b9bd58d6-2292-4751-a941-07b2f4d4355f\") " pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:21:13.556234 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:13.556084    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9bd58d6-2292-4751-a941-07b2f4d4355f-istiod-ca-cert\") pod \"e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz\" (UID: \"b9bd58d6-2292-4751-a941-07b2f4d4355f\") " pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:21:13.556234 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:13.556110    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9bd58d6-2292-4751-a941-07b2f4d4355f-istio-data\") pod \"e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz\" (UID: \"b9bd58d6-2292-4751-a941-07b2f4d4355f\") " pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:21:13.556234 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:13.556147    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48gpw\" (UniqueName: \"kubernetes.io/projected/b9bd58d6-2292-4751-a941-07b2f4d4355f-kube-api-access-48gpw\") pod \"e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz\" (UID: \"b9bd58d6-2292-4751-a941-07b2f4d4355f\") " pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:21:13.556234 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:13.556190    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9bd58d6-2292-4751-a941-07b2f4d4355f-istio-envoy\") pod \"e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz\" (UID: \"b9bd58d6-2292-4751-a941-07b2f4d4355f\") " pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:21:13.556234 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:13.556227    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bd58d6-2292-4751-a941-07b2f4d4355f-workload-socket\") pod \"e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz\" (UID: \"b9bd58d6-2292-4751-a941-07b2f4d4355f\") " pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:21:13.556541 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:13.556266    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9bd58d6-2292-4751-a941-07b2f4d4355f-istio-podinfo\") pod \"e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz\" (UID: \"b9bd58d6-2292-4751-a941-07b2f4d4355f\") " pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:21:13.556541 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:13.556312    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bd58d6-2292-4751-a941-07b2f4d4355f-credential-socket\") pod \"e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz\" (UID: \"b9bd58d6-2292-4751-a941-07b2f4d4355f\") " pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:21:13.556541 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:13.556359    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9bd58d6-2292-4751-a941-07b2f4d4355f-istio-token\") pod \"e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz\" (UID: \"b9bd58d6-2292-4751-a941-07b2f4d4355f\") " pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:21:13.556754 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:13.556552    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9bd58d6-2292-4751-a941-07b2f4d4355f-workload-certs\") pod \"e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz\" (UID: \"b9bd58d6-2292-4751-a941-07b2f4d4355f\") " pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:21:13.556754 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:13.556589    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9bd58d6-2292-4751-a941-07b2f4d4355f-istio-data\") pod \"e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz\" (UID: \"b9bd58d6-2292-4751-a941-07b2f4d4355f\") " pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:21:13.556754 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:13.556669    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bd58d6-2292-4751-a941-07b2f4d4355f-workload-socket\") pod \"e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz\" (UID: \"b9bd58d6-2292-4751-a941-07b2f4d4355f\") " pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:21:13.556993 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:13.556973    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bd58d6-2292-4751-a941-07b2f4d4355f-credential-socket\") pod \"e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz\" (UID: \"b9bd58d6-2292-4751-a941-07b2f4d4355f\") " pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:21:13.557053 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:13.556973    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9bd58d6-2292-4751-a941-07b2f4d4355f-istiod-ca-cert\") pod \"e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz\" (UID: \"b9bd58d6-2292-4751-a941-07b2f4d4355f\") " pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:21:13.558537 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:13.558502    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9bd58d6-2292-4751-a941-07b2f4d4355f-istio-envoy\") pod \"e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz\" (UID: \"b9bd58d6-2292-4751-a941-07b2f4d4355f\") " pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:21:13.558728 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:13.558713    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9bd58d6-2292-4751-a941-07b2f4d4355f-istio-podinfo\") pod \"e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz\" (UID: \"b9bd58d6-2292-4751-a941-07b2f4d4355f\") " pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:21:13.564122 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:13.564095    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9bd58d6-2292-4751-a941-07b2f4d4355f-istio-token\") pod \"e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz\" (UID: \"b9bd58d6-2292-4751-a941-07b2f4d4355f\") " pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:21:13.564354 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:13.564334    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48gpw\" (UniqueName: \"kubernetes.io/projected/b9bd58d6-2292-4751-a941-07b2f4d4355f-kube-api-access-48gpw\") pod \"e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz\" (UID: \"b9bd58d6-2292-4751-a941-07b2f4d4355f\") " pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:21:13.673862 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:13.673778    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:21:13.950857 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:13.950826    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"]
Sep 11 04:21:13.951699 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:21:13.951677    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9bd58d6_2292_4751_a941_07b2f4d4355f.slice/crio-f2e941e0dd0e6b80710d78ac7e9b25f6e5eb6eabf40774bbe968c922738f7ad7 WatchSource:0}: Error finding container f2e941e0dd0e6b80710d78ac7e9b25f6e5eb6eabf40774bbe968c922738f7ad7: Status 404 returned error can't find the container with id f2e941e0dd0e6b80710d78ac7e9b25f6e5eb6eabf40774bbe968c922738f7ad7
Sep 11 04:21:13.954325 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:13.954290    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:21:13.954427 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:13.954355    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:21:13.954427 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:13.954382    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:21:14.865296 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:14.865264    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz" event={"ID":"b9bd58d6-2292-4751-a941-07b2f4d4355f","Type":"ContainerStarted","Data":"e324abdab9e679e0f5f689849aa0e0676d839db6f774004a42ae97fb838f8f25"}
Sep 11 04:21:14.865695 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:14.865314    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz" event={"ID":"b9bd58d6-2292-4751-a941-07b2f4d4355f","Type":"ContainerStarted","Data":"f2e941e0dd0e6b80710d78ac7e9b25f6e5eb6eabf40774bbe968c922738f7ad7"}
Sep 11 04:21:14.887256 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:14.887206    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz" podStartSLOduration=1.887188803 podStartE2EDuration="1.887188803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:21:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:21:14.884474398 +0000 UTC m=+1671.682564128" watchObservedRunningTime="2026-09-11 04:21:14.887188803 +0000 UTC m=+1671.685278603"
Sep 11 04:21:15.674558 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:15.674529    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:21:15.679940 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:15.679915    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:21:15.871185 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:15.871155    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:21:15.872213 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:15.872190    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:21:23.996214 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:23.996177    2558 scope.go:117] "RemoveContainer" containerID="4257a2d7bd6a50ed8d6fa19498709c9d37e7368e6be59471e5bcd0e0450e61c2"
Sep 11 04:21:25.405141 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:25.405103    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:21:34.989251 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:34.989162    2558 generic.go:356] "Generic (PLEG): container finished" podID="b9bd58d6-2292-4751-a941-07b2f4d4355f" containerID="e324abdab9e679e0f5f689849aa0e0676d839db6f774004a42ae97fb838f8f25" exitCode=0
Sep 11 04:21:34.989251 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:34.989233    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz" event={"ID":"b9bd58d6-2292-4751-a941-07b2f4d4355f","Type":"ContainerDied","Data":"e324abdab9e679e0f5f689849aa0e0676d839db6f774004a42ae97fb838f8f25"}
Sep 11 04:21:34.989750 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:34.989689    2558 scope.go:117] "RemoveContainer" containerID="e324abdab9e679e0f5f689849aa0e0676d839db6f774004a42ae97fb838f8f25"
Sep 11 04:21:34.990795 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:34.990768    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:21:34.990862 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:34.990835    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:21:34.990903 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:34.990865    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 04:21:35.996626 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:35.996592    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz" event={"ID":"b9bd58d6-2292-4751-a941-07b2f4d4355f","Type":"ContainerStarted","Data":"8930d647c1cd62a30c7c25b2f59da243f3784a4f5b244e9632baff55469612ee"}
Sep 11 04:21:36.674641 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:36.674602    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:21:36.674857 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:36.674838    2558 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 11 04:21:36.674909 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:36.674883    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz" podUID="b9bd58d6-2292-4751-a941-07b2f4d4355f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 11 04:21:37.674945 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:37.674909    2558 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 11 04:21:37.675333 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:37.674967    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz" podUID="b9bd58d6-2292-4751-a941-07b2f4d4355f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 11 04:21:38.674271 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:38.674234    2558 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 11 04:21:38.674472 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:38.674286    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz" podUID="b9bd58d6-2292-4751-a941-07b2f4d4355f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 11 04:21:39.674517 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:39.674481    2558 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 11 04:21:39.674901 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:39.674540    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz" podUID="b9bd58d6-2292-4751-a941-07b2f4d4355f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 11 04:21:40.674698 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:40.674667    2558 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 11 04:21:40.675093 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:40.674718    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz" podUID="b9bd58d6-2292-4751-a941-07b2f4d4355f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 11 04:21:41.678262 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:41.678234    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:21:41.678663 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:41.678584    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:21:41.679253 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:41.679235    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:21:51.601305 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:51.601270    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:21:55.381437 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:55.381404    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"]
Sep 11 04:21:55.381993 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:55.381656    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz" podUID="b9bd58d6-2292-4751-a941-07b2f4d4355f" containerName="istio-proxy" containerID="cri-o://8930d647c1cd62a30c7c25b2f59da243f3784a4f5b244e9632baff55469612ee" gracePeriod=30
Sep 11 04:21:56.680333 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:56.680295    2558 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 04:21:56.680714 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:21:56.680368    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz" podUID="b9bd58d6-2292-4751-a941-07b2f4d4355f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 04:22:00.633848 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:00.633824    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:22:00.827351 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:00.827319    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9bd58d6-2292-4751-a941-07b2f4d4355f-workload-certs\") pod \"b9bd58d6-2292-4751-a941-07b2f4d4355f\" (UID: \"b9bd58d6-2292-4751-a941-07b2f4d4355f\") "
Sep 11 04:22:00.827555 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:00.827383    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9bd58d6-2292-4751-a941-07b2f4d4355f-istio-podinfo\") pod \"b9bd58d6-2292-4751-a941-07b2f4d4355f\" (UID: \"b9bd58d6-2292-4751-a941-07b2f4d4355f\") "
Sep 11 04:22:00.827555 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:00.827419    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9bd58d6-2292-4751-a941-07b2f4d4355f-istio-envoy\") pod \"b9bd58d6-2292-4751-a941-07b2f4d4355f\" (UID: \"b9bd58d6-2292-4751-a941-07b2f4d4355f\") "
Sep 11 04:22:00.827555 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:00.827450    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bd58d6-2292-4751-a941-07b2f4d4355f-credential-socket\") pod \"b9bd58d6-2292-4751-a941-07b2f4d4355f\" (UID: \"b9bd58d6-2292-4751-a941-07b2f4d4355f\") "
Sep 11 04:22:00.827555 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:00.827472    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9bd58d6-2292-4751-a941-07b2f4d4355f-istio-token\") pod \"b9bd58d6-2292-4751-a941-07b2f4d4355f\" (UID: \"b9bd58d6-2292-4751-a941-07b2f4d4355f\") "
Sep 11 04:22:00.827555 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:00.827520    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9bd58d6-2292-4751-a941-07b2f4d4355f-istio-data\") pod \"b9bd58d6-2292-4751-a941-07b2f4d4355f\" (UID: \"b9bd58d6-2292-4751-a941-07b2f4d4355f\") "
Sep 11 04:22:00.827555 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:00.827544    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bd58d6-2292-4751-a941-07b2f4d4355f-workload-socket\") pod \"b9bd58d6-2292-4751-a941-07b2f4d4355f\" (UID: \"b9bd58d6-2292-4751-a941-07b2f4d4355f\") "
Sep 11 04:22:00.827903 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:00.827597    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48gpw\" (UniqueName: \"kubernetes.io/projected/b9bd58d6-2292-4751-a941-07b2f4d4355f-kube-api-access-48gpw\") pod \"b9bd58d6-2292-4751-a941-07b2f4d4355f\" (UID: \"b9bd58d6-2292-4751-a941-07b2f4d4355f\") "
Sep 11 04:22:00.827903 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:00.827627    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9bd58d6-2292-4751-a941-07b2f4d4355f-istiod-ca-cert\") pod \"b9bd58d6-2292-4751-a941-07b2f4d4355f\" (UID: \"b9bd58d6-2292-4751-a941-07b2f4d4355f\") "
Sep 11 04:22:00.827903 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:00.827679    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9bd58d6-2292-4751-a941-07b2f4d4355f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b9bd58d6-2292-4751-a941-07b2f4d4355f" (UID: "b9bd58d6-2292-4751-a941-07b2f4d4355f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:22:00.827903 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:00.827782    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9bd58d6-2292-4751-a941-07b2f4d4355f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b9bd58d6-2292-4751-a941-07b2f4d4355f" (UID: "b9bd58d6-2292-4751-a941-07b2f4d4355f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:22:00.827903 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:00.827890    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9bd58d6-2292-4751-a941-07b2f4d4355f-istio-data" (OuterVolumeSpecName: "istio-data") pod "b9bd58d6-2292-4751-a941-07b2f4d4355f" (UID: "b9bd58d6-2292-4751-a941-07b2f4d4355f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:22:00.828138 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:00.827900    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9bd58d6-2292-4751-a941-07b2f4d4355f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b9bd58d6-2292-4751-a941-07b2f4d4355f" (UID: "b9bd58d6-2292-4751-a941-07b2f4d4355f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:22:00.828138 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:00.828105    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9bd58d6-2292-4751-a941-07b2f4d4355f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b9bd58d6-2292-4751-a941-07b2f4d4355f" (UID: "b9bd58d6-2292-4751-a941-07b2f4d4355f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:22:00.828246 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:00.828219    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bd58d6-2292-4751-a941-07b2f4d4355f-credential-socket\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:22:00.828246 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:00.828234    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9bd58d6-2292-4751-a941-07b2f4d4355f-istio-data\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:22:00.828246 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:00.828243    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bd58d6-2292-4751-a941-07b2f4d4355f-workload-socket\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:22:00.828364 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:00.828252    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9bd58d6-2292-4751-a941-07b2f4d4355f-istiod-ca-cert\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:22:00.828364 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:00.828260    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9bd58d6-2292-4751-a941-07b2f4d4355f-workload-certs\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:22:00.830231 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:00.830205    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b9bd58d6-2292-4751-a941-07b2f4d4355f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b9bd58d6-2292-4751-a941-07b2f4d4355f" (UID: "b9bd58d6-2292-4751-a941-07b2f4d4355f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 04:22:00.830231 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:00.830203    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9bd58d6-2292-4751-a941-07b2f4d4355f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b9bd58d6-2292-4751-a941-07b2f4d4355f" (UID: "b9bd58d6-2292-4751-a941-07b2f4d4355f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:22:00.830365 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:00.830266    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9bd58d6-2292-4751-a941-07b2f4d4355f-kube-api-access-48gpw" (OuterVolumeSpecName: "kube-api-access-48gpw") pod "b9bd58d6-2292-4751-a941-07b2f4d4355f" (UID: "b9bd58d6-2292-4751-a941-07b2f4d4355f"). InnerVolumeSpecName "kube-api-access-48gpw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:22:00.830365 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:00.830274    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9bd58d6-2292-4751-a941-07b2f4d4355f-istio-token" (OuterVolumeSpecName: "istio-token") pod "b9bd58d6-2292-4751-a941-07b2f4d4355f" (UID: "b9bd58d6-2292-4751-a941-07b2f4d4355f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:22:00.929266 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:00.929217    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9bd58d6-2292-4751-a941-07b2f4d4355f-istio-podinfo\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:22:00.929266 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:00.929264    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9bd58d6-2292-4751-a941-07b2f4d4355f-istio-envoy\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:22:00.929266 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:00.929279    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9bd58d6-2292-4751-a941-07b2f4d4355f-istio-token\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:22:00.929552 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:00.929300    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48gpw\" (UniqueName: \"kubernetes.io/projected/b9bd58d6-2292-4751-a941-07b2f4d4355f-kube-api-access-48gpw\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:22:01.133539 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:01.133454    2558 generic.go:356] "Generic (PLEG): container finished" podID="b9bd58d6-2292-4751-a941-07b2f4d4355f" containerID="8930d647c1cd62a30c7c25b2f59da243f3784a4f5b244e9632baff55469612ee" exitCode=0
Sep 11 04:22:01.133539 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:01.133499    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"
Sep 11 04:22:01.133734 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:01.133537    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz" event={"ID":"b9bd58d6-2292-4751-a941-07b2f4d4355f","Type":"ContainerDied","Data":"8930d647c1cd62a30c7c25b2f59da243f3784a4f5b244e9632baff55469612ee"}
Sep 11 04:22:01.133734 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:01.133591    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz" event={"ID":"b9bd58d6-2292-4751-a941-07b2f4d4355f","Type":"ContainerDied","Data":"f2e941e0dd0e6b80710d78ac7e9b25f6e5eb6eabf40774bbe968c922738f7ad7"}
Sep 11 04:22:01.133734 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:01.133614    2558 scope.go:117] "RemoveContainer" containerID="8930d647c1cd62a30c7c25b2f59da243f3784a4f5b244e9632baff55469612ee"
Sep 11 04:22:01.150649 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:01.150629    2558 scope.go:117] "RemoveContainer" containerID="e324abdab9e679e0f5f689849aa0e0676d839db6f774004a42ae97fb838f8f25"
Sep 11 04:22:01.159033 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:01.159010    2558 scope.go:117] "RemoveContainer" containerID="8930d647c1cd62a30c7c25b2f59da243f3784a4f5b244e9632baff55469612ee"
Sep 11 04:22:01.159328 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:22:01.159303    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8930d647c1cd62a30c7c25b2f59da243f3784a4f5b244e9632baff55469612ee\": container with ID starting with 8930d647c1cd62a30c7c25b2f59da243f3784a4f5b244e9632baff55469612ee not found: ID does not exist" containerID="8930d647c1cd62a30c7c25b2f59da243f3784a4f5b244e9632baff55469612ee"
Sep 11 04:22:01.159438 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:01.159339    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8930d647c1cd62a30c7c25b2f59da243f3784a4f5b244e9632baff55469612ee"} err="failed to get container status \"8930d647c1cd62a30c7c25b2f59da243f3784a4f5b244e9632baff55469612ee\": rpc error: code = NotFound desc = could not find container \"8930d647c1cd62a30c7c25b2f59da243f3784a4f5b244e9632baff55469612ee\": container with ID starting with 8930d647c1cd62a30c7c25b2f59da243f3784a4f5b244e9632baff55469612ee not found: ID does not exist"
Sep 11 04:22:01.159438 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:01.159363    2558 scope.go:117] "RemoveContainer" containerID="e324abdab9e679e0f5f689849aa0e0676d839db6f774004a42ae97fb838f8f25"
Sep 11 04:22:01.159652 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:22:01.159635    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e324abdab9e679e0f5f689849aa0e0676d839db6f774004a42ae97fb838f8f25\": container with ID starting with e324abdab9e679e0f5f689849aa0e0676d839db6f774004a42ae97fb838f8f25 not found: ID does not exist" containerID="e324abdab9e679e0f5f689849aa0e0676d839db6f774004a42ae97fb838f8f25"
Sep 11 04:22:01.159710 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:01.159660    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e324abdab9e679e0f5f689849aa0e0676d839db6f774004a42ae97fb838f8f25"} err="failed to get container status \"e324abdab9e679e0f5f689849aa0e0676d839db6f774004a42ae97fb838f8f25\": rpc error: code = NotFound desc = could not find container \"e324abdab9e679e0f5f689849aa0e0676d839db6f774004a42ae97fb838f8f25\": container with ID starting with e324abdab9e679e0f5f689849aa0e0676d839db6f774004a42ae97fb838f8f25 not found: ID does not exist"
Sep 11 04:22:01.160697 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:01.160670    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"]
Sep 11 04:22:01.164011 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:01.163989    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz"]
Sep 11 04:22:01.810669 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:01.810594    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9bd58d6-2292-4751-a941-07b2f4d4355f" path="/var/lib/kubelet/pods/b9bd58d6-2292-4751-a941-07b2f4d4355f/volumes"
Sep 11 04:22:12.507312 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:12.507273    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:22:20.427001 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:20.426965    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc"]
Sep 11 04:22:25.291784 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:25.291749    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:22:35.445634 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:35.445598    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc" podUID="9f810f44-97ba-4c7a-9323-946419e488d1" containerName="main" containerID="cri-o://7ed9dd26588135214a7450d77af7dc4c91b77a5e58a6cf603c511a9f2bae2da0" gracePeriod=45
Sep 11 04:22:35.697419 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:35.697345    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc"
Sep 11 04:22:35.838748 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:35.838720    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f810f44-97ba-4c7a-9323-946419e488d1-home\") pod \"9f810f44-97ba-4c7a-9323-946419e488d1\" (UID: \"9f810f44-97ba-4c7a-9323-946419e488d1\") "
Sep 11 04:22:35.838897 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:35.838754    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mtjz\" (UniqueName: \"kubernetes.io/projected/9f810f44-97ba-4c7a-9323-946419e488d1-kube-api-access-9mtjz\") pod \"9f810f44-97ba-4c7a-9323-946419e488d1\" (UID: \"9f810f44-97ba-4c7a-9323-946419e488d1\") "
Sep 11 04:22:35.838897 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:35.838804    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f810f44-97ba-4c7a-9323-946419e488d1-tmp-dir\") pod \"9f810f44-97ba-4c7a-9323-946419e488d1\" (UID: \"9f810f44-97ba-4c7a-9323-946419e488d1\") "
Sep 11 04:22:35.838897 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:35.838831    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f810f44-97ba-4c7a-9323-946419e488d1-tls-certs\") pod \"9f810f44-97ba-4c7a-9323-946419e488d1\" (UID: \"9f810f44-97ba-4c7a-9323-946419e488d1\") "
Sep 11 04:22:35.838897 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:35.838847    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f810f44-97ba-4c7a-9323-946419e488d1-dshm\") pod \"9f810f44-97ba-4c7a-9323-946419e488d1\" (UID: \"9f810f44-97ba-4c7a-9323-946419e488d1\") "
Sep 11 04:22:35.839113 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:35.838907    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f810f44-97ba-4c7a-9323-946419e488d1-model-cache\") pod \"9f810f44-97ba-4c7a-9323-946419e488d1\" (UID: \"9f810f44-97ba-4c7a-9323-946419e488d1\") "
Sep 11 04:22:35.839113 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:35.838980    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f810f44-97ba-4c7a-9323-946419e488d1-home" (OuterVolumeSpecName: "home") pod "9f810f44-97ba-4c7a-9323-946419e488d1" (UID: "9f810f44-97ba-4c7a-9323-946419e488d1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:22:35.839113 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:35.839057    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f810f44-97ba-4c7a-9323-946419e488d1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9f810f44-97ba-4c7a-9323-946419e488d1" (UID: "9f810f44-97ba-4c7a-9323-946419e488d1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:22:35.839273 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:35.839217    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f810f44-97ba-4c7a-9323-946419e488d1-model-cache" (OuterVolumeSpecName: "model-cache") pod "9f810f44-97ba-4c7a-9323-946419e488d1" (UID: "9f810f44-97ba-4c7a-9323-946419e488d1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:22:35.839273 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:35.839243    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f810f44-97ba-4c7a-9323-946419e488d1-home\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:22:35.839273 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:35.839262    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f810f44-97ba-4c7a-9323-946419e488d1-tmp-dir\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:22:35.840992 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:35.840964    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f810f44-97ba-4c7a-9323-946419e488d1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9f810f44-97ba-4c7a-9323-946419e488d1" (UID: "9f810f44-97ba-4c7a-9323-946419e488d1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:22:35.841101 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:35.841013    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f810f44-97ba-4c7a-9323-946419e488d1-dshm" (OuterVolumeSpecName: "dshm") pod "9f810f44-97ba-4c7a-9323-946419e488d1" (UID: "9f810f44-97ba-4c7a-9323-946419e488d1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:22:35.841101 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:35.841028    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f810f44-97ba-4c7a-9323-946419e488d1-kube-api-access-9mtjz" (OuterVolumeSpecName: "kube-api-access-9mtjz") pod "9f810f44-97ba-4c7a-9323-946419e488d1" (UID: "9f810f44-97ba-4c7a-9323-946419e488d1"). InnerVolumeSpecName "kube-api-access-9mtjz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:22:35.939849 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:35.939826    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f810f44-97ba-4c7a-9323-946419e488d1-tls-certs\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:22:35.939849 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:35.939846    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f810f44-97ba-4c7a-9323-946419e488d1-dshm\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:22:35.939990 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:35.939855    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f810f44-97ba-4c7a-9323-946419e488d1-model-cache\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:22:35.939990 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:35.939864    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mtjz\" (UniqueName: \"kubernetes.io/projected/9f810f44-97ba-4c7a-9323-946419e488d1-kube-api-access-9mtjz\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:22:36.322536 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:36.322503    2558 generic.go:356] "Generic (PLEG): container finished" podID="9f810f44-97ba-4c7a-9323-946419e488d1" containerID="7ed9dd26588135214a7450d77af7dc4c91b77a5e58a6cf603c511a9f2bae2da0" exitCode=0
Sep 11 04:22:36.322715 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:36.322556    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc"
Sep 11 04:22:36.322715 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:36.322553    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc" event={"ID":"9f810f44-97ba-4c7a-9323-946419e488d1","Type":"ContainerDied","Data":"7ed9dd26588135214a7450d77af7dc4c91b77a5e58a6cf603c511a9f2bae2da0"}
Sep 11 04:22:36.322715 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:36.322662    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc" event={"ID":"9f810f44-97ba-4c7a-9323-946419e488d1","Type":"ContainerDied","Data":"69db4cc6f700f510ae6e47de944c26f26e1d70490db277c77d79bb0bbbfebc89"}
Sep 11 04:22:36.322715 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:36.322680    2558 scope.go:117] "RemoveContainer" containerID="7ed9dd26588135214a7450d77af7dc4c91b77a5e58a6cf603c511a9f2bae2da0"
Sep 11 04:22:36.331625 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:36.331607    2558 scope.go:117] "RemoveContainer" containerID="7ed9dd26588135214a7450d77af7dc4c91b77a5e58a6cf603c511a9f2bae2da0"
Sep 11 04:22:36.331882 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:22:36.331862    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ed9dd26588135214a7450d77af7dc4c91b77a5e58a6cf603c511a9f2bae2da0\": container with ID starting with 7ed9dd26588135214a7450d77af7dc4c91b77a5e58a6cf603c511a9f2bae2da0 not found: ID does not exist" containerID="7ed9dd26588135214a7450d77af7dc4c91b77a5e58a6cf603c511a9f2bae2da0"
Sep 11 04:22:36.331939 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:36.331890    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ed9dd26588135214a7450d77af7dc4c91b77a5e58a6cf603c511a9f2bae2da0"} err="failed to get container status \"7ed9dd26588135214a7450d77af7dc4c91b77a5e58a6cf603c511a9f2bae2da0\": rpc error: code = NotFound desc = could not find container \"7ed9dd26588135214a7450d77af7dc4c91b77a5e58a6cf603c511a9f2bae2da0\": container with ID starting with 7ed9dd26588135214a7450d77af7dc4c91b77a5e58a6cf603c511a9f2bae2da0 not found: ID does not exist"
Sep 11 04:22:36.344375 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:36.344350    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc"]
Sep 11 04:22:36.347332 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:36.347308    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-fdc690/ipp-route-fdc690-kserve-5f644568bc-npzgc"]
Sep 11 04:22:37.810195 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:22:37.810163    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f810f44-97ba-4c7a-9323-946419e488d1" path="/var/lib/kubelet/pods/9f810f44-97ba-4c7a-9323-946419e488d1/volumes"
Sep 11 04:23:03.629328 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:03.629278    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"]
Sep 11 04:23:03.629800 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:03.629553    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb" podUID="387ef80d-efa3-4e99-9183-0d4deb7f4239" containerName="istio-proxy" containerID="cri-o://c732dc7884c86d806f7a48f63891eb959bf3c4ab20e8c61e3ee0c90c8bb2fc85" gracePeriod=30
Sep 11 04:23:08.156378 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:08.156340    2558 patch_prober.go:28] interesting pod/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 04:23:08.156843 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:08.156434    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb" podUID="387ef80d-efa3-4e99-9183-0d4deb7f4239" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 04:23:08.877223 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:08.877198    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:23:08.944910 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:08.944831    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/387ef80d-efa3-4e99-9183-0d4deb7f4239-workload-socket\") pod \"387ef80d-efa3-4e99-9183-0d4deb7f4239\" (UID: \"387ef80d-efa3-4e99-9183-0d4deb7f4239\") "
Sep 11 04:23:08.945050 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:08.944915    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/387ef80d-efa3-4e99-9183-0d4deb7f4239-credential-socket\") pod \"387ef80d-efa3-4e99-9183-0d4deb7f4239\" (UID: \"387ef80d-efa3-4e99-9183-0d4deb7f4239\") "
Sep 11 04:23:08.945050 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:08.944935    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/387ef80d-efa3-4e99-9183-0d4deb7f4239-istiod-ca-cert\") pod \"387ef80d-efa3-4e99-9183-0d4deb7f4239\" (UID: \"387ef80d-efa3-4e99-9183-0d4deb7f4239\") "
Sep 11 04:23:08.945050 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:08.944958    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/387ef80d-efa3-4e99-9183-0d4deb7f4239-istio-envoy\") pod \"387ef80d-efa3-4e99-9183-0d4deb7f4239\" (UID: \"387ef80d-efa3-4e99-9183-0d4deb7f4239\") "
Sep 11 04:23:08.945050 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:08.944974    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/387ef80d-efa3-4e99-9183-0d4deb7f4239-istio-token\") pod \"387ef80d-efa3-4e99-9183-0d4deb7f4239\" (UID: \"387ef80d-efa3-4e99-9183-0d4deb7f4239\") "
Sep 11 04:23:08.945291 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:08.945068    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/387ef80d-efa3-4e99-9183-0d4deb7f4239-istio-data\") pod \"387ef80d-efa3-4e99-9183-0d4deb7f4239\" (UID: \"387ef80d-efa3-4e99-9183-0d4deb7f4239\") "
Sep 11 04:23:08.945291 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:08.945124    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fgvw\" (UniqueName: \"kubernetes.io/projected/387ef80d-efa3-4e99-9183-0d4deb7f4239-kube-api-access-4fgvw\") pod \"387ef80d-efa3-4e99-9183-0d4deb7f4239\" (UID: \"387ef80d-efa3-4e99-9183-0d4deb7f4239\") "
Sep 11 04:23:08.945291 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:08.945135    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/387ef80d-efa3-4e99-9183-0d4deb7f4239-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "387ef80d-efa3-4e99-9183-0d4deb7f4239" (UID: "387ef80d-efa3-4e99-9183-0d4deb7f4239"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:23:08.945291 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:08.945170    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/387ef80d-efa3-4e99-9183-0d4deb7f4239-workload-certs\") pod \"387ef80d-efa3-4e99-9183-0d4deb7f4239\" (UID: \"387ef80d-efa3-4e99-9183-0d4deb7f4239\") "
Sep 11 04:23:08.945291 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:08.945202    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/387ef80d-efa3-4e99-9183-0d4deb7f4239-istio-podinfo\") pod \"387ef80d-efa3-4e99-9183-0d4deb7f4239\" (UID: \"387ef80d-efa3-4e99-9183-0d4deb7f4239\") "
Sep 11 04:23:08.945291 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:08.945269    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/387ef80d-efa3-4e99-9183-0d4deb7f4239-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "387ef80d-efa3-4e99-9183-0d4deb7f4239" (UID: "387ef80d-efa3-4e99-9183-0d4deb7f4239"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:23:08.945634 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:08.945315    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/387ef80d-efa3-4e99-9183-0d4deb7f4239-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "387ef80d-efa3-4e99-9183-0d4deb7f4239" (UID: "387ef80d-efa3-4e99-9183-0d4deb7f4239"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:23:08.945634 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:08.945351    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/387ef80d-efa3-4e99-9183-0d4deb7f4239-istio-data" (OuterVolumeSpecName: "istio-data") pod "387ef80d-efa3-4e99-9183-0d4deb7f4239" (UID: "387ef80d-efa3-4e99-9183-0d4deb7f4239"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:23:08.945634 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:08.945568    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/387ef80d-efa3-4e99-9183-0d4deb7f4239-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "387ef80d-efa3-4e99-9183-0d4deb7f4239" (UID: "387ef80d-efa3-4e99-9183-0d4deb7f4239"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:23:08.946680 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:08.946085    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/387ef80d-efa3-4e99-9183-0d4deb7f4239-workload-certs\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:23:08.946680 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:08.946110    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/387ef80d-efa3-4e99-9183-0d4deb7f4239-workload-socket\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:23:08.946680 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:08.946124    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/387ef80d-efa3-4e99-9183-0d4deb7f4239-credential-socket\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:23:08.946680 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:08.946137    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/387ef80d-efa3-4e99-9183-0d4deb7f4239-istiod-ca-cert\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:23:08.946680 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:08.946150    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/387ef80d-efa3-4e99-9183-0d4deb7f4239-istio-data\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:23:08.947541 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:08.947520    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/387ef80d-efa3-4e99-9183-0d4deb7f4239-kube-api-access-4fgvw" (OuterVolumeSpecName: "kube-api-access-4fgvw") pod "387ef80d-efa3-4e99-9183-0d4deb7f4239" (UID: "387ef80d-efa3-4e99-9183-0d4deb7f4239"). InnerVolumeSpecName "kube-api-access-4fgvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:23:08.947703 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:08.947677    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/387ef80d-efa3-4e99-9183-0d4deb7f4239-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "387ef80d-efa3-4e99-9183-0d4deb7f4239" (UID: "387ef80d-efa3-4e99-9183-0d4deb7f4239"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 04:23:08.947703 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:08.947685    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/387ef80d-efa3-4e99-9183-0d4deb7f4239-istio-token" (OuterVolumeSpecName: "istio-token") pod "387ef80d-efa3-4e99-9183-0d4deb7f4239" (UID: "387ef80d-efa3-4e99-9183-0d4deb7f4239"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:23:08.948201 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:08.948184    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/387ef80d-efa3-4e99-9183-0d4deb7f4239-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "387ef80d-efa3-4e99-9183-0d4deb7f4239" (UID: "387ef80d-efa3-4e99-9183-0d4deb7f4239"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:23:09.046946 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:09.046909    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/387ef80d-efa3-4e99-9183-0d4deb7f4239-istio-envoy\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:23:09.046946 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:09.046939    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/387ef80d-efa3-4e99-9183-0d4deb7f4239-istio-token\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:23:09.046946 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:09.046950    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fgvw\" (UniqueName: \"kubernetes.io/projected/387ef80d-efa3-4e99-9183-0d4deb7f4239-kube-api-access-4fgvw\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:23:09.047182 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:09.046960    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/387ef80d-efa3-4e99-9183-0d4deb7f4239-istio-podinfo\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:23:09.500164 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:09.500126    2558 generic.go:356] "Generic (PLEG): container finished" podID="387ef80d-efa3-4e99-9183-0d4deb7f4239" containerID="c732dc7884c86d806f7a48f63891eb959bf3c4ab20e8c61e3ee0c90c8bb2fc85" exitCode=0
Sep 11 04:23:09.500667 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:09.500173    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"
Sep 11 04:23:09.500667 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:09.500210    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb" event={"ID":"387ef80d-efa3-4e99-9183-0d4deb7f4239","Type":"ContainerDied","Data":"c732dc7884c86d806f7a48f63891eb959bf3c4ab20e8c61e3ee0c90c8bb2fc85"}
Sep 11 04:23:09.500667 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:09.500264    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb" event={"ID":"387ef80d-efa3-4e99-9183-0d4deb7f4239","Type":"ContainerDied","Data":"915fb0f6244d658bf8fb3eb4d0fb1e80fb55aae0c788d2317e21ddc5f74dffe9"}
Sep 11 04:23:09.500667 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:09.500290    2558 scope.go:117] "RemoveContainer" containerID="c732dc7884c86d806f7a48f63891eb959bf3c4ab20e8c61e3ee0c90c8bb2fc85"
Sep 11 04:23:09.510747 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:09.510718    2558 scope.go:117] "RemoveContainer" containerID="e01b81ee7e0a916bc3b88df8a5d79460f5f1f960caa4a5d7d552b614f2bf28be"
Sep 11 04:23:09.518963 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:09.518945    2558 scope.go:117] "RemoveContainer" containerID="c732dc7884c86d806f7a48f63891eb959bf3c4ab20e8c61e3ee0c90c8bb2fc85"
Sep 11 04:23:09.519228 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:23:09.519212    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c732dc7884c86d806f7a48f63891eb959bf3c4ab20e8c61e3ee0c90c8bb2fc85\": container with ID starting with c732dc7884c86d806f7a48f63891eb959bf3c4ab20e8c61e3ee0c90c8bb2fc85 not found: ID does not exist" containerID="c732dc7884c86d806f7a48f63891eb959bf3c4ab20e8c61e3ee0c90c8bb2fc85"
Sep 11 04:23:09.519274 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:09.519237    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c732dc7884c86d806f7a48f63891eb959bf3c4ab20e8c61e3ee0c90c8bb2fc85"} err="failed to get container status \"c732dc7884c86d806f7a48f63891eb959bf3c4ab20e8c61e3ee0c90c8bb2fc85\": rpc error: code = NotFound desc = could not find container \"c732dc7884c86d806f7a48f63891eb959bf3c4ab20e8c61e3ee0c90c8bb2fc85\": container with ID starting with c732dc7884c86d806f7a48f63891eb959bf3c4ab20e8c61e3ee0c90c8bb2fc85 not found: ID does not exist"
Sep 11 04:23:09.519274 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:09.519252    2558 scope.go:117] "RemoveContainer" containerID="e01b81ee7e0a916bc3b88df8a5d79460f5f1f960caa4a5d7d552b614f2bf28be"
Sep 11 04:23:09.519532 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:23:09.519507    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e01b81ee7e0a916bc3b88df8a5d79460f5f1f960caa4a5d7d552b614f2bf28be\": container with ID starting with e01b81ee7e0a916bc3b88df8a5d79460f5f1f960caa4a5d7d552b614f2bf28be not found: ID does not exist" containerID="e01b81ee7e0a916bc3b88df8a5d79460f5f1f960caa4a5d7d552b614f2bf28be"
Sep 11 04:23:09.519619 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:09.519537    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e01b81ee7e0a916bc3b88df8a5d79460f5f1f960caa4a5d7d552b614f2bf28be"} err="failed to get container status \"e01b81ee7e0a916bc3b88df8a5d79460f5f1f960caa4a5d7d552b614f2bf28be\": rpc error: code = NotFound desc = could not find container \"e01b81ee7e0a916bc3b88df8a5d79460f5f1f960caa4a5d7d552b614f2bf28be\": container with ID starting with e01b81ee7e0a916bc3b88df8a5d79460f5f1f960caa4a5d7d552b614f2bf28be not found: ID does not exist"
Sep 11 04:23:09.524544 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:09.524522    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"]
Sep 11 04:23:09.528614 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:09.528593    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb"]
Sep 11 04:23:09.809645 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:09.809570    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="387ef80d-efa3-4e99-9183-0d4deb7f4239" path="/var/lib/kubelet/pods/387ef80d-efa3-4e99-9183-0d4deb7f4239/volumes"
Sep 11 04:23:18.006715 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:18.006626    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:23:21.185357 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:21.185318    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"]
Sep 11 04:23:21.185732 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:21.185658    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4" podUID="c089ec66-cfe2-47cb-b56f-bd390109f572" containerName="istio-proxy" containerID="cri-o://29dbc15c504814b84dc4e13c9faa8f853ca8290d975cabdc5946301de0f9bd7b" gracePeriod=30
Sep 11 04:23:21.735069 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:21.735029    2558 patch_prober.go:28] interesting pod/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 04:23:21.735241 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:21.735127    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4" podUID="c089ec66-cfe2-47cb-b56f-bd390109f572" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 04:23:23.906624 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:23.906581    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nfssn_c9add74a-5c51-4ccf-9edd-3b90a66b9ef9/ovn-acl-logging/0.log"
Sep 11 04:23:23.908992 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:23.908974    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nfssn_c9add74a-5c51-4ccf-9edd-3b90a66b9ef9/ovn-acl-logging/0.log"
Sep 11 04:23:26.446612 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.446540    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:23:26.517359 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.517321    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvvsd\" (UniqueName: \"kubernetes.io/projected/c089ec66-cfe2-47cb-b56f-bd390109f572-kube-api-access-bvvsd\") pod \"c089ec66-cfe2-47cb-b56f-bd390109f572\" (UID: \"c089ec66-cfe2-47cb-b56f-bd390109f572\") "
Sep 11 04:23:26.517535 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.517463    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c089ec66-cfe2-47cb-b56f-bd390109f572-istio-data\") pod \"c089ec66-cfe2-47cb-b56f-bd390109f572\" (UID: \"c089ec66-cfe2-47cb-b56f-bd390109f572\") "
Sep 11 04:23:26.517535 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.517485    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c089ec66-cfe2-47cb-b56f-bd390109f572-istiod-ca-cert\") pod \"c089ec66-cfe2-47cb-b56f-bd390109f572\" (UID: \"c089ec66-cfe2-47cb-b56f-bd390109f572\") "
Sep 11 04:23:26.517535 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.517503    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c089ec66-cfe2-47cb-b56f-bd390109f572-workload-socket\") pod \"c089ec66-cfe2-47cb-b56f-bd390109f572\" (UID: \"c089ec66-cfe2-47cb-b56f-bd390109f572\") "
Sep 11 04:23:26.517728 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.517560    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c089ec66-cfe2-47cb-b56f-bd390109f572-istio-token\") pod \"c089ec66-cfe2-47cb-b56f-bd390109f572\" (UID: \"c089ec66-cfe2-47cb-b56f-bd390109f572\") "
Sep 11 04:23:26.517728 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.517599    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c089ec66-cfe2-47cb-b56f-bd390109f572-istio-podinfo\") pod \"c089ec66-cfe2-47cb-b56f-bd390109f572\" (UID: \"c089ec66-cfe2-47cb-b56f-bd390109f572\") "
Sep 11 04:23:26.517728 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.517650    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c089ec66-cfe2-47cb-b56f-bd390109f572-istio-envoy\") pod \"c089ec66-cfe2-47cb-b56f-bd390109f572\" (UID: \"c089ec66-cfe2-47cb-b56f-bd390109f572\") "
Sep 11 04:23:26.517728 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.517688    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c089ec66-cfe2-47cb-b56f-bd390109f572-credential-socket\") pod \"c089ec66-cfe2-47cb-b56f-bd390109f572\" (UID: \"c089ec66-cfe2-47cb-b56f-bd390109f572\") "
Sep 11 04:23:26.517728 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.517719    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c089ec66-cfe2-47cb-b56f-bd390109f572-workload-certs\") pod \"c089ec66-cfe2-47cb-b56f-bd390109f572\" (UID: \"c089ec66-cfe2-47cb-b56f-bd390109f572\") "
Sep 11 04:23:26.517977 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.517809    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c089ec66-cfe2-47cb-b56f-bd390109f572-istio-data" (OuterVolumeSpecName: "istio-data") pod "c089ec66-cfe2-47cb-b56f-bd390109f572" (UID: "c089ec66-cfe2-47cb-b56f-bd390109f572"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:23:26.517977 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.517832    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c089ec66-cfe2-47cb-b56f-bd390109f572-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c089ec66-cfe2-47cb-b56f-bd390109f572" (UID: "c089ec66-cfe2-47cb-b56f-bd390109f572"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:23:26.517977 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.517899    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c089ec66-cfe2-47cb-b56f-bd390109f572-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c089ec66-cfe2-47cb-b56f-bd390109f572" (UID: "c089ec66-cfe2-47cb-b56f-bd390109f572"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:23:26.518128 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.518086    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c089ec66-cfe2-47cb-b56f-bd390109f572-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c089ec66-cfe2-47cb-b56f-bd390109f572" (UID: "c089ec66-cfe2-47cb-b56f-bd390109f572"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:23:26.518128 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.518091    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c089ec66-cfe2-47cb-b56f-bd390109f572-istio-data\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:23:26.518232 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.518133    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c089ec66-cfe2-47cb-b56f-bd390109f572-istiod-ca-cert\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:23:26.518232 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.518147    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c089ec66-cfe2-47cb-b56f-bd390109f572-workload-socket\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:23:26.518335 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.518297    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c089ec66-cfe2-47cb-b56f-bd390109f572-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c089ec66-cfe2-47cb-b56f-bd390109f572" (UID: "c089ec66-cfe2-47cb-b56f-bd390109f572"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:23:26.519817 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.519780    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c089ec66-cfe2-47cb-b56f-bd390109f572-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c089ec66-cfe2-47cb-b56f-bd390109f572" (UID: "c089ec66-cfe2-47cb-b56f-bd390109f572"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 04:23:26.519915 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.519825    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c089ec66-cfe2-47cb-b56f-bd390109f572-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c089ec66-cfe2-47cb-b56f-bd390109f572" (UID: "c089ec66-cfe2-47cb-b56f-bd390109f572"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:23:26.520099 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.520072    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c089ec66-cfe2-47cb-b56f-bd390109f572-kube-api-access-bvvsd" (OuterVolumeSpecName: "kube-api-access-bvvsd") pod "c089ec66-cfe2-47cb-b56f-bd390109f572" (UID: "c089ec66-cfe2-47cb-b56f-bd390109f572"). InnerVolumeSpecName "kube-api-access-bvvsd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:23:26.520196 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.520072    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c089ec66-cfe2-47cb-b56f-bd390109f572-istio-token" (OuterVolumeSpecName: "istio-token") pod "c089ec66-cfe2-47cb-b56f-bd390109f572" (UID: "c089ec66-cfe2-47cb-b56f-bd390109f572"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:23:26.594697 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.594659    2558 generic.go:356] "Generic (PLEG): container finished" podID="c089ec66-cfe2-47cb-b56f-bd390109f572" containerID="29dbc15c504814b84dc4e13c9faa8f853ca8290d975cabdc5946301de0f9bd7b" exitCode=0
Sep 11 04:23:26.594868 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.594713    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"
Sep 11 04:23:26.594868 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.594742    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4" event={"ID":"c089ec66-cfe2-47cb-b56f-bd390109f572","Type":"ContainerDied","Data":"29dbc15c504814b84dc4e13c9faa8f853ca8290d975cabdc5946301de0f9bd7b"}
Sep 11 04:23:26.594868 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.594803    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4" event={"ID":"c089ec66-cfe2-47cb-b56f-bd390109f572","Type":"ContainerDied","Data":"6bafec16a5af367ffb28b43f2fcf24ca4909a9ebe781e6f6ceb9187a37cf14ae"}
Sep 11 04:23:26.594868 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.594825    2558 scope.go:117] "RemoveContainer" containerID="29dbc15c504814b84dc4e13c9faa8f853ca8290d975cabdc5946301de0f9bd7b"
Sep 11 04:23:26.604449 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.604427    2558 scope.go:117] "RemoveContainer" containerID="53a785fa280c7c0667dbaf959298eb96f34941a54ab9cb810433a99dd3090ef6"
Sep 11 04:23:26.613580 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.613551    2558 scope.go:117] "RemoveContainer" containerID="29dbc15c504814b84dc4e13c9faa8f853ca8290d975cabdc5946301de0f9bd7b"
Sep 11 04:23:26.614002 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:23:26.613976    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29dbc15c504814b84dc4e13c9faa8f853ca8290d975cabdc5946301de0f9bd7b\": container with ID starting with 29dbc15c504814b84dc4e13c9faa8f853ca8290d975cabdc5946301de0f9bd7b not found: ID does not exist" containerID="29dbc15c504814b84dc4e13c9faa8f853ca8290d975cabdc5946301de0f9bd7b"
Sep 11 04:23:26.614095 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.614012    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29dbc15c504814b84dc4e13c9faa8f853ca8290d975cabdc5946301de0f9bd7b"} err="failed to get container status \"29dbc15c504814b84dc4e13c9faa8f853ca8290d975cabdc5946301de0f9bd7b\": rpc error: code = NotFound desc = could not find container \"29dbc15c504814b84dc4e13c9faa8f853ca8290d975cabdc5946301de0f9bd7b\": container with ID starting with 29dbc15c504814b84dc4e13c9faa8f853ca8290d975cabdc5946301de0f9bd7b not found: ID does not exist"
Sep 11 04:23:26.614095 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.614056    2558 scope.go:117] "RemoveContainer" containerID="53a785fa280c7c0667dbaf959298eb96f34941a54ab9cb810433a99dd3090ef6"
Sep 11 04:23:26.614639 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:23:26.614530    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53a785fa280c7c0667dbaf959298eb96f34941a54ab9cb810433a99dd3090ef6\": container with ID starting with 53a785fa280c7c0667dbaf959298eb96f34941a54ab9cb810433a99dd3090ef6 not found: ID does not exist" containerID="53a785fa280c7c0667dbaf959298eb96f34941a54ab9cb810433a99dd3090ef6"
Sep 11 04:23:26.614639 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.614568    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53a785fa280c7c0667dbaf959298eb96f34941a54ab9cb810433a99dd3090ef6"} err="failed to get container status \"53a785fa280c7c0667dbaf959298eb96f34941a54ab9cb810433a99dd3090ef6\": rpc error: code = NotFound desc = could not find container \"53a785fa280c7c0667dbaf959298eb96f34941a54ab9cb810433a99dd3090ef6\": container with ID starting with 53a785fa280c7c0667dbaf959298eb96f34941a54ab9cb810433a99dd3090ef6 not found: ID does not exist"
Sep 11 04:23:26.617857 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.617828    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"]
Sep 11 04:23:26.618848 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.618787    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c089ec66-cfe2-47cb-b56f-bd390109f572-istio-envoy\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:23:26.618848 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.618819    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c089ec66-cfe2-47cb-b56f-bd390109f572-credential-socket\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:23:26.618848 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.618836    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c089ec66-cfe2-47cb-b56f-bd390109f572-workload-certs\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:23:26.618848 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.618852    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvvsd\" (UniqueName: \"kubernetes.io/projected/c089ec66-cfe2-47cb-b56f-bd390109f572-kube-api-access-bvvsd\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:23:26.619136 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.618865    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c089ec66-cfe2-47cb-b56f-bd390109f572-istio-token\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:23:26.619136 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.618876    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c089ec66-cfe2-47cb-b56f-bd390109f572-istio-podinfo\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:23:26.621428 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:26.621406    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4"]
Sep 11 04:23:27.809595 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:27.809561    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c089ec66-cfe2-47cb-b56f-bd390109f572" path="/var/lib/kubelet/pods/c089ec66-cfe2-47cb-b56f-bd390109f572/volumes"
Sep 11 04:23:35.105777 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:35.105741    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:23:49.576950 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:49.576914    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl"]
Sep 11 04:23:49.577784 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:49.577722    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl" podUID="2b95ca31-ad4e-416c-8d6e-d547fd806734" containerName="maas-api" containerID="cri-o://e6102fddada8a728552a1df56af6b67faedf977d9dde55aa0234d396a218277b" gracePeriod=30
Sep 11 04:23:49.728292 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:49.728258    2558 generic.go:356] "Generic (PLEG): container finished" podID="2b95ca31-ad4e-416c-8d6e-d547fd806734" containerID="e6102fddada8a728552a1df56af6b67faedf977d9dde55aa0234d396a218277b" exitCode=0
Sep 11 04:23:49.728449 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:49.728325    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl" event={"ID":"2b95ca31-ad4e-416c-8d6e-d547fd806734","Type":"ContainerDied","Data":"e6102fddada8a728552a1df56af6b67faedf977d9dde55aa0234d396a218277b"}
Sep 11 04:23:49.834848 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:49.834825    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl"
Sep 11 04:23:49.931316 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:49.931287    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b95ca31-ad4e-416c-8d6e-d547fd806734-metrics-certs\") pod \"2b95ca31-ad4e-416c-8d6e-d547fd806734\" (UID: \"2b95ca31-ad4e-416c-8d6e-d547fd806734\") "
Sep 11 04:23:49.931502 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:49.931331    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlqm9\" (UniqueName: \"kubernetes.io/projected/2b95ca31-ad4e-416c-8d6e-d547fd806734-kube-api-access-vlqm9\") pod \"2b95ca31-ad4e-416c-8d6e-d547fd806734\" (UID: \"2b95ca31-ad4e-416c-8d6e-d547fd806734\") "
Sep 11 04:23:49.931502 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:49.931352    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b95ca31-ad4e-416c-8d6e-d547fd806734-maas-api-tls\") pod \"2b95ca31-ad4e-416c-8d6e-d547fd806734\" (UID: \"2b95ca31-ad4e-416c-8d6e-d547fd806734\") "
Sep 11 04:23:49.931502 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:49.931379    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b95ca31-ad4e-416c-8d6e-d547fd806734-openshift-service-ca\") pod \"2b95ca31-ad4e-416c-8d6e-d547fd806734\" (UID: \"2b95ca31-ad4e-416c-8d6e-d547fd806734\") "
Sep 11 04:23:49.931821 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:49.931776    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b95ca31-ad4e-416c-8d6e-d547fd806734-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2b95ca31-ad4e-416c-8d6e-d547fd806734" (UID: "2b95ca31-ad4e-416c-8d6e-d547fd806734"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:23:49.933589 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:49.933561    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b95ca31-ad4e-416c-8d6e-d547fd806734-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2b95ca31-ad4e-416c-8d6e-d547fd806734" (UID: "2b95ca31-ad4e-416c-8d6e-d547fd806734"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:23:49.933791 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:49.933757    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b95ca31-ad4e-416c-8d6e-d547fd806734-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2b95ca31-ad4e-416c-8d6e-d547fd806734" (UID: "2b95ca31-ad4e-416c-8d6e-d547fd806734"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:23:49.933902 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:49.933811    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b95ca31-ad4e-416c-8d6e-d547fd806734-kube-api-access-vlqm9" (OuterVolumeSpecName: "kube-api-access-vlqm9") pod "2b95ca31-ad4e-416c-8d6e-d547fd806734" (UID: "2b95ca31-ad4e-416c-8d6e-d547fd806734"). InnerVolumeSpecName "kube-api-access-vlqm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:23:50.032510 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:50.032474    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b95ca31-ad4e-416c-8d6e-d547fd806734-metrics-certs\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:23:50.032510 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:50.032506    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlqm9\" (UniqueName: \"kubernetes.io/projected/2b95ca31-ad4e-416c-8d6e-d547fd806734-kube-api-access-vlqm9\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:23:50.032719 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:50.032520    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b95ca31-ad4e-416c-8d6e-d547fd806734-maas-api-tls\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:23:50.032719 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:50.032532    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b95ca31-ad4e-416c-8d6e-d547fd806734-openshift-service-ca\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:23:50.735634 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:50.735592    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl" event={"ID":"2b95ca31-ad4e-416c-8d6e-d547fd806734","Type":"ContainerDied","Data":"d2c81d51124c9e13127908be3ed55b8035526249eca3968cf3910e07bdd291bd"}
Sep 11 04:23:50.735634 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:50.735619    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl"
Sep 11 04:23:50.736128 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:50.735654    2558 scope.go:117] "RemoveContainer" containerID="e6102fddada8a728552a1df56af6b67faedf977d9dde55aa0234d396a218277b"
Sep 11 04:23:50.758874 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:50.758850    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl"]
Sep 11 04:23:50.764219 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:50.764197    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9342ed-5f7bb76456-5sjzl"]
Sep 11 04:23:51.809238 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:51.809206    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b95ca31-ad4e-416c-8d6e-d547fd806734" path="/var/lib/kubelet/pods/2b95ca31-ad4e-416c-8d6e-d547fd806734/volumes"
Sep 11 04:23:52.293373 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:52.293335    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:23:59.227828 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:59.227792    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-645ff58b69-sb66g"]
Sep 11 04:23:59.228262 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:59.228016    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-645ff58b69-sb66g" podUID="e002994b-a1b3-43cb-82d5-709df14bd3b1" containerName="manager" containerID="cri-o://b81f281a38ff847e6426ad66e0b1a0a8fcfdd0c0efd7bfd8bfd1ae81a2c66384" gracePeriod=30
Sep 11 04:23:59.478930 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:59.478873    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-645ff58b69-sb66g"
Sep 11 04:23:59.617975 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:59.617947    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcpcf\" (UniqueName: \"kubernetes.io/projected/e002994b-a1b3-43cb-82d5-709df14bd3b1-kube-api-access-dcpcf\") pod \"e002994b-a1b3-43cb-82d5-709df14bd3b1\" (UID: \"e002994b-a1b3-43cb-82d5-709df14bd3b1\") "
Sep 11 04:23:59.618107 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:59.618032    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e002994b-a1b3-43cb-82d5-709df14bd3b1-metrics-certs\") pod \"e002994b-a1b3-43cb-82d5-709df14bd3b1\" (UID: \"e002994b-a1b3-43cb-82d5-709df14bd3b1\") "
Sep 11 04:23:59.618107 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:59.618073    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e002994b-a1b3-43cb-82d5-709df14bd3b1-webhook-cert\") pod \"e002994b-a1b3-43cb-82d5-709df14bd3b1\" (UID: \"e002994b-a1b3-43cb-82d5-709df14bd3b1\") "
Sep 11 04:23:59.620054 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:59.620029    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e002994b-a1b3-43cb-82d5-709df14bd3b1-kube-api-access-dcpcf" (OuterVolumeSpecName: "kube-api-access-dcpcf") pod "e002994b-a1b3-43cb-82d5-709df14bd3b1" (UID: "e002994b-a1b3-43cb-82d5-709df14bd3b1"). InnerVolumeSpecName "kube-api-access-dcpcf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:23:59.620170 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:59.620061    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e002994b-a1b3-43cb-82d5-709df14bd3b1-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e002994b-a1b3-43cb-82d5-709df14bd3b1" (UID: "e002994b-a1b3-43cb-82d5-709df14bd3b1"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:23:59.620170 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:59.620088    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e002994b-a1b3-43cb-82d5-709df14bd3b1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e002994b-a1b3-43cb-82d5-709df14bd3b1" (UID: "e002994b-a1b3-43cb-82d5-709df14bd3b1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:23:59.719161 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:59.719126    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e002994b-a1b3-43cb-82d5-709df14bd3b1-metrics-certs\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:23:59.719161 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:59.719155    2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e002994b-a1b3-43cb-82d5-709df14bd3b1-webhook-cert\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:23:59.719161 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:59.719164    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcpcf\" (UniqueName: \"kubernetes.io/projected/e002994b-a1b3-43cb-82d5-709df14bd3b1-kube-api-access-dcpcf\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:23:59.787489 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:59.787399    2558 generic.go:356] "Generic (PLEG): container finished" podID="e002994b-a1b3-43cb-82d5-709df14bd3b1" containerID="b81f281a38ff847e6426ad66e0b1a0a8fcfdd0c0efd7bfd8bfd1ae81a2c66384" exitCode=0
Sep 11 04:23:59.787489 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:59.787442    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-645ff58b69-sb66g"
Sep 11 04:23:59.787489 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:59.787473    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-645ff58b69-sb66g" event={"ID":"e002994b-a1b3-43cb-82d5-709df14bd3b1","Type":"ContainerDied","Data":"b81f281a38ff847e6426ad66e0b1a0a8fcfdd0c0efd7bfd8bfd1ae81a2c66384"}
Sep 11 04:23:59.787733 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:59.787517    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-645ff58b69-sb66g" event={"ID":"e002994b-a1b3-43cb-82d5-709df14bd3b1","Type":"ContainerDied","Data":"a551b9d7b4ce3399944b16c32d9af5813ddf3c12623a374ef261e221c20394db"}
Sep 11 04:23:59.787733 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:59.787541    2558 scope.go:117] "RemoveContainer" containerID="b81f281a38ff847e6426ad66e0b1a0a8fcfdd0c0efd7bfd8bfd1ae81a2c66384"
Sep 11 04:23:59.796878 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:59.796855    2558 scope.go:117] "RemoveContainer" containerID="b81f281a38ff847e6426ad66e0b1a0a8fcfdd0c0efd7bfd8bfd1ae81a2c66384"
Sep 11 04:23:59.797143 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:23:59.797123    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b81f281a38ff847e6426ad66e0b1a0a8fcfdd0c0efd7bfd8bfd1ae81a2c66384\": container with ID starting with b81f281a38ff847e6426ad66e0b1a0a8fcfdd0c0efd7bfd8bfd1ae81a2c66384 not found: ID does not exist" containerID="b81f281a38ff847e6426ad66e0b1a0a8fcfdd0c0efd7bfd8bfd1ae81a2c66384"
Sep 11 04:23:59.797195 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:59.797151    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b81f281a38ff847e6426ad66e0b1a0a8fcfdd0c0efd7bfd8bfd1ae81a2c66384"} err="failed to get container status \"b81f281a38ff847e6426ad66e0b1a0a8fcfdd0c0efd7bfd8bfd1ae81a2c66384\": rpc error: code = NotFound desc = could not find container \"b81f281a38ff847e6426ad66e0b1a0a8fcfdd0c0efd7bfd8bfd1ae81a2c66384\": container with ID starting with b81f281a38ff847e6426ad66e0b1a0a8fcfdd0c0efd7bfd8bfd1ae81a2c66384 not found: ID does not exist"
Sep 11 04:23:59.810476 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:59.810452    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-645ff58b69-sb66g"]
Sep 11 04:23:59.813703 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:23:59.813681    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-645ff58b69-sb66g"]
Sep 11 04:24:01.394359 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:24:01.394326    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:24:01.810196 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:24:01.810130    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e002994b-a1b3-43cb-82d5-709df14bd3b1" path="/var/lib/kubelet/pods/e002994b-a1b3-43cb-82d5-709df14bd3b1/volumes"
Sep 11 04:25:23.104326 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:23.104286    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:25:24.552372 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.552335    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-645ff58b69-fxmnn"]
Sep 11 04:25:24.552808 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.552785    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c089ec66-cfe2-47cb-b56f-bd390109f572" containerName="istio-proxy"
Sep 11 04:25:24.552863 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.552811    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c089ec66-cfe2-47cb-b56f-bd390109f572" containerName="istio-proxy"
Sep 11 04:25:24.552863 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.552827    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="387ef80d-efa3-4e99-9183-0d4deb7f4239" containerName="istio-proxy"
Sep 11 04:25:24.552863 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.552836    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="387ef80d-efa3-4e99-9183-0d4deb7f4239" containerName="istio-proxy"
Sep 11 04:25:24.552863 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.552847    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c089ec66-cfe2-47cb-b56f-bd390109f572" containerName="istio-proxy"
Sep 11 04:25:24.552863 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.552855    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c089ec66-cfe2-47cb-b56f-bd390109f572" containerName="istio-proxy"
Sep 11 04:25:24.553035 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.552873    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f810f44-97ba-4c7a-9323-946419e488d1" containerName="main"
Sep 11 04:25:24.553035 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.552879    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f810f44-97ba-4c7a-9323-946419e488d1" containerName="main"
Sep 11 04:25:24.553035 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.552888    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9bd58d6-2292-4751-a941-07b2f4d4355f" containerName="istio-proxy"
Sep 11 04:25:24.553035 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.552893    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9bd58d6-2292-4751-a941-07b2f4d4355f" containerName="istio-proxy"
Sep 11 04:25:24.553035 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.552900    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b95ca31-ad4e-416c-8d6e-d547fd806734" containerName="maas-api"
Sep 11 04:25:24.553035 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.552904    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b95ca31-ad4e-416c-8d6e-d547fd806734" containerName="maas-api"
Sep 11 04:25:24.553035 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.552914    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e002994b-a1b3-43cb-82d5-709df14bd3b1" containerName="manager"
Sep 11 04:25:24.553035 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.552920    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e002994b-a1b3-43cb-82d5-709df14bd3b1" containerName="manager"
Sep 11 04:25:24.553035 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.552930    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9bd58d6-2292-4751-a941-07b2f4d4355f" containerName="istio-proxy"
Sep 11 04:25:24.553035 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.552935    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9bd58d6-2292-4751-a941-07b2f4d4355f" containerName="istio-proxy"
Sep 11 04:25:24.553035 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.553003    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f810f44-97ba-4c7a-9323-946419e488d1" containerName="main"
Sep 11 04:25:24.553035 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.553012    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="387ef80d-efa3-4e99-9183-0d4deb7f4239" containerName="istio-proxy"
Sep 11 04:25:24.553035 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.553018    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c089ec66-cfe2-47cb-b56f-bd390109f572" containerName="istio-proxy"
Sep 11 04:25:24.553035 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.553023    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9bd58d6-2292-4751-a941-07b2f4d4355f" containerName="istio-proxy"
Sep 11 04:25:24.553035 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.553028    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9bd58d6-2292-4751-a941-07b2f4d4355f" containerName="istio-proxy"
Sep 11 04:25:24.553035 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.553033    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e002994b-a1b3-43cb-82d5-709df14bd3b1" containerName="manager"
Sep 11 04:25:24.553035 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.553041    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="387ef80d-efa3-4e99-9183-0d4deb7f4239" containerName="istio-proxy"
Sep 11 04:25:24.553558 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.553047    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b95ca31-ad4e-416c-8d6e-d547fd806734" containerName="maas-api"
Sep 11 04:25:24.556197 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.556180    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-645ff58b69-fxmnn"
Sep 11 04:25:24.559729 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.559702    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 04:25:24.559729 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.559707    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qwhqf\""
Sep 11 04:25:24.559929 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.559749    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 04:25:24.559929 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.559757    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 04:25:24.565457 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.565435    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-645ff58b69-fxmnn"]
Sep 11 04:25:24.669598 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.669564    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4zrb\" (UniqueName: \"kubernetes.io/projected/eb1053a0-655f-4368-9a43-4639175eb878-kube-api-access-j4zrb\") pod \"maas-controller-645ff58b69-fxmnn\" (UID: \"eb1053a0-655f-4368-9a43-4639175eb878\") " pod="opendatahub/maas-controller-645ff58b69-fxmnn"
Sep 11 04:25:24.669818 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.669606    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb1053a0-655f-4368-9a43-4639175eb878-webhook-cert\") pod \"maas-controller-645ff58b69-fxmnn\" (UID: \"eb1053a0-655f-4368-9a43-4639175eb878\") " pod="opendatahub/maas-controller-645ff58b69-fxmnn"
Sep 11 04:25:24.669818 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.669668    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb1053a0-655f-4368-9a43-4639175eb878-metrics-certs\") pod \"maas-controller-645ff58b69-fxmnn\" (UID: \"eb1053a0-655f-4368-9a43-4639175eb878\") " pod="opendatahub/maas-controller-645ff58b69-fxmnn"
Sep 11 04:25:24.770748 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.770710    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4zrb\" (UniqueName: \"kubernetes.io/projected/eb1053a0-655f-4368-9a43-4639175eb878-kube-api-access-j4zrb\") pod \"maas-controller-645ff58b69-fxmnn\" (UID: \"eb1053a0-655f-4368-9a43-4639175eb878\") " pod="opendatahub/maas-controller-645ff58b69-fxmnn"
Sep 11 04:25:24.770748 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.770754    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb1053a0-655f-4368-9a43-4639175eb878-webhook-cert\") pod \"maas-controller-645ff58b69-fxmnn\" (UID: \"eb1053a0-655f-4368-9a43-4639175eb878\") " pod="opendatahub/maas-controller-645ff58b69-fxmnn"
Sep 11 04:25:24.770968 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.770867    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb1053a0-655f-4368-9a43-4639175eb878-metrics-certs\") pod \"maas-controller-645ff58b69-fxmnn\" (UID: \"eb1053a0-655f-4368-9a43-4639175eb878\") " pod="opendatahub/maas-controller-645ff58b69-fxmnn"
Sep 11 04:25:24.773357 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.773324    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb1053a0-655f-4368-9a43-4639175eb878-webhook-cert\") pod \"maas-controller-645ff58b69-fxmnn\" (UID: \"eb1053a0-655f-4368-9a43-4639175eb878\") " pod="opendatahub/maas-controller-645ff58b69-fxmnn"
Sep 11 04:25:24.773501 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.773421    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb1053a0-655f-4368-9a43-4639175eb878-metrics-certs\") pod \"maas-controller-645ff58b69-fxmnn\" (UID: \"eb1053a0-655f-4368-9a43-4639175eb878\") " pod="opendatahub/maas-controller-645ff58b69-fxmnn"
Sep 11 04:25:24.778987 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.778963    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4zrb\" (UniqueName: \"kubernetes.io/projected/eb1053a0-655f-4368-9a43-4639175eb878-kube-api-access-j4zrb\") pod \"maas-controller-645ff58b69-fxmnn\" (UID: \"eb1053a0-655f-4368-9a43-4639175eb878\") " pod="opendatahub/maas-controller-645ff58b69-fxmnn"
Sep 11 04:25:24.867185 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:24.867159    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-645ff58b69-fxmnn"
Sep 11 04:25:25.140442 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:25.140309    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-645ff58b69-fxmnn"]
Sep 11 04:25:25.145849 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:25:25.145817    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb1053a0_655f_4368_9a43_4639175eb878.slice/crio-97444bd35e8250506b62127b627234df294a818b8c15c5fd7fdd70a9d7e2bf62 WatchSource:0}: Error finding container 97444bd35e8250506b62127b627234df294a818b8c15c5fd7fdd70a9d7e2bf62: Status 404 returned error can't find the container with id 97444bd35e8250506b62127b627234df294a818b8c15c5fd7fdd70a9d7e2bf62
Sep 11 04:25:25.147120 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:25.147104    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 04:25:25.228041 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:25.228008    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-645ff58b69-fxmnn" event={"ID":"eb1053a0-655f-4368-9a43-4639175eb878","Type":"ContainerStarted","Data":"97444bd35e8250506b62127b627234df294a818b8c15c5fd7fdd70a9d7e2bf62"}
Sep 11 04:25:26.235102 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:26.235061    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-645ff58b69-fxmnn" event={"ID":"eb1053a0-655f-4368-9a43-4639175eb878","Type":"ContainerStarted","Data":"abbba766946f336a059791ddc5a796f81e898ca041a9fb4e43360191aeb2b0a0"}
Sep 11 04:25:26.235584 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:26.235144    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-645ff58b69-fxmnn"
Sep 11 04:25:26.252107 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:26.252056    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-645ff58b69-fxmnn" podStartSLOduration=1.801159314 podStartE2EDuration="2.25204265s" totalImagesPullingTime="450.883336ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:25:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:25:26.251053278 +0000 UTC m=+1923.049143018" watchObservedRunningTime="2026-09-11 04:25:26.25204265 +0000 UTC m=+1923.050132375"
Sep 11 04:25:37.242306 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:37.242272    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-645ff58b69-fxmnn"
Sep 11 04:25:47.100607 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:47.100574    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:25:54.790319 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:25:54.790279    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:26:02.198475 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:26:02.198435    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:26:09.496268 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:26:09.496233    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:26:23.494367 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:26:23.494290    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:26:31.200856 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:26:31.200818    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:27:58.098494 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:27:58.097835    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:28:04.800745 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:28:04.800708    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:28:12.196248 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:28:12.196214    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:28:23.940821 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:28:23.940796    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nfssn_c9add74a-5c51-4ccf-9edd-3b90a66b9ef9/ovn-acl-logging/0.log"
Sep 11 04:28:23.945036 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:28:23.945017    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nfssn_c9add74a-5c51-4ccf-9edd-3b90a66b9ef9/ovn-acl-logging/0.log"
Sep 11 04:28:25.691728 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:28:25.691696    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:28:40.215187 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:28:40.215149    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:29:07.314425 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:07.314394    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:29:15.290203 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:15.290172    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:29:23.195492 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:23.195408    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:29:30.369991 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:30.369952    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7f866d8d77-grn4z"]
Sep 11 04:29:30.370547 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:30.370527    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="387ef80d-efa3-4e99-9183-0d4deb7f4239" containerName="istio-proxy"
Sep 11 04:29:30.370608 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:30.370552    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="387ef80d-efa3-4e99-9183-0d4deb7f4239" containerName="istio-proxy"
Sep 11 04:29:30.370652 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:30.370640    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c089ec66-cfe2-47cb-b56f-bd390109f572" containerName="istio-proxy"
Sep 11 04:29:30.374098 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:30.374076    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7f866d8d77-grn4z"
Sep 11 04:29:30.384830 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:30.384803    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7f866d8d77-grn4z"]
Sep 11 04:29:30.446770 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:30.446739    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76f9f789-4d2d-4654-b59b-3f3c6151df91-maas-api-tls\") pod \"maas-api-7f866d8d77-grn4z\" (UID: \"76f9f789-4d2d-4654-b59b-3f3c6151df91\") " pod="odh-ai-gateway-infra/maas-api-7f866d8d77-grn4z"
Sep 11 04:29:30.446962 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:30.446773    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vcpz\" (UniqueName: \"kubernetes.io/projected/76f9f789-4d2d-4654-b59b-3f3c6151df91-kube-api-access-8vcpz\") pod \"maas-api-7f866d8d77-grn4z\" (UID: \"76f9f789-4d2d-4654-b59b-3f3c6151df91\") " pod="odh-ai-gateway-infra/maas-api-7f866d8d77-grn4z"
Sep 11 04:29:30.446962 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:30.446925    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76f9f789-4d2d-4654-b59b-3f3c6151df91-openshift-service-ca\") pod \"maas-api-7f866d8d77-grn4z\" (UID: \"76f9f789-4d2d-4654-b59b-3f3c6151df91\") " pod="odh-ai-gateway-infra/maas-api-7f866d8d77-grn4z"
Sep 11 04:29:30.447082 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:30.446980    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76f9f789-4d2d-4654-b59b-3f3c6151df91-metrics-certs\") pod \"maas-api-7f866d8d77-grn4z\" (UID: \"76f9f789-4d2d-4654-b59b-3f3c6151df91\") " pod="odh-ai-gateway-infra/maas-api-7f866d8d77-grn4z"
Sep 11 04:29:30.548179 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:30.548141    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76f9f789-4d2d-4654-b59b-3f3c6151df91-maas-api-tls\") pod \"maas-api-7f866d8d77-grn4z\" (UID: \"76f9f789-4d2d-4654-b59b-3f3c6151df91\") " pod="odh-ai-gateway-infra/maas-api-7f866d8d77-grn4z"
Sep 11 04:29:30.548179 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:30.548181    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vcpz\" (UniqueName: \"kubernetes.io/projected/76f9f789-4d2d-4654-b59b-3f3c6151df91-kube-api-access-8vcpz\") pod \"maas-api-7f866d8d77-grn4z\" (UID: \"76f9f789-4d2d-4654-b59b-3f3c6151df91\") " pod="odh-ai-gateway-infra/maas-api-7f866d8d77-grn4z"
Sep 11 04:29:30.548445 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:30.548258    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76f9f789-4d2d-4654-b59b-3f3c6151df91-openshift-service-ca\") pod \"maas-api-7f866d8d77-grn4z\" (UID: \"76f9f789-4d2d-4654-b59b-3f3c6151df91\") " pod="odh-ai-gateway-infra/maas-api-7f866d8d77-grn4z"
Sep 11 04:29:30.548445 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:30.548295    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76f9f789-4d2d-4654-b59b-3f3c6151df91-metrics-certs\") pod \"maas-api-7f866d8d77-grn4z\" (UID: \"76f9f789-4d2d-4654-b59b-3f3c6151df91\") " pod="odh-ai-gateway-infra/maas-api-7f866d8d77-grn4z"
Sep 11 04:29:30.548990 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:30.548971    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76f9f789-4d2d-4654-b59b-3f3c6151df91-openshift-service-ca\") pod \"maas-api-7f866d8d77-grn4z\" (UID: \"76f9f789-4d2d-4654-b59b-3f3c6151df91\") " pod="odh-ai-gateway-infra/maas-api-7f866d8d77-grn4z"
Sep 11 04:29:30.550546 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:30.550525    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76f9f789-4d2d-4654-b59b-3f3c6151df91-maas-api-tls\") pod \"maas-api-7f866d8d77-grn4z\" (UID: \"76f9f789-4d2d-4654-b59b-3f3c6151df91\") " pod="odh-ai-gateway-infra/maas-api-7f866d8d77-grn4z"
Sep 11 04:29:30.550665 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:30.550644    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76f9f789-4d2d-4654-b59b-3f3c6151df91-metrics-certs\") pod \"maas-api-7f866d8d77-grn4z\" (UID: \"76f9f789-4d2d-4654-b59b-3f3c6151df91\") " pod="odh-ai-gateway-infra/maas-api-7f866d8d77-grn4z"
Sep 11 04:29:30.555446 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:30.555427    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vcpz\" (UniqueName: \"kubernetes.io/projected/76f9f789-4d2d-4654-b59b-3f3c6151df91-kube-api-access-8vcpz\") pod \"maas-api-7f866d8d77-grn4z\" (UID: \"76f9f789-4d2d-4654-b59b-3f3c6151df91\") " pod="odh-ai-gateway-infra/maas-api-7f866d8d77-grn4z"
Sep 11 04:29:30.686500 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:30.686409    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7f866d8d77-grn4z"
Sep 11 04:29:30.888900 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:30.888867    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:29:30.957305 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:30.957278    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7f866d8d77-grn4z"]
Sep 11 04:29:30.958584 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:29:30.958562    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76f9f789_4d2d_4654_b59b_3f3c6151df91.slice/crio-c8fd164f2437d0e554b5d1a3d0f0e3c2f7301df383c94b89f6415e42cb8c7dcd WatchSource:0}: Error finding container c8fd164f2437d0e554b5d1a3d0f0e3c2f7301df383c94b89f6415e42cb8c7dcd: Status 404 returned error can't find the container with id c8fd164f2437d0e554b5d1a3d0f0e3c2f7301df383c94b89f6415e42cb8c7dcd
Sep 11 04:29:31.494943 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:31.494897    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7f866d8d77-grn4z" event={"ID":"76f9f789-4d2d-4654-b59b-3f3c6151df91","Type":"ContainerStarted","Data":"64e085198c4d0323350cb4b754e3157b40cb5f7b93babcb1c6a9f98970260fd2"}
Sep 11 04:29:31.495420 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:31.494959    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7f866d8d77-grn4z" event={"ID":"76f9f789-4d2d-4654-b59b-3f3c6151df91","Type":"ContainerStarted","Data":"c8fd164f2437d0e554b5d1a3d0f0e3c2f7301df383c94b89f6415e42cb8c7dcd"}
Sep 11 04:29:31.495420 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:31.494986    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7f866d8d77-grn4z"
Sep 11 04:29:31.515516 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:31.515458    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7f866d8d77-grn4z" podStartSLOduration=1.184028332 podStartE2EDuration="1.515436709s" totalImagesPullingTime="331.408377ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:29:31.511996437 +0000 UTC m=+2168.310086164" watchObservedRunningTime="2026-09-11 04:29:31.515436709 +0000 UTC m=+2168.313526434"
Sep 11 04:29:37.503839 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:37.503797    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:29:37.511290 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:37.511266    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7f866d8d77-grn4z"
Sep 11 04:29:37.558188 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:37.558153    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kxwqb"]
Sep 11 04:29:37.558443 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:37.558375    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kxwqb" podUID="db8feed7-508a-411e-874e-fd8247ae7d30" containerName="maas-api" containerID="cri-o://6cf17a805a67f3cad13bf44d98d7faebe3a13aca5eda097b25a2d17e614738a7" gracePeriod=30
Sep 11 04:29:38.803858 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:38.803831    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kxwqb"
Sep 11 04:29:38.925060 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:38.924957    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db8feed7-508a-411e-874e-fd8247ae7d30-openshift-service-ca\") pod \"db8feed7-508a-411e-874e-fd8247ae7d30\" (UID: \"db8feed7-508a-411e-874e-fd8247ae7d30\") "
Sep 11 04:29:38.925060 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:38.925053    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db8feed7-508a-411e-874e-fd8247ae7d30-metrics-certs\") pod \"db8feed7-508a-411e-874e-fd8247ae7d30\" (UID: \"db8feed7-508a-411e-874e-fd8247ae7d30\") "
Sep 11 04:29:38.925283 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:38.925112    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db8feed7-508a-411e-874e-fd8247ae7d30-maas-api-tls\") pod \"db8feed7-508a-411e-874e-fd8247ae7d30\" (UID: \"db8feed7-508a-411e-874e-fd8247ae7d30\") "
Sep 11 04:29:38.925283 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:38.925143    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbf4n\" (UniqueName: \"kubernetes.io/projected/db8feed7-508a-411e-874e-fd8247ae7d30-kube-api-access-wbf4n\") pod \"db8feed7-508a-411e-874e-fd8247ae7d30\" (UID: \"db8feed7-508a-411e-874e-fd8247ae7d30\") "
Sep 11 04:29:38.925430 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:38.925338    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db8feed7-508a-411e-874e-fd8247ae7d30-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "db8feed7-508a-411e-874e-fd8247ae7d30" (UID: "db8feed7-508a-411e-874e-fd8247ae7d30"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:29:38.925565 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:38.925545    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db8feed7-508a-411e-874e-fd8247ae7d30-openshift-service-ca\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:29:38.927331 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:38.927291    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db8feed7-508a-411e-874e-fd8247ae7d30-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "db8feed7-508a-411e-874e-fd8247ae7d30" (UID: "db8feed7-508a-411e-874e-fd8247ae7d30"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:29:38.927331 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:38.927308    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db8feed7-508a-411e-874e-fd8247ae7d30-kube-api-access-wbf4n" (OuterVolumeSpecName: "kube-api-access-wbf4n") pod "db8feed7-508a-411e-874e-fd8247ae7d30" (UID: "db8feed7-508a-411e-874e-fd8247ae7d30"). InnerVolumeSpecName "kube-api-access-wbf4n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:29:38.927513 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:38.927340    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db8feed7-508a-411e-874e-fd8247ae7d30-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "db8feed7-508a-411e-874e-fd8247ae7d30" (UID: "db8feed7-508a-411e-874e-fd8247ae7d30"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:29:39.026191 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:39.026151    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db8feed7-508a-411e-874e-fd8247ae7d30-maas-api-tls\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:29:39.026191 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:39.026189    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbf4n\" (UniqueName: \"kubernetes.io/projected/db8feed7-508a-411e-874e-fd8247ae7d30-kube-api-access-wbf4n\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:29:39.026191 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:39.026198    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db8feed7-508a-411e-874e-fd8247ae7d30-metrics-certs\") on node \"ip-10-0-130-195.ec2.internal\" DevicePath \"\""
Sep 11 04:29:39.542788 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:39.542750    2558 generic.go:356] "Generic (PLEG): container finished" podID="db8feed7-508a-411e-874e-fd8247ae7d30" containerID="6cf17a805a67f3cad13bf44d98d7faebe3a13aca5eda097b25a2d17e614738a7" exitCode=0
Sep 11 04:29:39.542788 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:39.542792    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kxwqb"
Sep 11 04:29:39.543008 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:39.542827    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kxwqb" event={"ID":"db8feed7-508a-411e-874e-fd8247ae7d30","Type":"ContainerDied","Data":"6cf17a805a67f3cad13bf44d98d7faebe3a13aca5eda097b25a2d17e614738a7"}
Sep 11 04:29:39.543008 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:39.542885    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kxwqb" event={"ID":"db8feed7-508a-411e-874e-fd8247ae7d30","Type":"ContainerDied","Data":"666d2f2f8c9263a5a14733e9c9ef713c35fd4ef07b42d911b3d37b07cd43b1a2"}
Sep 11 04:29:39.543008 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:39.542908    2558 scope.go:117] "RemoveContainer" containerID="6cf17a805a67f3cad13bf44d98d7faebe3a13aca5eda097b25a2d17e614738a7"
Sep 11 04:29:39.552543 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:39.552523    2558 scope.go:117] "RemoveContainer" containerID="6cf17a805a67f3cad13bf44d98d7faebe3a13aca5eda097b25a2d17e614738a7"
Sep 11 04:29:39.552878 ip-10-0-130-195 kubenswrapper[2558]: E0911 04:29:39.552856    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cf17a805a67f3cad13bf44d98d7faebe3a13aca5eda097b25a2d17e614738a7\": container with ID starting with 6cf17a805a67f3cad13bf44d98d7faebe3a13aca5eda097b25a2d17e614738a7 not found: ID does not exist" containerID="6cf17a805a67f3cad13bf44d98d7faebe3a13aca5eda097b25a2d17e614738a7"
Sep 11 04:29:39.552931 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:39.552886    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cf17a805a67f3cad13bf44d98d7faebe3a13aca5eda097b25a2d17e614738a7"} err="failed to get container status \"6cf17a805a67f3cad13bf44d98d7faebe3a13aca5eda097b25a2d17e614738a7\": rpc error: code = NotFound desc = could not find container \"6cf17a805a67f3cad13bf44d98d7faebe3a13aca5eda097b25a2d17e614738a7\": container with ID starting with 6cf17a805a67f3cad13bf44d98d7faebe3a13aca5eda097b25a2d17e614738a7 not found: ID does not exist"
Sep 11 04:29:39.565425 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:39.565399    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kxwqb"]
Sep 11 04:29:39.569424 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:39.569404    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kxwqb"]
Sep 11 04:29:39.809618 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:39.809537    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db8feed7-508a-411e-874e-fd8247ae7d30" path="/var/lib/kubelet/pods/db8feed7-508a-411e-874e-fd8247ae7d30/volumes"
Sep 11 04:29:43.594292 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:43.594258    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:29:50.698487 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:50.698452    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fm2rt"]
Sep 11 04:29:58.951828 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:58.951795    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-645ff58b69-fxmnn_eb1053a0-655f-4368-9a43-4639175eb878/manager/0.log"
Sep 11 04:29:59.454715 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:59.454685    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65b869c898-hlqb7_f70cd365-5791-4e3d-a0ad-6bbff9bc48af/copy-manifests/0.log"
Sep 11 04:29:59.461507 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:59.461488    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65b869c898-hlqb7_f70cd365-5791-4e3d-a0ad-6bbff9bc48af/manager/0.log"
Sep 11 04:29:59.944547 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:29:59.944512    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7f866d8d77-grn4z_76f9f789-4d2d-4654-b59b-3f3c6151df91/maas-api/0.log"
Sep 11 04:30:00.295353 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:00.295264    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-smtdw_f96d36d2-5060-40db-9450-e2c6e9d66d68/postgres/0.log"
Sep 11 04:30:01.321013 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:01.320982    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-62hc8_4b349024-b3f7-4bc4-9d50-076a0f6f7e8e/manager/0.log"
Sep 11 04:30:01.664849 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:01.664772    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-fm2rt_9588c225-99f9-4f3c-9264-75ba6c21d6ac/limitador/0.log"
Sep 11 04:30:02.161299 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:02.161270    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk_a925516e-8aba-415b-b45d-b4ad1ef84f74/istio-proxy/0.log"
Sep 11 04:30:02.296515 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:02.296482    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-lb4tw_b03f904a-27b1-4a1d-b44d-601e0eb00785/discovery/0.log"
Sep 11 04:30:02.536959 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:02.536853    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f78fb9f44-czvpr_fc6b6b0e-dab5-46e4-bec9-12a6db67525e/kube-auth-proxy/0.log"
Sep 11 04:30:02.660660 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:02.660631    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-t9t74_f1d3b637-e83f-46fa-b4d3-de3eddd404b5/istio-proxy/1.log"
Sep 11 04:30:03.020873 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:03.020845    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78556b97cb-rt5r7_42222ece-7ddd-483e-8ca8-934910a8fa25/router/0.log"
Sep 11 04:30:03.381794 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:03.381766    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-wr59x_655c39e7-ec39-4712-a0cf-ebcc35ff46e6/main/0.log"
Sep 11 04:30:03.724756 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:03.724681    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-bhhd9_802671e4-0c09-41a9-b8ff-e29745496e25/main/0.log"
Sep 11 04:30:03.961211 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:03.961177    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-vzrlw_d9e8f836-3e15-401f-8c2c-b593009405f2/main/0.log"
Sep 11 04:30:12.940187 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:12.940152    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gb2cl_e72b85ea-da06-4626-9ac7-1aa09afbc972/global-pull-secret-syncer/0.log"
Sep 11 04:30:13.184225 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:13.184177    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zt598_0247f5db-3e1c-4545-baff-7388ebef867d/konnectivity-agent/0.log"
Sep 11 04:30:13.204941 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:13.204867    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-195.ec2.internal_5e4ec590b0b700dcbd5a280ea65eb0b6/haproxy/0.log"
Sep 11 04:30:17.663763 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:17.663736    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-62hc8_4b349024-b3f7-4bc4-9d50-076a0f6f7e8e/manager/0.log"
Sep 11 04:30:17.799475 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:17.799446    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-fm2rt_9588c225-99f9-4f3c-9264-75ba6c21d6ac/limitador/0.log"
Sep 11 04:30:19.522814 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:19.522779    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-lm5hf_53d1b221-40dd-4507-b81a-4af75f45efaf/cluster-monitoring-operator/0.log"
Sep 11 04:30:19.868744 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:19.868705    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wl6cc_4b207435-8f38-4d10-81a1-2a5c8948e12c/node-exporter/0.log"
Sep 11 04:30:19.893767 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:19.893726    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wl6cc_4b207435-8f38-4d10-81a1-2a5c8948e12c/kube-rbac-proxy/0.log"
Sep 11 04:30:19.915829 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:19.915808    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wl6cc_4b207435-8f38-4d10-81a1-2a5c8948e12c/init-textfile/0.log"
Sep 11 04:30:22.103265 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:22.103237    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-h76wv_73868425-41c2-4554-aef0-2528200edc9d/networking-console-plugin/0.log"
Sep 11 04:30:23.161839 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:23.161805    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dxk5v/perf-node-gather-daemonset-k9kcg"]
Sep 11 04:30:23.162198 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:23.162141    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db8feed7-508a-411e-874e-fd8247ae7d30" containerName="maas-api"
Sep 11 04:30:23.162198 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:23.162151    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="db8feed7-508a-411e-874e-fd8247ae7d30" containerName="maas-api"
Sep 11 04:30:23.162274 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:23.162223    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="db8feed7-508a-411e-874e-fd8247ae7d30" containerName="maas-api"
Sep 11 04:30:23.165518 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:23.165498    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dxk5v/perf-node-gather-daemonset-k9kcg"
Sep 11 04:30:23.168019 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:23.167998    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dxk5v\"/\"kube-root-ca.crt\""
Sep 11 04:30:23.168952 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:23.168935    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dxk5v\"/\"openshift-service-ca.crt\""
Sep 11 04:30:23.168952 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:23.168948    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dxk5v\"/\"default-dockercfg-gxcvx\""
Sep 11 04:30:23.175931 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:23.175909    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dxk5v/perf-node-gather-daemonset-k9kcg"]
Sep 11 04:30:23.223942 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:23.223910    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a0140e0-6472-4218-a07a-ed04883c2aef-podres\") pod \"perf-node-gather-daemonset-k9kcg\" (UID: \"8a0140e0-6472-4218-a07a-ed04883c2aef\") " pod="openshift-must-gather-dxk5v/perf-node-gather-daemonset-k9kcg"
Sep 11 04:30:23.224078 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:23.223950    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a0140e0-6472-4218-a07a-ed04883c2aef-lib-modules\") pod \"perf-node-gather-daemonset-k9kcg\" (UID: \"8a0140e0-6472-4218-a07a-ed04883c2aef\") " pod="openshift-must-gather-dxk5v/perf-node-gather-daemonset-k9kcg"
Sep 11 04:30:23.224078 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:23.224027    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcg46\" (UniqueName: \"kubernetes.io/projected/8a0140e0-6472-4218-a07a-ed04883c2aef-kube-api-access-lcg46\") pod \"perf-node-gather-daemonset-k9kcg\" (UID: \"8a0140e0-6472-4218-a07a-ed04883c2aef\") " pod="openshift-must-gather-dxk5v/perf-node-gather-daemonset-k9kcg"
Sep 11 04:30:23.224078 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:23.224062    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a0140e0-6472-4218-a07a-ed04883c2aef-proc\") pod \"perf-node-gather-daemonset-k9kcg\" (UID: \"8a0140e0-6472-4218-a07a-ed04883c2aef\") " pod="openshift-must-gather-dxk5v/perf-node-gather-daemonset-k9kcg"
Sep 11 04:30:23.224189 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:23.224108    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a0140e0-6472-4218-a07a-ed04883c2aef-sys\") pod \"perf-node-gather-daemonset-k9kcg\" (UID: \"8a0140e0-6472-4218-a07a-ed04883c2aef\") " pod="openshift-must-gather-dxk5v/perf-node-gather-daemonset-k9kcg"
Sep 11 04:30:23.324832 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:23.324800    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcg46\" (UniqueName: \"kubernetes.io/projected/8a0140e0-6472-4218-a07a-ed04883c2aef-kube-api-access-lcg46\") pod \"perf-node-gather-daemonset-k9kcg\" (UID: \"8a0140e0-6472-4218-a07a-ed04883c2aef\") " pod="openshift-must-gather-dxk5v/perf-node-gather-daemonset-k9kcg"
Sep 11 04:30:23.324971 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:23.324845    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a0140e0-6472-4218-a07a-ed04883c2aef-proc\") pod \"perf-node-gather-daemonset-k9kcg\" (UID: \"8a0140e0-6472-4218-a07a-ed04883c2aef\") " pod="openshift-must-gather-dxk5v/perf-node-gather-daemonset-k9kcg"
Sep 11 04:30:23.324971 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:23.324887    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a0140e0-6472-4218-a07a-ed04883c2aef-sys\") pod \"perf-node-gather-daemonset-k9kcg\" (UID: \"8a0140e0-6472-4218-a07a-ed04883c2aef\") " pod="openshift-must-gather-dxk5v/perf-node-gather-daemonset-k9kcg"
Sep 11 04:30:23.324971 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:23.324943    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a0140e0-6472-4218-a07a-ed04883c2aef-podres\") pod \"perf-node-gather-daemonset-k9kcg\" (UID: \"8a0140e0-6472-4218-a07a-ed04883c2aef\") " pod="openshift-must-gather-dxk5v/perf-node-gather-daemonset-k9kcg"
Sep 11 04:30:23.325110 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:23.324980    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a0140e0-6472-4218-a07a-ed04883c2aef-lib-modules\") pod \"perf-node-gather-daemonset-k9kcg\" (UID: \"8a0140e0-6472-4218-a07a-ed04883c2aef\") " pod="openshift-must-gather-dxk5v/perf-node-gather-daemonset-k9kcg"
Sep 11 04:30:23.325110 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:23.324998    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a0140e0-6472-4218-a07a-ed04883c2aef-sys\") pod \"perf-node-gather-daemonset-k9kcg\" (UID: \"8a0140e0-6472-4218-a07a-ed04883c2aef\") " pod="openshift-must-gather-dxk5v/perf-node-gather-daemonset-k9kcg"
Sep 11 04:30:23.325110 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:23.324998    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a0140e0-6472-4218-a07a-ed04883c2aef-proc\") pod \"perf-node-gather-daemonset-k9kcg\" (UID: \"8a0140e0-6472-4218-a07a-ed04883c2aef\") " pod="openshift-must-gather-dxk5v/perf-node-gather-daemonset-k9kcg"
Sep 11 04:30:23.325110 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:23.325100    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a0140e0-6472-4218-a07a-ed04883c2aef-podres\") pod \"perf-node-gather-daemonset-k9kcg\" (UID: \"8a0140e0-6472-4218-a07a-ed04883c2aef\") " pod="openshift-must-gather-dxk5v/perf-node-gather-daemonset-k9kcg"
Sep 11 04:30:23.325239 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:23.325100    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a0140e0-6472-4218-a07a-ed04883c2aef-lib-modules\") pod \"perf-node-gather-daemonset-k9kcg\" (UID: \"8a0140e0-6472-4218-a07a-ed04883c2aef\") " pod="openshift-must-gather-dxk5v/perf-node-gather-daemonset-k9kcg"
Sep 11 04:30:23.332715 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:23.332693    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcg46\" (UniqueName: \"kubernetes.io/projected/8a0140e0-6472-4218-a07a-ed04883c2aef-kube-api-access-lcg46\") pod \"perf-node-gather-daemonset-k9kcg\" (UID: \"8a0140e0-6472-4218-a07a-ed04883c2aef\") " pod="openshift-must-gather-dxk5v/perf-node-gather-daemonset-k9kcg"
Sep 11 04:30:23.351165 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:23.351147    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-b9zbm_e80fdc87-5412-4a97-a1cc-d68c5511edf2/download-server/0.log"
Sep 11 04:30:23.475816 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:23.475755    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dxk5v/perf-node-gather-daemonset-k9kcg"
Sep 11 04:30:23.743848 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:23.743823    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dxk5v/perf-node-gather-daemonset-k9kcg"]
Sep 11 04:30:23.745233 ip-10-0-130-195 kubenswrapper[2558]: W0911 04:30:23.745200    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8a0140e0_6472_4218_a07a_ed04883c2aef.slice/crio-f8683f6e9c47031c6dfa0d829815b77de864e837886177fa8b9d8e40747de56e WatchSource:0}: Error finding container f8683f6e9c47031c6dfa0d829815b77de864e837886177fa8b9d8e40747de56e: Status 404 returned error can't find the container with id f8683f6e9c47031c6dfa0d829815b77de864e837886177fa8b9d8e40747de56e
Sep 11 04:30:23.776376 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:23.776348    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dxk5v/perf-node-gather-daemonset-k9kcg" event={"ID":"8a0140e0-6472-4218-a07a-ed04883c2aef","Type":"ContainerStarted","Data":"f8683f6e9c47031c6dfa0d829815b77de864e837886177fa8b9d8e40747de56e"}
Sep 11 04:30:24.782787 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:24.782754    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dxk5v/perf-node-gather-daemonset-k9kcg" event={"ID":"8a0140e0-6472-4218-a07a-ed04883c2aef","Type":"ContainerStarted","Data":"816bca6e8374a4eeddda224ac8aa0e2caf58608b9f3e7aaf7b62ad1438b46b4f"}
Sep 11 04:30:24.783162 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:24.782867    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dxk5v/perf-node-gather-daemonset-k9kcg"
Sep 11 04:30:24.805222 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:24.805179    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dxk5v/perf-node-gather-daemonset-k9kcg" podStartSLOduration=1.8051672509999999 podStartE2EDuration="1.805167251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 04:30:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:30:24.802469089 +0000 UTC m=+2221.600558815" watchObservedRunningTime="2026-09-11 04:30:24.805167251 +0000 UTC m=+2221.603256976"
Sep 11 04:30:25.224329 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:25.224303    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jcsgz_7afc68c1-54e3-4f06-8dcd-184a06388ccf/dns/0.log"
Sep 11 04:30:25.251580 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:25.251554    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jcsgz_7afc68c1-54e3-4f06-8dcd-184a06388ccf/kube-rbac-proxy/0.log"
Sep 11 04:30:25.377800 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:25.377764    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5k289_93264b23-0656-44f5-aa41-8626a42e1348/dns-node-resolver/0.log"
Sep 11 04:30:25.979396 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:25.979368    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6b78dcfd7c-gll52_46c3aeb9-b4ad-4654-a471-da65b785386b/registry/0.log"
Sep 11 04:30:26.002911 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:26.002874    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6rfcj_3a500433-7480-46a7-9c45-9a58866265c3/node-ca/0.log"
Sep 11 04:30:27.005104 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:27.005075    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk_a925516e-8aba-415b-b45d-b4ad1ef84f74/istio-proxy/0.log"
Sep 11 04:30:27.222950 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:27.222921    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-lb4tw_b03f904a-27b1-4a1d-b44d-601e0eb00785/discovery/0.log"
Sep 11 04:30:27.272746 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:27.272668    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f78fb9f44-czvpr_fc6b6b0e-dab5-46e4-bec9-12a6db67525e/kube-auth-proxy/0.log"
Sep 11 04:30:27.303673 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:27.303643    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-t9t74_f1d3b637-e83f-46fa-b4d3-de3eddd404b5/istio-proxy/0.log"
Sep 11 04:30:27.310552 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:27.310523    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-t9t74_f1d3b637-e83f-46fa-b4d3-de3eddd404b5/istio-proxy/1.log"
Sep 11 04:30:27.434116 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:27.434085    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78556b97cb-rt5r7_42222ece-7ddd-483e-8ca8-934910a8fa25/router/0.log"
Sep 11 04:30:28.349974 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:28.349943    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tfr46_57ce4512-0f2a-462f-bf95-6cd72f7f727b/serve-healthcheck-canary/0.log"
Sep 11 04:30:29.010022 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:29.009986    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rzpgp_98be0e97-3076-42f5-be44-71b25c72f0ba/kube-rbac-proxy/0.log"
Sep 11 04:30:29.032152 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:29.032128    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rzpgp_98be0e97-3076-42f5-be44-71b25c72f0ba/exporter/0.log"
Sep 11 04:30:29.054943 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:29.054917    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rzpgp_98be0e97-3076-42f5-be44-71b25c72f0ba/extractor/0.log"
Sep 11 04:30:30.798088 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:30.798060    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dxk5v/perf-node-gather-daemonset-k9kcg"
Sep 11 04:30:31.556077 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:31.556039    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-645ff58b69-fxmnn_eb1053a0-655f-4368-9a43-4639175eb878/manager/0.log"
Sep 11 04:30:31.908943 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:31.908906    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65b869c898-hlqb7_f70cd365-5791-4e3d-a0ad-6bbff9bc48af/manager/0.log"
Sep 11 04:30:31.964085 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:31.964057    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65b869c898-hlqb7_f70cd365-5791-4e3d-a0ad-6bbff9bc48af/copy-manifests/0.log"
Sep 11 04:30:33.609728 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:33.609696    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk_a925516e-8aba-415b-b45d-b4ad1ef84f74/istio-proxy/0.log"
Sep 11 04:30:33.824490 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:33.824458    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-lb4tw_b03f904a-27b1-4a1d-b44d-601e0eb00785/discovery/0.log"
Sep 11 04:30:33.852110 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:33.852066    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f78fb9f44-czvpr_fc6b6b0e-dab5-46e4-bec9-12a6db67525e/kube-auth-proxy/0.log"
Sep 11 04:30:33.876454 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:33.876360    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-t9t74_f1d3b637-e83f-46fa-b4d3-de3eddd404b5/istio-proxy/0.log"
Sep 11 04:30:33.883961 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:33.883940    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-t9t74_f1d3b637-e83f-46fa-b4d3-de3eddd404b5/istio-proxy/1.log"
Sep 11 04:30:33.970956 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:33.970930    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78556b97cb-rt5r7_42222ece-7ddd-483e-8ca8-934910a8fa25/router/0.log"
Sep 11 04:30:35.455032 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:35.455002    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk_a925516e-8aba-415b-b45d-b4ad1ef84f74/istio-proxy/0.log"
Sep 11 04:30:35.666089 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:35.666059    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-lb4tw_b03f904a-27b1-4a1d-b44d-601e0eb00785/discovery/0.log"
Sep 11 04:30:35.697040 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:35.697008    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f78fb9f44-czvpr_fc6b6b0e-dab5-46e4-bec9-12a6db67525e/kube-auth-proxy/0.log"
Sep 11 04:30:35.721428 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:35.721317    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-t9t74_f1d3b637-e83f-46fa-b4d3-de3eddd404b5/istio-proxy/0.log"
Sep 11 04:30:35.733015 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:35.732978    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-t9t74_f1d3b637-e83f-46fa-b4d3-de3eddd404b5/istio-proxy/1.log"
Sep 11 04:30:35.825480 ip-10-0-130-195 kubenswrapper[2558]: I0911 04:30:35.825372    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78556b97cb-rt5r7_42222ece-7ddd-483e-8ca8-934910a8fa25/router/0.log"