Sep 05 06:25:33.902368 ip-10-0-141-49 systemd[1]: Starting Kubernetes Kubelet...
Sep 05 06:25:34.346156 ip-10-0-141-49 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 05 06:25:34.346156 ip-10-0-141-49 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 05 06:25:34.346156 ip-10-0-141-49 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 05 06:25:34.346156 ip-10-0-141-49 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 05 06:25:34.346156 ip-10-0-141-49 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 05 06:25:34.348922 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.348817    2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 05 06:25:34.353377 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353351    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 05 06:25:34.353377 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353374    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 05 06:25:34.353377 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353378    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 05 06:25:34.353483 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353384    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 05 06:25:34.353483 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353387    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 05 06:25:34.353483 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353396    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 05 06:25:34.353483 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353399    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 05 06:25:34.353483 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353402    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 05 06:25:34.353483 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353405    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 05 06:25:34.353483 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353408    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 05 06:25:34.353483 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353411    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 05 06:25:34.353483 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353413    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 05 06:25:34.353483 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353416    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 05 06:25:34.353483 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353419    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 05 06:25:34.353483 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353421    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 05 06:25:34.353483 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353424    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 05 06:25:34.353483 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353427    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 05 06:25:34.353483 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353429    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 05 06:25:34.353483 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353432    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 05 06:25:34.353483 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353434    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 05 06:25:34.353483 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353436    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 05 06:25:34.353483 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353439    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 05 06:25:34.353483 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353441    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 05 06:25:34.354081 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353444    2567 feature_gate.go:328] unrecognized feature gate: Example2
Sep 05 06:25:34.354081 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353446    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 05 06:25:34.354081 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353449    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 05 06:25:34.354081 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353451    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 05 06:25:34.354081 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353453    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 05 06:25:34.354081 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353457    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 05 06:25:34.354081 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353459    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 05 06:25:34.354081 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353464    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 05 06:25:34.354081 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353468    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 05 06:25:34.354081 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353471    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 05 06:25:34.354081 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353473    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 05 06:25:34.354081 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353477    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 05 06:25:34.354081 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353479    2567 feature_gate.go:328] unrecognized feature gate: Example
Sep 05 06:25:34.354081 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353483    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 05 06:25:34.354081 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353487    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 05 06:25:34.354081 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353489    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 05 06:25:34.354081 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353492    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 05 06:25:34.354081 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353495    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 05 06:25:34.354081 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353497    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 05 06:25:34.354081 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353500    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 05 06:25:34.354568 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353503    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 05 06:25:34.354568 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353505    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 05 06:25:34.354568 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353508    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 05 06:25:34.354568 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353510    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 05 06:25:34.354568 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353513    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 05 06:25:34.354568 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353516    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 05 06:25:34.354568 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353518    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 05 06:25:34.354568 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353521    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 05 06:25:34.354568 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353523    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 05 06:25:34.354568 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353526    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 05 06:25:34.354568 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353528    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 05 06:25:34.354568 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353531    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 05 06:25:34.354568 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353534    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 05 06:25:34.354568 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353537    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 05 06:25:34.354568 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353539    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 05 06:25:34.354568 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353542    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 05 06:25:34.354568 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353545    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 05 06:25:34.354568 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353548    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 05 06:25:34.354568 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353551    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 05 06:25:34.354568 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353553    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 05 06:25:34.355089 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353556    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 05 06:25:34.355089 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353558    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 05 06:25:34.355089 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353560    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 05 06:25:34.355089 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353563    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 05 06:25:34.355089 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353565    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 05 06:25:34.355089 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353570    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 05 06:25:34.355089 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353573    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 05 06:25:34.355089 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353577    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 05 06:25:34.355089 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353580    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 05 06:25:34.355089 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353583    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 05 06:25:34.355089 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353585    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 05 06:25:34.355089 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353587    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 05 06:25:34.355089 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353590    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 05 06:25:34.355089 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353592    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 05 06:25:34.355089 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353595    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 05 06:25:34.355089 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353597    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 05 06:25:34.355089 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353600    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 05 06:25:34.355089 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353603    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 05 06:25:34.355089 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353607    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 05 06:25:34.355560 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353611    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 05 06:25:34.355560 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353614    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 05 06:25:34.355560 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353616    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 05 06:25:34.355560 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353618    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 05 06:25:34.355560 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353621    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 05 06:25:34.355560 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353623    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 05 06:25:34.355560 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353626    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 05 06:25:34.355560 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353628    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 05 06:25:34.355560 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353631    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 05 06:25:34.355560 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353634    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 05 06:25:34.355560 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353638    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 05 06:25:34.355560 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353640    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 05 06:25:34.355560 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353643    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 05 06:25:34.355560 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353645    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 05 06:25:34.355560 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353648    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 05 06:25:34.355560 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353650    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 05 06:25:34.355560 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.353653    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 05 06:25:34.355560 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354427    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 05 06:25:34.355560 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354435    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 05 06:25:34.355560 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354438    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 05 06:25:34.355560 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354442    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 05 06:25:34.356096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354449    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 05 06:25:34.356096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354452    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 05 06:25:34.356096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354454    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 05 06:25:34.356096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354457    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 05 06:25:34.356096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354459    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 05 06:25:34.356096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354462    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 05 06:25:34.356096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354464    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 05 06:25:34.356096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354467    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 05 06:25:34.356096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354469    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 05 06:25:34.356096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354473    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 05 06:25:34.356096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354476    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 05 06:25:34.356096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354479    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 05 06:25:34.356096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354482    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 05 06:25:34.356096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354484    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 05 06:25:34.356096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354487    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 05 06:25:34.356096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354490    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 05 06:25:34.356096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354492    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 05 06:25:34.356096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354495    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 05 06:25:34.356096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354498    2567 feature_gate.go:328] unrecognized feature gate: Example
Sep 05 06:25:34.356096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354500    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 05 06:25:34.356598 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354503    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 05 06:25:34.356598 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354505    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 05 06:25:34.356598 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354508    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 05 06:25:34.356598 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354511    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 05 06:25:34.356598 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354513    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 05 06:25:34.356598 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354516    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 05 06:25:34.356598 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354518    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 05 06:25:34.356598 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354521    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 05 06:25:34.356598 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354524    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 05 06:25:34.356598 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354527    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 05 06:25:34.356598 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354529    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 05 06:25:34.356598 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354532    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 05 06:25:34.356598 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354534    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 05 06:25:34.356598 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354537    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 05 06:25:34.356598 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354540    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 05 06:25:34.356598 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354543    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 05 06:25:34.356598 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354545    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 05 06:25:34.356598 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354547    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 05 06:25:34.356598 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354550    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 05 06:25:34.356598 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354553    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 05 06:25:34.357096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354556    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 05 06:25:34.357096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354558    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 05 06:25:34.357096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354560    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 05 06:25:34.357096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354567    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 05 06:25:34.357096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354570    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 05 06:25:34.357096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354573    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 05 06:25:34.357096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354576    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 05 06:25:34.357096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354579    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 05 06:25:34.357096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354582    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 05 06:25:34.357096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354584    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 05 06:25:34.357096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354587    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 05 06:25:34.357096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354590    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 05 06:25:34.357096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354592    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 05 06:25:34.357096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354595    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 05 06:25:34.357096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354598    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 05 06:25:34.357096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354600    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 05 06:25:34.357096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354603    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 05 06:25:34.357096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354606    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 05 06:25:34.357096 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354608    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 05 06:25:34.357573 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354611    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 05 06:25:34.357573 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354614    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 05 06:25:34.357573 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354616    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 05 06:25:34.357573 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354619    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 05 06:25:34.357573 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354621    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 05 06:25:34.357573 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354624    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 05 06:25:34.357573 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354629    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 05 06:25:34.357573 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354633    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 05 06:25:34.357573 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354636    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 05 06:25:34.357573 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354638    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 05 06:25:34.357573 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354640    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 05 06:25:34.357573 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354643    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 05 06:25:34.357573 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354645    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 05 06:25:34.357573 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354647    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 05 06:25:34.357573 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354650    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 05 06:25:34.357573 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354652    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 05 06:25:34.357573 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354658    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 05 06:25:34.357573 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354662    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 05 06:25:34.358021 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354665    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 05 06:25:34.358021 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354668    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 05 06:25:34.358021 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354671    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 05 06:25:34.358021 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354673    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 05 06:25:34.358021 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354676    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 05 06:25:34.358021 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354679    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 05 06:25:34.358021 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354682    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 05 06:25:34.358021 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354685    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 05 06:25:34.358021 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354687    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 05 06:25:34.358021 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354690    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 05 06:25:34.358021 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354693    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 05 06:25:34.358021 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354695    2567 feature_gate.go:328] unrecognized feature gate: Example2
Sep 05 06:25:34.358021 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354698    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 05 06:25:34.358021 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354701    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 05 06:25:34.358021 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354703    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 05 06:25:34.358021 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354706    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 05 06:25:34.358021 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354708    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 05 06:25:34.358021 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.354711    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 05 06:25:34.358021 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355149    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 05 06:25:34.358021 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355156    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 05 06:25:34.358559 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355159    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 05 06:25:34.358559 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355163    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 05 06:25:34.358559 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355166    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 05 06:25:34.358559 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355168    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 05 06:25:34.358559 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355171    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 05 06:25:34.358559 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355174    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 05 06:25:34.358559 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355176    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 05 06:25:34.358559 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355179    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 05 06:25:34.358559 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355181    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 05 06:25:34.358559 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355184    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 05 06:25:34.358559 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355188    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 05 06:25:34.358559 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355191    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 05 06:25:34.358559 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355194    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 05 06:25:34.358559 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355197    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 05 06:25:34.358559 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355199    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 05 06:25:34.358559 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355202    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 05 06:25:34.358559 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355204    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 05 06:25:34.358559 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355207    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 05 06:25:34.358559 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355209    2567 feature_gate.go:328] unrecognized feature gate: Example
Sep 05 06:25:34.358559 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355212    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 05 06:25:34.359088 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355215    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 05 06:25:34.359088 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355218    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 05 06:25:34.359088 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355220    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 05 06:25:34.359088 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355223    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 05 06:25:34.359088 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355225    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 05 06:25:34.359088 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355228    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 05 06:25:34.359088 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355231    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 05 06:25:34.359088 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355233    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 05 06:25:34.359088 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355236    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 05 06:25:34.359088 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355238    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 05 06:25:34.359088 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355241    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 05 06:25:34.359088 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355243    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 05 06:25:34.359088 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355245    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 05 06:25:34.359088 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355248    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 05 06:25:34.359088 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355251    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 05 06:25:34.359088 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355253    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 05 06:25:34.359088 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355256    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 05 06:25:34.359088 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355258    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 05 06:25:34.359088 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355261    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 05 06:25:34.359088 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355263    2567 feature_gate.go:328] unrecognized feature gate: Example2
Sep 05 06:25:34.359600 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355266    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 05 06:25:34.359600 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355269    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 05 06:25:34.359600 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355273    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 05 06:25:34.359600 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355275    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 05 06:25:34.359600 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355278    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 05 06:25:34.359600 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355280    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 05 06:25:34.359600 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355282    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 05 06:25:34.359600 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355285    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 05 06:25:34.359600 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355288    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 05 06:25:34.359600 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355291    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 05 06:25:34.359600 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355293    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 05 06:25:34.359600 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355295    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 05 06:25:34.359600 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355298    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 05 06:25:34.359600 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355301    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 05 06:25:34.359600 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355303    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 05 06:25:34.359600 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355306    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 05 06:25:34.359600 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355308    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 05 06:25:34.359600 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355311    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 05 06:25:34.359600 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355313    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 05 06:25:34.359600 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355316    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 05 06:25:34.360103 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355319    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 05 06:25:34.360103 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355323    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 05 06:25:34.360103 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355326    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 05 06:25:34.360103 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355329    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 05 06:25:34.360103 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355332    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 05 06:25:34.360103 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355335    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 05 06:25:34.360103 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355337    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 05 06:25:34.360103 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355340    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 05 06:25:34.360103 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355342    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 05 06:25:34.360103 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355345    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 05 06:25:34.360103 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355347    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 05 06:25:34.360103 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355351    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 05 06:25:34.360103 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355354    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 05 06:25:34.360103 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355357    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 05 06:25:34.360103 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355362    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 05 06:25:34.360103 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355366    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 05 06:25:34.360103 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355368    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 05 06:25:34.360103 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355371    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 05 06:25:34.360103 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355373    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 05 06:25:34.360613 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355376    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 05 06:25:34.360613 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355380    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 05 06:25:34.360613 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355384    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 05 06:25:34.360613 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355386    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 05 06:25:34.360613 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355389    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 05 06:25:34.360613 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355392    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 05 06:25:34.360613 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355395    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 05 06:25:34.360613 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355398    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 05 06:25:34.360613 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355401    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 05 06:25:34.360613 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355404    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 05 06:25:34.360613 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355406    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 05 06:25:34.360613 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355409    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 05 06:25:34.360613 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355412    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 05 06:25:34.360613 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355414    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 05 06:25:34.360613 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355417    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 05 06:25:34.360613 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355420    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 05 06:25:34.360613 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355422    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 05 06:25:34.360613 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.355425    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 05 06:25:34.360613 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355513    2567 flags.go:64] FLAG: --address="0.0.0.0"
Sep 05 06:25:34.360613 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355562    2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 05 06:25:34.360613 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355568    2567 flags.go:64] FLAG: --anonymous-auth="true"
Sep 05 06:25:34.361142 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355574    2567 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 05 06:25:34.361142 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355586    2567 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 05 06:25:34.361142 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355591    2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 05 06:25:34.361142 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355596    2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 05 06:25:34.361142 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355601    2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 05 06:25:34.361142 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355606    2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 05 06:25:34.361142 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355611    2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 05 06:25:34.361142 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355615    2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 05 06:25:34.361142 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355618    2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 05 06:25:34.361142 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355621    2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 05 06:25:34.361142 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355624    2567 flags.go:64] FLAG: --cgroup-root=""
Sep 05 06:25:34.361142 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355627    2567 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 05 06:25:34.361142 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355630    2567 flags.go:64] FLAG: --client-ca-file=""
Sep 05 06:25:34.361142 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355633    2567 flags.go:64] FLAG: --cloud-provider="external"
Sep 05 06:25:34.361142 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355636    2567 flags.go:64] FLAG: --cluster-dns="[]"
Sep 05 06:25:34.361142 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355640    2567 flags.go:64] FLAG: --cluster-domain=""
Sep 05 06:25:34.361142 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355643    2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 05 06:25:34.361142 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355646    2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 05 06:25:34.361142 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355650    2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 05 06:25:34.361142 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355653    2567 flags.go:64] FLAG: --container-log-max-files="5"
Sep 05 06:25:34.361142 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355657    2567 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 05 06:25:34.361142 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355660    2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 05 06:25:34.361142 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355663    2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 05 06:25:34.361689 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355667    2567 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 05 06:25:34.361689 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355670    2567 flags.go:64] FLAG: --contention-profiling="false"
Sep 05 06:25:34.361689 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355673    2567 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 05 06:25:34.361689 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355676    2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 05 06:25:34.361689 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355679    2567 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 05 06:25:34.361689 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355681    2567 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 05 06:25:34.361689 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355686    2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 05 06:25:34.361689 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355688    2567 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 05 06:25:34.361689 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355691    2567 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 05 06:25:34.361689 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355694    2567 flags.go:64] FLAG: --enable-load-reader="false"
Sep 05 06:25:34.361689 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355698    2567 flags.go:64] FLAG: --enable-server="true"
Sep 05 06:25:34.361689 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355701    2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 05 06:25:34.361689 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355705    2567 flags.go:64] FLAG: --event-burst="100"
Sep 05 06:25:34.361689 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355708    2567 flags.go:64] FLAG: --event-qps="50"
Sep 05 06:25:34.361689 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355711    2567 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 05 06:25:34.361689 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355716    2567 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 05 06:25:34.361689 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355718    2567 flags.go:64] FLAG: --eviction-hard=""
Sep 05 06:25:34.361689 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355722    2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 05 06:25:34.361689 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355725    2567 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 05 06:25:34.361689 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355729    2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 05 06:25:34.361689 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355732    2567 flags.go:64] FLAG: --eviction-soft=""
Sep 05 06:25:34.361689 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355734    2567 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 05 06:25:34.361689 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355737    2567 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 05 06:25:34.361689 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355741    2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 05 06:25:34.361689 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355744    2567 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 05 06:25:34.362355 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355747    2567 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 05 06:25:34.362355 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355750    2567 flags.go:64] FLAG: --fail-swap-on="true"
Sep 05 06:25:34.362355 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355753    2567 flags.go:64] FLAG: --feature-gates=""
Sep 05 06:25:34.362355 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355757    2567 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 05 06:25:34.362355 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355760    2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 05 06:25:34.362355 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355763    2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 05 06:25:34.362355 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355766    2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 05 06:25:34.362355 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355769    2567 flags.go:64] FLAG: --healthz-port="10248"
Sep 05 06:25:34.362355 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355771    2567 flags.go:64] FLAG: --help="false"
Sep 05 06:25:34.362355 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355774    2567 flags.go:64] FLAG: --hostname-override="ip-10-0-141-49.ec2.internal"
Sep 05 06:25:34.362355 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355778    2567 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 05 06:25:34.362355 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355781    2567 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 05 06:25:34.362355 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355783    2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 05 06:25:34.362355 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355786    2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 05 06:25:34.362355 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355790    2567 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 05 06:25:34.362355 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355793    2567 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 05 06:25:34.362355 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355795    2567 flags.go:64] FLAG: --image-service-endpoint=""
Sep 05 06:25:34.362355 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355798    2567 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 05 06:25:34.362355 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355802    2567 flags.go:64] FLAG: --kube-api-burst="100"
Sep 05 06:25:34.362355 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355804    2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 05 06:25:34.362355 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355808    2567 flags.go:64] FLAG: --kube-api-qps="50"
Sep 05 06:25:34.362355 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355811    2567 flags.go:64] FLAG: --kube-reserved=""
Sep 05 06:25:34.362355 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355815    2567 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 05 06:25:34.362355 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355818    2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 05 06:25:34.362947 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355823    2567 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 05 06:25:34.362947 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355825    2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 05 06:25:34.362947 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355828    2567 flags.go:64] FLAG: --lock-file=""
Sep 05 06:25:34.362947 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355831    2567 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 05 06:25:34.362947 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355834    2567 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 05 06:25:34.362947 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355837    2567 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 05 06:25:34.362947 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355842    2567 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 05 06:25:34.362947 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355845    2567 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 05 06:25:34.362947 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355848    2567 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 05 06:25:34.362947 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355851    2567 flags.go:64] FLAG: --logging-format="text"
Sep 05 06:25:34.362947 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355854    2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 05 06:25:34.362947 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355858    2567 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 05 06:25:34.362947 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355861    2567 flags.go:64] FLAG: --manifest-url=""
Sep 05 06:25:34.362947 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355863    2567 flags.go:64] FLAG: --manifest-url-header=""
Sep 05 06:25:34.362947 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355868    2567 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 05 06:25:34.362947 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355871    2567 flags.go:64] FLAG: --max-open-files="1000000"
Sep 05 06:25:34.362947 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355875    2567 flags.go:64] FLAG: --max-pods="110"
Sep 05 06:25:34.362947 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355878    2567 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 05 06:25:34.362947 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355881    2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 05 06:25:34.362947 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355884    2567 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 05 06:25:34.362947 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355887    2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 05 06:25:34.362947 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355890    2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 05 06:25:34.362947 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355893    2567 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 05 06:25:34.362947 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355896    2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 05 06:25:34.362947 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355904    2567 flags.go:64] FLAG: --node-status-max-images="50"
Sep 05 06:25:34.363606 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355907    2567 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 05 06:25:34.363606 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355910    2567 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 05 06:25:34.363606 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355913    2567 flags.go:64] FLAG: --pod-cidr=""
Sep 05 06:25:34.363606 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355916    2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 05 06:25:34.363606 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355922    2567 flags.go:64] FLAG: --pod-manifest-path=""
Sep 05 06:25:34.363606 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355927    2567 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 05 06:25:34.363606 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355930    2567 flags.go:64] FLAG: --pods-per-core="0"
Sep 05 06:25:34.363606 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355933    2567 flags.go:64] FLAG: --port="10250"
Sep 05 06:25:34.363606 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355937    2567 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 05 06:25:34.363606 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355940    2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05ccce2e3dcfc35da"
Sep 05 06:25:34.363606 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355943    2567 flags.go:64] FLAG: --qos-reserved=""
Sep 05 06:25:34.363606 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355946    2567 flags.go:64] FLAG: --read-only-port="10255"
Sep 05 06:25:34.363606 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355949    2567 flags.go:64] FLAG: --register-node="true"
Sep 05 06:25:34.363606 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355951    2567 flags.go:64] FLAG: --register-with-taints=""
Sep 05 06:25:34.363606 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355955    2567 flags.go:64] FLAG: --registry-burst="10"
Sep 05 06:25:34.363606 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355958    2567 flags.go:64] FLAG: --registry-qps="5"
Sep 05 06:25:34.363606 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355961    2567 flags.go:64] FLAG: --reserved-cpus=""
Sep 05 06:25:34.363606 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355964    2567 flags.go:64] FLAG: --reserved-memory=""
Sep 05 06:25:34.363606 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355967    2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 05 06:25:34.363606 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355971    2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 05 06:25:34.363606 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355974    2567 flags.go:64] FLAG: --rotate-certificates="false"
Sep 05 06:25:34.363606 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355977    2567 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 05 06:25:34.363606 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355979    2567 flags.go:64] FLAG: --runonce="false"
Sep 05 06:25:34.363606 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355982    2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 05 06:25:34.363606 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355985    2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 05 06:25:34.364304 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355990    2567 flags.go:64] FLAG: --seccomp-default="false"
Sep 05 06:25:34.364304 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355993    2567 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 05 06:25:34.364304 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355996    2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 05 06:25:34.364304 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.355999    2567 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 05 06:25:34.364304 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.356002    2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 05 06:25:34.364304 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.356005    2567 flags.go:64] FLAG: --storage-driver-password="root"
Sep 05 06:25:34.364304 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.356007    2567 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 05 06:25:34.364304 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.356010    2567 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 05 06:25:34.364304 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.356013    2567 flags.go:64] FLAG: --storage-driver-user="root"
Sep 05 06:25:34.364304 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.356016    2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 05 06:25:34.364304 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.356020    2567 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 05 06:25:34.364304 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.356037    2567 flags.go:64] FLAG: --system-cgroups=""
Sep 05 06:25:34.364304 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.356042    2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 05 06:25:34.364304 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.356048    2567 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 05 06:25:34.364304 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.356051    2567 flags.go:64] FLAG: --tls-cert-file=""
Sep 05 06:25:34.364304 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.356055    2567 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 05 06:25:34.364304 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.356060    2567 flags.go:64] FLAG: --tls-min-version=""
Sep 05 06:25:34.364304 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.356063    2567 flags.go:64] FLAG: --tls-private-key-file=""
Sep 05 06:25:34.364304 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.356066    2567 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 05 06:25:34.364304 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.356069    2567 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 05 06:25:34.364304 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.356072    2567 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 05 06:25:34.364304 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.356075    2567 flags.go:64] FLAG: --v="2"
Sep 05 06:25:34.364304 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.356080    2567 flags.go:64] FLAG: --version="false"
Sep 05 06:25:34.364304 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.356088    2567 flags.go:64] FLAG: --vmodule=""
Sep 05 06:25:34.364304 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.356092    2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 05 06:25:34.365324 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.356095    2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 05 06:25:34.365324 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356223    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 05 06:25:34.365324 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356227    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 05 06:25:34.365324 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356231    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 05 06:25:34.365324 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356235    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 05 06:25:34.365324 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356237    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 05 06:25:34.365324 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356240    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 05 06:25:34.365324 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356243    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 05 06:25:34.365324 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356246    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 05 06:25:34.365324 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356249    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 05 06:25:34.365324 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356253    2567 feature_gate.go:328] unrecognized feature gate: Example
Sep 05 06:25:34.365324 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356256    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 05 06:25:34.365324 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356259    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 05 06:25:34.365324 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356261    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 05 06:25:34.365324 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356264    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 05 06:25:34.365324 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356267    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 05 06:25:34.365324 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356269    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 05 06:25:34.365324 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356272    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 05 06:25:34.365324 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356275    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 05 06:25:34.365324 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356278    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 05 06:25:34.365842 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356281    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 05 06:25:34.365842 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356283    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 05 06:25:34.365842 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356287    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 05 06:25:34.365842 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356290    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 05 06:25:34.365842 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356293    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 05 06:25:34.365842 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356295    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 05 06:25:34.365842 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356298    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 05 06:25:34.365842 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356300    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 05 06:25:34.365842 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356303    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 05 06:25:34.365842 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356306    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 05 06:25:34.365842 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356310    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 05 06:25:34.365842 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356313    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 05 06:25:34.365842 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356316    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 05 06:25:34.365842 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356318    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 05 06:25:34.365842 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356321    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 05 06:25:34.365842 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356324    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 05 06:25:34.365842 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356326    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 05 06:25:34.365842 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356329    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 05 06:25:34.365842 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356331    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 05 06:25:34.366373 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356334    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 05 06:25:34.366373 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356336    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 05 06:25:34.366373 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356339    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 05 06:25:34.366373 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356342    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 05 06:25:34.366373 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356344    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 05 06:25:34.366373 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356347    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 05 06:25:34.366373 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356349    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 05 06:25:34.366373 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356352    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 05 06:25:34.366373 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356354    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 05 06:25:34.366373 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356357    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 05 06:25:34.366373 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356360    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 05 06:25:34.366373 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356362    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 05 06:25:34.366373 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356366    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 05 06:25:34.366373 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356368    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 05 06:25:34.366373 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356371    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 05 06:25:34.366373 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356375    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 05 06:25:34.366373 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356378    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 05 06:25:34.366373 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356381    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 05 06:25:34.366373 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356383    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 05 06:25:34.366373 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356386    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 05 06:25:34.366880 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356388    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 05 06:25:34.366880 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356390    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 05 06:25:34.366880 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356393    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 05 06:25:34.366880 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356395    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 05 06:25:34.366880 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356398    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 05 06:25:34.366880 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356400    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 05 06:25:34.366880 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356403    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 05 06:25:34.366880 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356406    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 05 06:25:34.366880 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356409    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 05 06:25:34.366880 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356412    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 05 06:25:34.366880 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356415    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 05 06:25:34.366880 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356418    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 05 06:25:34.366880 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356421    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 05 06:25:34.366880 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356423    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 05 06:25:34.366880 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356426    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 05 06:25:34.366880 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356428    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 05 06:25:34.366880 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356431    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 05 06:25:34.366880 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356433    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 05 06:25:34.366880 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356436    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 05 06:25:34.367396 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356438    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 05 06:25:34.367396 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356441    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 05 06:25:34.367396 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356443    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 05 06:25:34.367396 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356445    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 05 06:25:34.367396 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356448    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 05 06:25:34.367396 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356450    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 05 06:25:34.367396 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356453    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 05 06:25:34.367396 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356456    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 05 06:25:34.367396 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356459    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 05 06:25:34.367396 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356462    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 05 06:25:34.367396 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356464    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 05 06:25:34.367396 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356467    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 05 06:25:34.367396 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356470    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 05 06:25:34.367396 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356472    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 05 06:25:34.367396 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356475    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 05 06:25:34.367396 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356477    2567 feature_gate.go:328] unrecognized feature gate: Example2
Sep 05 06:25:34.367396 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356480    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 05 06:25:34.367396 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356482    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 05 06:25:34.367396 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356485    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 05 06:25:34.367396 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356487    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 05 06:25:34.367916 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356490    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 05 06:25:34.367916 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.356492    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 05 06:25:34.367916 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.357192    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 05 06:25:34.367916 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.367329    2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 05 06:25:34.367916 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.367356    2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 05 06:25:34.367916 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.367382    2567 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 05 06:25:34.367916 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.367389    2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 05 06:25:34.367916 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367458    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 05 06:25:34.367916 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367465    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 05 06:25:34.367916 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367468    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 05 06:25:34.367916 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367471    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 05 06:25:34.367916 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367475    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 05 06:25:34.367916 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367477    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 05 06:25:34.367916 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367480    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 05 06:25:34.367916 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367483    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 05 06:25:34.368330 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367485    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 05 06:25:34.368330 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367488    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 05 06:25:34.368330 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367491    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 05 06:25:34.368330 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367493    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 05 06:25:34.368330 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367496    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 05 06:25:34.368330 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367499    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 05 06:25:34.368330 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367501    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 05 06:25:34.368330 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367504    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 05 06:25:34.368330 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367507    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 05 06:25:34.368330 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367509    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 05 06:25:34.368330 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367512    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 05 06:25:34.368330 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367514    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 05 06:25:34.368330 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367517    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 05 06:25:34.368330 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367520    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 05 06:25:34.368330 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367522    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 05 06:25:34.368330 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367525    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 05 06:25:34.368330 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367527    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 05 06:25:34.368330 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367530    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 05 06:25:34.368330 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367533    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 05 06:25:34.368330 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367536    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 05 06:25:34.368831 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367540    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 05 06:25:34.368831 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367543    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 05 06:25:34.368831 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367546    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 05 06:25:34.368831 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367549    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 05 06:25:34.368831 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367552    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 05 06:25:34.368831 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367554    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 05 06:25:34.368831 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367557    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 05 06:25:34.368831 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367560    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 05 06:25:34.368831 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367562    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 05 06:25:34.368831 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367566    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 05 06:25:34.368831 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367570    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 05 06:25:34.368831 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367573    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 05 06:25:34.368831 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367576    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 05 06:25:34.368831 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367590    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 05 06:25:34.368831 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367593    2567 feature_gate.go:328] unrecognized feature gate: Example
Sep 05 06:25:34.368831 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367596    2567 feature_gate.go:328] unrecognized feature gate: Example2
Sep 05 06:25:34.368831 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367599    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 05 06:25:34.368831 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367602    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 05 06:25:34.368831 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367604    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 05 06:25:34.368831 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367608    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 05 06:25:34.369497 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367610    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 05 06:25:34.369497 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367613    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 05 06:25:34.369497 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367616    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 05 06:25:34.369497 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367618    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 05 06:25:34.369497 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367621    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 05 06:25:34.369497 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367625    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 05 06:25:34.369497 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367629    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 05 06:25:34.369497 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367632    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 05 06:25:34.369497 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367635    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 05 06:25:34.369497 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367637    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 05 06:25:34.369497 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367640    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 05 06:25:34.369497 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367643    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 05 06:25:34.369497 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367646    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 05 06:25:34.369497 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367649    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 05 06:25:34.369497 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367651    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 05 06:25:34.369497 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367654    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 05 06:25:34.369497 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367657    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 05 06:25:34.369497 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367659    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 05 06:25:34.369497 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367662    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 05 06:25:34.370006 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367665    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 05 06:25:34.370006 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367667    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 05 06:25:34.370006 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367670    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 05 06:25:34.370006 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367673    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 05 06:25:34.370006 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367675    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 05 06:25:34.370006 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367678    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 05 06:25:34.370006 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367682    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 05 06:25:34.370006 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367685    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 05 06:25:34.370006 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367687    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 05 06:25:34.370006 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367690    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 05 06:25:34.370006 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367693    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 05 06:25:34.370006 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367695    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 05 06:25:34.370006 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367699    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 05 06:25:34.370006 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367702    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 05 06:25:34.370006 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367704    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 05 06:25:34.370006 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367707    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 05 06:25:34.370006 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367710    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 05 06:25:34.370006 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367712    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 05 06:25:34.370006 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367715    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 05 06:25:34.370487 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367717    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 05 06:25:34.370487 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367720    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 05 06:25:34.370487 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367722    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 05 06:25:34.370487 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367725    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 05 06:25:34.370487 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367728    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 05 06:25:34.370487 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367730    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 05 06:25:34.370487 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367733    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 05 06:25:34.370487 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367736    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 05 06:25:34.370487 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367739    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 05 06:25:34.370487 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367741    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 05 06:25:34.370487 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367744    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 05 06:25:34.370487 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367746    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 05 06:25:34.370487 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367750    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 05 06:25:34.370487 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.367757    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 05 06:25:34.370487 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367911    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 05 06:25:34.370860 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367918    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 05 06:25:34.370860 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367922    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 05 06:25:34.370860 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367925    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 05 06:25:34.370860 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367928    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 05 06:25:34.370860 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367931    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 05 06:25:34.370860 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367934    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 05 06:25:34.370860 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367937    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 05 06:25:34.370860 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367939    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 05 06:25:34.370860 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367942    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 05 06:25:34.370860 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367946    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 05 06:25:34.370860 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367950    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 05 06:25:34.370860 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367954    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 05 06:25:34.370860 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367957    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 05 06:25:34.370860 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367959    2567 feature_gate.go:328] unrecognized feature gate: Example2
Sep 05 06:25:34.370860 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367962    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 05 06:25:34.370860 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367965    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 05 06:25:34.370860 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367967    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 05 06:25:34.370860 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367970    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 05 06:25:34.370860 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367973    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 05 06:25:34.370860 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367975    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 05 06:25:34.371376 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367978    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 05 06:25:34.371376 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367980    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 05 06:25:34.371376 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367983    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 05 06:25:34.371376 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367988    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 05 06:25:34.371376 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367990    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 05 06:25:34.371376 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367993    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 05 06:25:34.371376 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367996    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 05 06:25:34.371376 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.367998    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 05 06:25:34.371376 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368001    2567 feature_gate.go:328] unrecognized feature gate: Example
Sep 05 06:25:34.371376 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368004    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 05 06:25:34.371376 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368006    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 05 06:25:34.371376 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368009    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 05 06:25:34.371376 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368012    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 05 06:25:34.371376 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368014    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 05 06:25:34.371376 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368017    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 05 06:25:34.371376 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368019    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 05 06:25:34.371376 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368022    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 05 06:25:34.371376 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368045    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 05 06:25:34.371376 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368048    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 05 06:25:34.371376 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368051    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 05 06:25:34.371921 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368054    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 05 06:25:34.371921 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368056    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 05 06:25:34.371921 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368059    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 05 06:25:34.371921 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368061    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 05 06:25:34.371921 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368066    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 05 06:25:34.371921 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368069    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 05 06:25:34.371921 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368072    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 05 06:25:34.371921 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368074    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 05 06:25:34.371921 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368077    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 05 06:25:34.371921 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368079    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 05 06:25:34.371921 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368082    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 05 06:25:34.371921 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368084    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 05 06:25:34.371921 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368087    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 05 06:25:34.371921 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368089    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 05 06:25:34.371921 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368093    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 05 06:25:34.371921 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368096    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 05 06:25:34.371921 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368099    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 05 06:25:34.371921 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368101    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 05 06:25:34.371921 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368104    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 05 06:25:34.371921 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368107    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 05 06:25:34.372521 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368110    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 05 06:25:34.372521 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368113    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 05 06:25:34.372521 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368115    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 05 06:25:34.372521 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368118    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 05 06:25:34.372521 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368120    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 05 06:25:34.372521 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368123    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 05 06:25:34.372521 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368127    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 05 06:25:34.372521 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368130    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 05 06:25:34.372521 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368133    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 05 06:25:34.372521 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368136    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 05 06:25:34.372521 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368138    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 05 06:25:34.372521 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368142    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 05 06:25:34.372521 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368145    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 05 06:25:34.372521 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368149    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 05 06:25:34.372521 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368152    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 05 06:25:34.372521 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368155    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 05 06:25:34.372521 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368158    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 05 06:25:34.372521 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368162    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 05 06:25:34.372955 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368165    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 05 06:25:34.372955 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368168    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 05 06:25:34.372955 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368170    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 05 06:25:34.372955 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368173    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 05 06:25:34.372955 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368175    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 05 06:25:34.372955 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368178    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 05 06:25:34.372955 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368180    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 05 06:25:34.372955 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368183    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 05 06:25:34.372955 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368186    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 05 06:25:34.372955 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368188    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 05 06:25:34.372955 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368191    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 05 06:25:34.372955 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368194    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 05 06:25:34.372955 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368196    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 05 06:25:34.372955 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368199    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 05 06:25:34.372955 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368202    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 05 06:25:34.372955 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368205    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 05 06:25:34.372955 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368208    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 05 06:25:34.372955 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368210    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 05 06:25:34.372955 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368213    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 05 06:25:34.372955 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:34.368215    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 05 06:25:34.373464 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.368220    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 05 06:25:34.373464 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.368378    2567 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 05 06:25:34.373464 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.370626    2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 05 06:25:34.373464 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.371610    2567 server.go:1019] "Starting client certificate rotation"
Sep 05 06:25:34.373464 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.371715    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 05 06:25:34.373464 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.371784    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 05 06:25:34.374476 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.374455    2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 05 06:25:34.378335 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.378312    2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 05 06:25:34.389625 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.389592    2567 log.go:25] "Validated CRI v1 runtime API"
Sep 05 06:25:34.392721 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.392702    2567 log.go:25] "Validated CRI v1 image API"
Sep 05 06:25:34.393624 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.393608    2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 05 06:25:34.397588 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.397566    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 05 06:25:34.398170 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.398143    2567 fs.go:135] Filesystem UUIDs: map[681bc6d0-dc88-4bda-97ad-eefc2bdafbba:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 91fe1b77-b4ed-4d7e-8f88-ee01f3fd26ad:/dev/nvme0n1p3]
Sep 05 06:25:34.398230 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.398171    2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 05 06:25:34.404836 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.404687    2567 manager.go:216] Machine: {Timestamp:2026-09-05 06:25:34.403335459 +0000 UTC m=+0.377090125 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102650 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28ad732cc5478cdbba155d2d168bc8 SystemUUID:ec28ad73-2cc5-478c-dbba-155d2d168bc8 BootID:4a8121da-6719-4ac8-ad6e-334d755b83a8 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3e:52:37:e0:3d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3e:52:37:e0:3d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:72:25:22:c4:88 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 05 06:25:34.404836 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.404814    2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 05 06:25:34.405035 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.404917    2567 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 05 06:25:34.408523 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.408486    2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 05 06:25:34.408680 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.408526    2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-49.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 05 06:25:34.409249 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.409235    2567 topology_manager.go:138] "Creating topology manager with none policy"
Sep 05 06:25:34.409249 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.409251    2567 container_manager_linux.go:309] "Creating device plugin manager"
Sep 05 06:25:34.409318 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.409259    2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 05 06:25:34.409980 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.409967    2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 05 06:25:34.410881 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.410867    2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 05 06:25:34.415110 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.415092    2567 state_mem.go:36] "Initialized new in-memory state store"
Sep 05 06:25:34.415267 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.415257    2567 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 05 06:25:34.415307 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.415291    2567 kubelet.go:486] "Attempting to sync node with API server"
Sep 05 06:25:34.415307 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.415302    2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 05 06:25:34.415361 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.415319    2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 05 06:25:34.415361 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.415330    2567 kubelet.go:398] "Adding apiserver pod source"
Sep 05 06:25:34.415361 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.415340    2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 05 06:25:34.415826 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.415809    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 05 06:25:34.415826 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.415837    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 05 06:25:34.418216 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.418190    2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 05 06:25:34.420651 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.420634    2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 05 06:25:34.420716 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.420666    2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 05 06:25:34.421712 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.421700    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 05 06:25:34.421757 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.421717    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 05 06:25:34.421757 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.421723    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 05 06:25:34.421757 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.421729    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 05 06:25:34.421757 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.421738    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 05 06:25:34.421757 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.421744    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 05 06:25:34.421757 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.421758    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 05 06:25:34.421908 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.421764    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 05 06:25:34.421908 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.421772    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 05 06:25:34.421908 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.421777    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 05 06:25:34.421908 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.421786    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 05 06:25:34.421908 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.421791    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 05 06:25:34.422623 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.422612    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 05 06:25:34.422667 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.422625    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 05 06:25:34.425670 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.425618    2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-49.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 05 06:25:34.425792 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:34.425687    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-49.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 05 06:25:34.425792 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:34.425687    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 05 06:25:34.427616 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.427602    2567 server.go:1268] "Started kubelet"
Sep 05 06:25:34.427713 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.427664    2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 05 06:25:34.427833 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.427693    2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 05 06:25:34.427833 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.427812    2567 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 05 06:25:34.428285 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.428260    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-z456s"
Sep 05 06:25:34.428581 ip-10-0-141-49 systemd[1]: Started Kubernetes Kubelet.
Sep 05 06:25:34.429182 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.428949    2567 server.go:310] "Adding debug handlers to kubelet server"
Sep 05 06:25:34.429434 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.429130    2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 05 06:25:34.433205 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:34.432177    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-49.ec2.internal.18d258b48889304d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-49.ec2.internal,UID:ip-10-0-141-49.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-49.ec2.internal,},FirstTimestamp:2026-09-05 06:25:34.427557965 +0000 UTC m=+0.401312630,LastTimestamp:2026-09-05 06:25:34.427557965 +0000 UTC m=+0.401312630,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-49.ec2.internal,}"
Sep 05 06:25:34.434459 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.434435    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 05 06:25:34.434968 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.434949    2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 05 06:25:34.435095 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:34.435073    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-49.ec2.internal\" not found"
Sep 05 06:25:34.435308 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:34.435282    2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 05 06:25:34.435703 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.435686    2567 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 05 06:25:34.435703 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.435705    2567 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 05 06:25:34.435799 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.435790    2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 05 06:25:34.435844 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.435836    2567 reconstruct.go:97] "Volume reconstruction finished"
Sep 05 06:25:34.435844 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.435843    2567 reconciler.go:29] "Reconciler: start to sync state"
Sep 05 06:25:34.436510 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.436492    2567 factory.go:55] Registering systemd factory
Sep 05 06:25:34.436510 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.436513    2567 factory.go:223] Registration of the systemd container factory successfully
Sep 05 06:25:34.436750 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.436734    2567 factory.go:153] Registering CRI-O factory
Sep 05 06:25:34.436750 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.436749    2567 factory.go:223] Registration of the crio container factory successfully
Sep 05 06:25:34.436851 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.436792    2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 05 06:25:34.436851 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.436807    2567 factory.go:103] Registering Raw factory
Sep 05 06:25:34.436851 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.436817    2567 manager.go:1196] Started watching for new ooms in manager
Sep 05 06:25:34.437234 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.437213    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-z456s"
Sep 05 06:25:34.437354 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.437254    2567 manager.go:349] Starting recovery of all containers
Sep 05 06:25:34.444747 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:34.444708    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 05 06:25:34.444925 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:34.444839    2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-49.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 05 06:25:34.450360 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.450337    2567 manager.go:354] Recovery completed
Sep 05 06:25:34.454781 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.454764    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 05 06:25:34.456787 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.456764    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-49.ec2.internal" event="NodeHasSufficientMemory"
Sep 05 06:25:34.456883 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.456811    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-49.ec2.internal" event="NodeHasNoDiskPressure"
Sep 05 06:25:34.456883 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.456827    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-49.ec2.internal" event="NodeHasSufficientPID"
Sep 05 06:25:34.457422 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.457405    2567 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 05 06:25:34.457422 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.457422    2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 05 06:25:34.457551 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.457412    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 05 06:25:34.457551 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.457443    2567 state_mem.go:36] "Initialized new in-memory state store"
Sep 05 06:25:34.458119 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.458104    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-49.ec2.internal" event="NodeHasSufficientMemory"
Sep 05 06:25:34.458184 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.458137    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-49.ec2.internal" event="NodeHasNoDiskPressure"
Sep 05 06:25:34.458184 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.458151    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-49.ec2.internal" event="NodeHasSufficientPID"
Sep 05 06:25:34.459712 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.459697    2567 policy_none.go:49] "None policy: Start"
Sep 05 06:25:34.459763 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.459716    2567 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 05 06:25:34.459763 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.459727    2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 05 06:25:34.461786 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.461771    2567 policy_none.go:47] "Start"
Sep 05 06:25:34.503852 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.503828    2567 manager.go:337] "Starting Device Plugin manager"
Sep 05 06:25:34.519103 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:34.503884    2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 05 06:25:34.519103 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.503898    2567 server.go:87] "Starting device plugin registration server"
Sep 05 06:25:34.519103 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.504377    2567 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 05 06:25:34.519103 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.504392    2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 05 06:25:34.519103 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.504488    2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 05 06:25:34.519103 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.504600    2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 05 06:25:34.519103 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.504609    2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 05 06:25:34.519103 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:34.505104    2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 05 06:25:34.519103 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:34.505152    2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-49.ec2.internal\" not found"
Sep 05 06:25:34.572695 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.572646    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 05 06:25:34.574229 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.574200    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 05 06:25:34.574389 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.574282    2567 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 05 06:25:34.574389 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.574318    2567 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 05 06:25:34.574389 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:34.574362    2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 05 06:25:34.577305 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.577277    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 05 06:25:34.605505 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.605396    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 05 06:25:34.606460 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.606440    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-49.ec2.internal" event="NodeHasSufficientMemory"
Sep 05 06:25:34.606565 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.606473    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-49.ec2.internal" event="NodeHasNoDiskPressure"
Sep 05 06:25:34.606565 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.606485    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-49.ec2.internal" event="NodeHasSufficientPID"
Sep 05 06:25:34.606565 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.606509    2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-49.ec2.internal"
Sep 05 06:25:34.615017 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.614992    2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-49.ec2.internal"
Sep 05 06:25:34.615144 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:34.615050    2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-49.ec2.internal\": node \"ip-10-0-141-49.ec2.internal\" not found"
Sep 05 06:25:34.631389 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:34.631355    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-49.ec2.internal\" not found"
Sep 05 06:25:34.675505 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.675467    2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-49.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-49.ec2.internal"]
Sep 05 06:25:34.675649 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.675557    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 05 06:25:34.677135 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.677118    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-49.ec2.internal" event="NodeHasSufficientMemory"
Sep 05 06:25:34.677228 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.677148    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-49.ec2.internal" event="NodeHasNoDiskPressure"
Sep 05 06:25:34.677228 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.677160    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-49.ec2.internal" event="NodeHasSufficientPID"
Sep 05 06:25:34.679298 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.679283    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 05 06:25:34.679405 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.679389    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-49.ec2.internal"
Sep 05 06:25:34.679475 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.679432    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 05 06:25:34.680254 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.680235    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-49.ec2.internal" event="NodeHasSufficientMemory"
Sep 05 06:25:34.680365 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.680270    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-49.ec2.internal" event="NodeHasNoDiskPressure"
Sep 05 06:25:34.680365 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.680284    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-49.ec2.internal" event="NodeHasSufficientPID"
Sep 05 06:25:34.680365 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.680285    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-49.ec2.internal" event="NodeHasSufficientMemory"
Sep 05 06:25:34.680365 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.680309    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-49.ec2.internal" event="NodeHasNoDiskPressure"
Sep 05 06:25:34.680365 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.680320    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-49.ec2.internal" event="NodeHasSufficientPID"
Sep 05 06:25:34.682423 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.682404    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-49.ec2.internal"
Sep 05 06:25:34.682516 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.682441    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 05 06:25:34.683243 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.683227    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-49.ec2.internal" event="NodeHasSufficientMemory"
Sep 05 06:25:34.683334 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.683261    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-49.ec2.internal" event="NodeHasNoDiskPressure"
Sep 05 06:25:34.683334 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.683276    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-49.ec2.internal" event="NodeHasSufficientPID"
Sep 05 06:25:34.715226 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:34.715197    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-49.ec2.internal\" not found" node="ip-10-0-141-49.ec2.internal"
Sep 05 06:25:34.719845 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:34.719824    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-49.ec2.internal\" not found" node="ip-10-0-141-49.ec2.internal"
Sep 05 06:25:34.732393 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:34.732366    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-49.ec2.internal\" not found"
Sep 05 06:25:34.833088 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:34.833053    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-49.ec2.internal\" not found"
Sep 05 06:25:34.837371 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.837352    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/83997819976fe16ec940b23b2f10ee3f-config\") pod \"kube-apiserver-proxy-ip-10-0-141-49.ec2.internal\" (UID: \"83997819976fe16ec940b23b2f10ee3f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-49.ec2.internal"
Sep 05 06:25:34.837442 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.837378    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8580d389453c76b8677803848f8baeb7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-49.ec2.internal\" (UID: \"8580d389453c76b8677803848f8baeb7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-49.ec2.internal"
Sep 05 06:25:34.837442 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.837398    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8580d389453c76b8677803848f8baeb7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-49.ec2.internal\" (UID: \"8580d389453c76b8677803848f8baeb7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-49.ec2.internal"
Sep 05 06:25:34.933879 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:34.933800    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-49.ec2.internal\" not found"
Sep 05 06:25:34.938154 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.938130    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/83997819976fe16ec940b23b2f10ee3f-config\") pod \"kube-apiserver-proxy-ip-10-0-141-49.ec2.internal\" (UID: \"83997819976fe16ec940b23b2f10ee3f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-49.ec2.internal"
Sep 05 06:25:34.938226 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.938161    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8580d389453c76b8677803848f8baeb7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-49.ec2.internal\" (UID: \"8580d389453c76b8677803848f8baeb7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-49.ec2.internal"
Sep 05 06:25:34.938226 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.938179    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8580d389453c76b8677803848f8baeb7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-49.ec2.internal\" (UID: \"8580d389453c76b8677803848f8baeb7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-49.ec2.internal"
Sep 05 06:25:34.938326 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.938239    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8580d389453c76b8677803848f8baeb7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-49.ec2.internal\" (UID: \"8580d389453c76b8677803848f8baeb7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-49.ec2.internal"
Sep 05 06:25:34.938326 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.938252    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8580d389453c76b8677803848f8baeb7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-49.ec2.internal\" (UID: \"8580d389453c76b8677803848f8baeb7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-49.ec2.internal"
Sep 05 06:25:34.938326 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:34.938262    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/83997819976fe16ec940b23b2f10ee3f-config\") pod \"kube-apiserver-proxy-ip-10-0-141-49.ec2.internal\" (UID: \"83997819976fe16ec940b23b2f10ee3f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-49.ec2.internal"
Sep 05 06:25:35.018332 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:35.018295    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-49.ec2.internal"
Sep 05 06:25:35.023666 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:35.023628    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-49.ec2.internal"
Sep 05 06:25:35.034536 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:35.034502    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-49.ec2.internal\" not found"
Sep 05 06:25:35.135092 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:35.135046    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-49.ec2.internal\" not found"
Sep 05 06:25:35.235528 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:35.235493    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-49.ec2.internal\" not found"
Sep 05 06:25:35.336015 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:35.335974    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-49.ec2.internal\" not found"
Sep 05 06:25:35.371373 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:35.371330    2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 05 06:25:35.371844 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:35.371508    2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 05 06:25:35.436196 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:35.436163    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-49.ec2.internal\" not found"
Sep 05 06:25:35.443082 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:35.443042    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-04 06:20:34 +0000 UTC" deadline="2028-04-30 11:47:40.03204122 +0000 UTC"
Sep 05 06:25:35.443082 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:35.443071    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14477h22m4.58897296s"
Sep 05 06:25:35.477275 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:35.477241    2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 05 06:25:35.536832 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:35.536729    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-49.ec2.internal\" not found"
Sep 05 06:25:35.592395 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:35.592357    2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 05 06:25:35.637189 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:35.637152    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-49.ec2.internal\" not found"
Sep 05 06:25:35.737635 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:35.737591    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-49.ec2.internal\" not found"
Sep 05 06:25:35.790573 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:35.790539    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83997819976fe16ec940b23b2f10ee3f.slice/crio-a181c3233008c8539ccc1538df1632a387fa24035c4989bb65c5a691e0969c36 WatchSource:0}: Error finding container a181c3233008c8539ccc1538df1632a387fa24035c4989bb65c5a691e0969c36: Status 404 returned error can't find the container with id a181c3233008c8539ccc1538df1632a387fa24035c4989bb65c5a691e0969c36
Sep 05 06:25:35.791954 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:35.791937    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 05 06:25:35.838222 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:35.838181    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-49.ec2.internal\" not found"
Sep 05 06:25:35.924464 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:35.924431    2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 05 06:25:35.936502 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:35.936462    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-49.ec2.internal"
Sep 05 06:25:35.948254 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:35.948218    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 05 06:25:35.949299 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:35.949281    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-49.ec2.internal"
Sep 05 06:25:35.962477 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:35.962450    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 05 06:25:36.371834 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.371798    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 05 06:25:36.416566 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.416519    2567 apiserver.go:52] "Watching apiserver"
Sep 05 06:25:36.425582 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.425388    2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 05 06:25:36.425923 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.425894    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-st2vb","openshift-dns/node-resolver-gqtqf","openshift-multus/multus-vzbwh","openshift-ovn-kubernetes/ovnkube-node-v7bb4","openshift-image-registry/node-ca-d8ftv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-49.ec2.internal","openshift-multus/multus-additional-cni-plugins-d6lsz","openshift-multus/network-metrics-daemon-sdsjs","openshift-network-diagnostics/network-check-target-sg8b7","openshift-network-operator/iptables-alerter-4bhxt","kube-system/global-pull-secret-syncer-ddpb9","kube-system/konnectivity-agent-snbwl","kube-system/kube-apiserver-proxy-ip-10-0-141-49.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtpzl"]
Sep 05 06:25:36.428816 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.428781    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4bhxt"
Sep 05 06:25:36.432716 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.432687    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 05 06:25:36.433079 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.433059    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 05 06:25:36.433330 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.433299    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 05 06:25:36.433552 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.433535    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bn4jm\""
Sep 05 06:25:36.438372 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.437696    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 05 06:25:36.441475 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.441094    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.446921 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.446712    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-ovn-node-metrics-cert\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.446921 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.446757    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/abbd8c4a-73d0-4380-b78a-c3ed5b70efd2-iptables-alerter-script\") pod \"iptables-alerter-4bhxt\" (UID: \"abbd8c4a-73d0-4380-b78a-c3ed5b70efd2\") " pod="openshift-network-operator/iptables-alerter-4bhxt"
Sep 05 06:25:36.446921 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.446801    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-etc-openvswitch\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.446921 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.446827    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-run-openvswitch\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.446921 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.446884    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-log-socket\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.446921 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.446907    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-host-cni-bin\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.447309 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.446931    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.447309 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.446963    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-env-overrides\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.447309 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.447019    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcgrd\" (UniqueName: \"kubernetes.io/projected/abbd8c4a-73d0-4380-b78a-c3ed5b70efd2-kube-api-access-dcgrd\") pod \"iptables-alerter-4bhxt\" (UID: \"abbd8c4a-73d0-4380-b78a-c3ed5b70efd2\") " pod="openshift-network-operator/iptables-alerter-4bhxt"
Sep 05 06:25:36.447309 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.447045    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-host-kubelet\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.447309 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.447070    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-host-run-ovn-kubernetes\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.447309 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.447096    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-ovnkube-config\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.447309 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.447141    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-ovnkube-script-lib\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.447309 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.447167    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvl5b\" (UniqueName: \"kubernetes.io/projected/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-kube-api-access-tvl5b\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.447309 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.447196    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-systemd-units\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.447309 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.447219    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-host-slash\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.447309 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.447243    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-var-lib-openvswitch\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.447309 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.447271    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-run-ovn\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.447309 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.447306    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-host-cni-netd\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.447919 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.447331    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/abbd8c4a-73d0-4380-b78a-c3ed5b70efd2-host-slash\") pod \"iptables-alerter-4bhxt\" (UID: \"abbd8c4a-73d0-4380-b78a-c3ed5b70efd2\") " pod="openshift-network-operator/iptables-alerter-4bhxt"
Sep 05 06:25:36.447919 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.447356    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-host-run-netns\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.447919 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.447393    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-run-systemd\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.447919 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.447422    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-node-log\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.449492 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.449000    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 05 06:25:36.449492 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.449098    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lk6g8\""
Sep 05 06:25:36.449492 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.449146    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 05 06:25:36.449492 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.449195    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 05 06:25:36.449492 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.449278    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 05 06:25:36.450389 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.450089    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 05 06:25:36.452702 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.451205    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 05 06:25:36.453561 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.453537    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddpb9"
Sep 05 06:25:36.453674 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:36.453633    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddpb9" podUID="486067d7-7a47-4c88-86d6-721fcd141e43"
Sep 05 06:25:36.456935 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.456296    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.462066 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.459417    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 05 06:25:36.462066 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.461657    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 05 06:25:36.462066 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.461737    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 05 06:25:36.462066 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.461933    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 05 06:25:36.462066 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.462037    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ct5dn\""
Sep 05 06:25:36.462589 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.462287    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 05 06:25:36.462589 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.462332    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d8ftv"
Sep 05 06:25:36.465855 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.465212    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 05 06:25:36.465855 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.465458    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 05 06:25:36.465855 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.465545    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 05 06:25:36.465855 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.465596    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-797lp\""
Sep 05 06:25:36.467456 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.467299    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sg8b7"
Sep 05 06:25:36.467456 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:36.467377    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sg8b7" podUID="e2b1bc6a-ad1b-422b-8e17-159ee06e7990"
Sep 05 06:25:36.470486 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.469826    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gqtqf"
Sep 05 06:25:36.472934 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.472505    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.473396 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.473372    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 05 06:25:36.473667 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.473648    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 05 06:25:36.474104 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.473890    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g79fb\""
Sep 05 06:25:36.475134 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.475111    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 05 06:25:36.475586 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.475394    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 05 06:25:36.475988 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.475684    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d6lsz"
Sep 05 06:25:36.477091 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.477034    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-w2jl5\""
Sep 05 06:25:36.477908 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.477888    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-snbwl"
Sep 05 06:25:36.478899 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.478846    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hqmbg"
Sep 05 06:25:36.479681 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.479662    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 05 06:25:36.479865 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.479851    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 05 06:25:36.480075 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.480059    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7l6lj\""
Sep 05 06:25:36.480459 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.480442    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdsjs"
Sep 05 06:25:36.480529 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:36.480516    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sdsjs" podUID="b63a35b8-5230-4b6a-8237-e7afcaf6182e"
Sep 05 06:25:36.481497 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.481255    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 05 06:25:36.481497 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.481469    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 05 06:25:36.481639 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.481606    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bqpbf\""
Sep 05 06:25:36.483522 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.483346    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtpzl"
Sep 05 06:25:36.485997 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.485969    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 05 06:25:36.486328 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.486305    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 05 06:25:36.486606 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.486580    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wvcj9\""
Sep 05 06:25:36.487230 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.487202    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 05 06:25:36.490428 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.490400    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hqmbg"
Sep 05 06:25:36.537122 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.537083    2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 05 06:25:36.548589 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.548551    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-node-log\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.548785 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.548605    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cfb4483c-d0eb-4434-95e5-46fdb9618271-host\") pod \"node-ca-d8ftv\" (UID: \"cfb4483c-d0eb-4434-95e5-46fdb9618271\") " pod="openshift-image-registry/node-ca-d8ftv"
Sep 05 06:25:36.548785 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.548637    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/78512c00-0c79-4b8a-8f76-7c852a909337-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d6lsz\" (UID: \"78512c00-0c79-4b8a-8f76-7c852a909337\") " pod="openshift-multus/multus-additional-cni-plugins-d6lsz"
Sep 05 06:25:36.548785 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.548664    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/486067d7-7a47-4c88-86d6-721fcd141e43-kubelet-config\") pod \"global-pull-secret-syncer-ddpb9\" (UID: \"486067d7-7a47-4c88-86d6-721fcd141e43\") " pod="kube-system/global-pull-secret-syncer-ddpb9"
Sep 05 06:25:36.548785 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.548702    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf-sys-fs\") pod \"aws-ebs-csi-driver-node-vtpzl\" (UID: \"9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtpzl"
Sep 05 06:25:36.548785 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.548735    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/abbd8c4a-73d0-4380-b78a-c3ed5b70efd2-iptables-alerter-script\") pod \"iptables-alerter-4bhxt\" (UID: \"abbd8c4a-73d0-4380-b78a-c3ed5b70efd2\") " pod="openshift-network-operator/iptables-alerter-4bhxt"
Sep 05 06:25:36.548785 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.548764    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-env-overrides\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.549213 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.548790    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-ovnkube-script-lib\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.549213 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.548815    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b130d031-50f3-4eb7-814d-fa16c13948cd-host\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.549213 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.548852    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b63a35b8-5230-4b6a-8237-e7afcaf6182e-metrics-certs\") pod \"network-metrics-daemon-sdsjs\" (UID: \"b63a35b8-5230-4b6a-8237-e7afcaf6182e\") " pod="openshift-multus/network-metrics-daemon-sdsjs"
Sep 05 06:25:36.549213 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.548878    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-etc-kubernetes\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.549213 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.548917    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcgrd\" (UniqueName: \"kubernetes.io/projected/abbd8c4a-73d0-4380-b78a-c3ed5b70efd2-kube-api-access-dcgrd\") pod \"iptables-alerter-4bhxt\" (UID: \"abbd8c4a-73d0-4380-b78a-c3ed5b70efd2\") " pod="openshift-network-operator/iptables-alerter-4bhxt"
Sep 05 06:25:36.549213 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.548944    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-host-kubelet\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.549213 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.548978    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-ovnkube-config\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.549213 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549003    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvl5b\" (UniqueName: \"kubernetes.io/projected/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-kube-api-access-tvl5b\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.549213 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549029    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/78512c00-0c79-4b8a-8f76-7c852a909337-cni-binary-copy\") pod \"multus-additional-cni-plugins-d6lsz\" (UID: \"78512c00-0c79-4b8a-8f76-7c852a909337\") " pod="openshift-multus/multus-additional-cni-plugins-d6lsz"
Sep 05 06:25:36.549213 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549055    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b7ed807e-6f50-4ceb-bc81-c95d18d4c24f-agent-certs\") pod \"konnectivity-agent-snbwl\" (UID: \"b7ed807e-6f50-4ceb-bc81-c95d18d4c24f\") " pod="kube-system/konnectivity-agent-snbwl"
Sep 05 06:25:36.549213 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549100    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-run-ovn\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.549213 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549129    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78512c00-0c79-4b8a-8f76-7c852a909337-system-cni-dir\") pod \"multus-additional-cni-plugins-d6lsz\" (UID: \"78512c00-0c79-4b8a-8f76-7c852a909337\") " pod="openshift-multus/multus-additional-cni-plugins-d6lsz"
Sep 05 06:25:36.549213 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549155    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/78512c00-0c79-4b8a-8f76-7c852a909337-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d6lsz\" (UID: \"78512c00-0c79-4b8a-8f76-7c852a909337\") " pod="openshift-multus/multus-additional-cni-plugins-d6lsz"
Sep 05 06:25:36.549213 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549181    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/78512c00-0c79-4b8a-8f76-7c852a909337-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d6lsz\" (UID: \"78512c00-0c79-4b8a-8f76-7c852a909337\") " pod="openshift-multus/multus-additional-cni-plugins-d6lsz"
Sep 05 06:25:36.549213 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549217    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b130d031-50f3-4eb7-814d-fa16c13948cd-etc-sysconfig\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.549931 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549242    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b130d031-50f3-4eb7-814d-fa16c13948cd-sys\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.549931 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549269    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-multus-socket-dir-parent\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.549931 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549293    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b130d031-50f3-4eb7-814d-fa16c13948cd-etc-systemd\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.549931 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549318    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-host-run-netns\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.549931 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549345    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-run-systemd\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.549931 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549368    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cfb4483c-d0eb-4434-95e5-46fdb9618271-serviceca\") pod \"node-ca-d8ftv\" (UID: \"cfb4483c-d0eb-4434-95e5-46fdb9618271\") " pod="openshift-image-registry/node-ca-d8ftv"
Sep 05 06:25:36.549931 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549395    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf-registration-dir\") pod \"aws-ebs-csi-driver-node-vtpzl\" (UID: \"9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtpzl"
Sep 05 06:25:36.549931 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549420    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-host-var-lib-cni-bin\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.549931 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549479    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-host-var-lib-cni-multus\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.549931 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549505    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-etc-openvswitch\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.549931 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549531    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-log-socket\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.549931 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549559    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/486067d7-7a47-4c88-86d6-721fcd141e43-original-pull-secret\") pod \"global-pull-secret-syncer-ddpb9\" (UID: \"486067d7-7a47-4c88-86d6-721fcd141e43\") " pod="kube-system/global-pull-secret-syncer-ddpb9"
Sep 05 06:25:36.549931 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549598    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b130d031-50f3-4eb7-814d-fa16c13948cd-tmp\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.549931 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549622    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vtpzl\" (UID: \"9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtpzl"
Sep 05 06:25:36.549931 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549643    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf-etc-selinux\") pod \"aws-ebs-csi-driver-node-vtpzl\" (UID: \"9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtpzl"
Sep 05 06:25:36.549931 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549668    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-host-run-k8s-cni-cncf-io\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.549931 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549683    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-hostroot\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.550475 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549700    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-host-run-ovn-kubernetes\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.550475 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549717    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/78512c00-0c79-4b8a-8f76-7c852a909337-cnibin\") pod \"multus-additional-cni-plugins-d6lsz\" (UID: \"78512c00-0c79-4b8a-8f76-7c852a909337\") " pod="openshift-multus/multus-additional-cni-plugins-d6lsz"
Sep 05 06:25:36.550475 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549732    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b130d031-50f3-4eb7-814d-fa16c13948cd-run\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.550475 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549749    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf-device-dir\") pod \"aws-ebs-csi-driver-node-vtpzl\" (UID: \"9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtpzl"
Sep 05 06:25:36.550475 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549765    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfsq8\" (UniqueName: \"kubernetes.io/projected/c2189095-f1cc-411d-b6ec-7ddc003732f7-kube-api-access-sfsq8\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.550475 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549781    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-host-cni-netd\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.550475 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549798    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqzw6\" (UniqueName: \"kubernetes.io/projected/cfb4483c-d0eb-4434-95e5-46fdb9618271-kube-api-access-tqzw6\") pod \"node-ca-d8ftv\" (UID: \"cfb4483c-d0eb-4434-95e5-46fdb9618271\") " pod="openshift-image-registry/node-ca-d8ftv"
Sep 05 06:25:36.550475 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549814    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn726\" (UniqueName: \"kubernetes.io/projected/78512c00-0c79-4b8a-8f76-7c852a909337-kube-api-access-pn726\") pod \"multus-additional-cni-plugins-d6lsz\" (UID: \"78512c00-0c79-4b8a-8f76-7c852a909337\") " pod="openshift-multus/multus-additional-cni-plugins-d6lsz"
Sep 05 06:25:36.550475 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549829    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/486067d7-7a47-4c88-86d6-721fcd141e43-dbus\") pod \"global-pull-secret-syncer-ddpb9\" (UID: \"486067d7-7a47-4c88-86d6-721fcd141e43\") " pod="kube-system/global-pull-secret-syncer-ddpb9"
Sep 05 06:25:36.550475 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549843    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b130d031-50f3-4eb7-814d-fa16c13948cd-etc-kubernetes\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.550475 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549858    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-cnibin\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.550475 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549880    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/abbd8c4a-73d0-4380-b78a-c3ed5b70efd2-host-slash\") pod \"iptables-alerter-4bhxt\" (UID: \"abbd8c4a-73d0-4380-b78a-c3ed5b70efd2\") " pod="openshift-network-operator/iptables-alerter-4bhxt"
Sep 05 06:25:36.550475 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549899    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-ovn-node-metrics-cert\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.550475 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549916    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b130d031-50f3-4eb7-814d-fa16c13948cd-etc-tuned\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.550475 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549935    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-host-run-netns\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.550475 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549956    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-host-cni-bin\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.550475 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549973    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b130d031-50f3-4eb7-814d-fa16c13948cd-etc-sysctl-conf\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.550993 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.549988    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-host-var-lib-kubelet\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.550993 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.550008    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-systemd-units\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.550993 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.550025    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-host-slash\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.550993 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.550073    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-var-lib-openvswitch\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.550993 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.550091    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b7ed807e-6f50-4ceb-bc81-c95d18d4c24f-konnectivity-ca\") pod \"konnectivity-agent-snbwl\" (UID: \"b7ed807e-6f50-4ceb-bc81-c95d18d4c24f\") " pod="kube-system/konnectivity-agent-snbwl"
Sep 05 06:25:36.550993 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.550126    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b130d031-50f3-4eb7-814d-fa16c13948cd-lib-modules\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.550993 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.550144    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b130d031-50f3-4eb7-814d-fa16c13948cd-var-lib-kubelet\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.550993 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.550160    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6258b8f7-e185-4e63-8f2d-5f693cd6f19a-hosts-file\") pod \"node-resolver-gqtqf\" (UID: \"6258b8f7-e185-4e63-8f2d-5f693cd6f19a\") " pod="openshift-dns/node-resolver-gqtqf"
Sep 05 06:25:36.550993 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.550176    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b130d031-50f3-4eb7-814d-fa16c13948cd-etc-modprobe-d\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.550993 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.550193    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhrnm\" (UniqueName: \"kubernetes.io/projected/b63a35b8-5230-4b6a-8237-e7afcaf6182e-kube-api-access-jhrnm\") pod \"network-metrics-daemon-sdsjs\" (UID: \"b63a35b8-5230-4b6a-8237-e7afcaf6182e\") " pod="openshift-multus/network-metrics-daemon-sdsjs"
Sep 05 06:25:36.550993 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.550213    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6js5z\" (UniqueName: \"kubernetes.io/projected/9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf-kube-api-access-6js5z\") pod \"aws-ebs-csi-driver-node-vtpzl\" (UID: \"9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtpzl"
Sep 05 06:25:36.550993 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.550228    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-multus-conf-dir\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.550993 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.550246    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-host-run-multus-certs\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.550993 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.550267    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-run-openvswitch\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.550993 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.550287    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.550993 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.550303    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlwh7\" (UniqueName: \"kubernetes.io/projected/e2b1bc6a-ad1b-422b-8e17-159ee06e7990-kube-api-access-rlwh7\") pod \"network-check-target-sg8b7\" (UID: \"e2b1bc6a-ad1b-422b-8e17-159ee06e7990\") " pod="openshift-network-diagnostics/network-check-target-sg8b7"
Sep 05 06:25:36.551748 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.550321    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6258b8f7-e185-4e63-8f2d-5f693cd6f19a-tmp-dir\") pod \"node-resolver-gqtqf\" (UID: \"6258b8f7-e185-4e63-8f2d-5f693cd6f19a\") " pod="openshift-dns/node-resolver-gqtqf"
Sep 05 06:25:36.551748 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.550337    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf-socket-dir\") pod \"aws-ebs-csi-driver-node-vtpzl\" (UID: \"9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtpzl"
Sep 05 06:25:36.551748 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.550353    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2zhc\" (UniqueName: \"kubernetes.io/projected/6258b8f7-e185-4e63-8f2d-5f693cd6f19a-kube-api-access-v2zhc\") pod \"node-resolver-gqtqf\" (UID: \"6258b8f7-e185-4e63-8f2d-5f693cd6f19a\") " pod="openshift-dns/node-resolver-gqtqf"
Sep 05 06:25:36.551748 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.550370    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b130d031-50f3-4eb7-814d-fa16c13948cd-etc-sysctl-d\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.551748 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.550386    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjrrv\" (UniqueName: \"kubernetes.io/projected/b130d031-50f3-4eb7-814d-fa16c13948cd-kube-api-access-rjrrv\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.551748 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.550401    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-system-cni-dir\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.551748 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.550416    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-multus-cni-dir\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.551748 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.550435    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c2189095-f1cc-411d-b6ec-7ddc003732f7-cni-binary-copy\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.551748 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.550451    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c2189095-f1cc-411d-b6ec-7ddc003732f7-multus-daemon-config\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.551748 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.550536    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-node-log\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.551748 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.551072    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/abbd8c4a-73d0-4380-b78a-c3ed5b70efd2-iptables-alerter-script\") pod \"iptables-alerter-4bhxt\" (UID: \"abbd8c4a-73d0-4380-b78a-c3ed5b70efd2\") " pod="openshift-network-operator/iptables-alerter-4bhxt"
Sep 05 06:25:36.551748 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.551580    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-env-overrides\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.551748 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.551647    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-host-cni-netd\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.552443 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.551762    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-host-cni-bin\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.552443 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.551839    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-systemd-units\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.552443 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.551882    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-host-slash\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.552443 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.551925    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-var-lib-openvswitch\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.552443 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.552004    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-host-kubelet\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.552443 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.552170    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-etc-openvswitch\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.552443 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.552225    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-log-socket\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.552443 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.552307    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-run-openvswitch\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.552443 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.552353    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.552443 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.552428    2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 05 06:25:36.553020 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.552461    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-ovnkube-config\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.553020 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.552782    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-run-ovn\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.553020 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.552892    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-host-run-ovn-kubernetes\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.553020 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.552989    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-host-run-netns\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.553247 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.553039    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-run-systemd\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.553247 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.553088    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/abbd8c4a-73d0-4380-b78a-c3ed5b70efd2-host-slash\") pod \"iptables-alerter-4bhxt\" (UID: \"abbd8c4a-73d0-4380-b78a-c3ed5b70efd2\") " pod="openshift-network-operator/iptables-alerter-4bhxt"
Sep 05 06:25:36.553354 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.553327    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-ovnkube-script-lib\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.557891 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.557707    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-ovn-node-metrics-cert\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.561798 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.561747    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvl5b\" (UniqueName: \"kubernetes.io/projected/7f8a8f16-2422-4c01-a619-1f17fe10cd4c-kube-api-access-tvl5b\") pod \"ovnkube-node-v7bb4\" (UID: \"7f8a8f16-2422-4c01-a619-1f17fe10cd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.566447 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.566400    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcgrd\" (UniqueName: \"kubernetes.io/projected/abbd8c4a-73d0-4380-b78a-c3ed5b70efd2-kube-api-access-dcgrd\") pod \"iptables-alerter-4bhxt\" (UID: \"abbd8c4a-73d0-4380-b78a-c3ed5b70efd2\") " pod="openshift-network-operator/iptables-alerter-4bhxt"
Sep 05 06:25:36.585095 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.582155    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-49.ec2.internal" event={"ID":"83997819976fe16ec940b23b2f10ee3f","Type":"ContainerStarted","Data":"a181c3233008c8539ccc1538df1632a387fa24035c4989bb65c5a691e0969c36"}
Sep 05 06:25:36.585095 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.584169    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-49.ec2.internal" event={"ID":"8580d389453c76b8677803848f8baeb7","Type":"ContainerStarted","Data":"6dc5e2a14869ead2119c827e09e99ab5d87edcaad2f9ed190cafe0ce38fae7dd"}
Sep 05 06:25:36.651470 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.651367    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b130d031-50f3-4eb7-814d-fa16c13948cd-etc-tuned\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.651470 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.651425    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-host-run-netns\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.651470 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.651454    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b130d031-50f3-4eb7-814d-fa16c13948cd-etc-sysctl-conf\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.651763 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.651480    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-host-var-lib-kubelet\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.651763 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.651509    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b7ed807e-6f50-4ceb-bc81-c95d18d4c24f-konnectivity-ca\") pod \"konnectivity-agent-snbwl\" (UID: \"b7ed807e-6f50-4ceb-bc81-c95d18d4c24f\") " pod="kube-system/konnectivity-agent-snbwl"
Sep 05 06:25:36.651763 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.651535    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b130d031-50f3-4eb7-814d-fa16c13948cd-lib-modules\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.651763 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.651560    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b130d031-50f3-4eb7-814d-fa16c13948cd-var-lib-kubelet\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.651763 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.651580    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6258b8f7-e185-4e63-8f2d-5f693cd6f19a-hosts-file\") pod \"node-resolver-gqtqf\" (UID: \"6258b8f7-e185-4e63-8f2d-5f693cd6f19a\") " pod="openshift-dns/node-resolver-gqtqf"
Sep 05 06:25:36.651763 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.651595    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b130d031-50f3-4eb7-814d-fa16c13948cd-etc-modprobe-d\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.651763 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.651612    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhrnm\" (UniqueName: \"kubernetes.io/projected/b63a35b8-5230-4b6a-8237-e7afcaf6182e-kube-api-access-jhrnm\") pod \"network-metrics-daemon-sdsjs\" (UID: \"b63a35b8-5230-4b6a-8237-e7afcaf6182e\") " pod="openshift-multus/network-metrics-daemon-sdsjs"
Sep 05 06:25:36.651763 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.651629    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6js5z\" (UniqueName: \"kubernetes.io/projected/9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf-kube-api-access-6js5z\") pod \"aws-ebs-csi-driver-node-vtpzl\" (UID: \"9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtpzl"
Sep 05 06:25:36.651763 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.651644    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-multus-conf-dir\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.651763 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.651659    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-host-run-multus-certs\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.651763 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.651685    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlwh7\" (UniqueName: \"kubernetes.io/projected/e2b1bc6a-ad1b-422b-8e17-159ee06e7990-kube-api-access-rlwh7\") pod \"network-check-target-sg8b7\" (UID: \"e2b1bc6a-ad1b-422b-8e17-159ee06e7990\") " pod="openshift-network-diagnostics/network-check-target-sg8b7"
Sep 05 06:25:36.651763 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.651702    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6258b8f7-e185-4e63-8f2d-5f693cd6f19a-tmp-dir\") pod \"node-resolver-gqtqf\" (UID: \"6258b8f7-e185-4e63-8f2d-5f693cd6f19a\") " pod="openshift-dns/node-resolver-gqtqf"
Sep 05 06:25:36.651763 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.651719    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf-socket-dir\") pod \"aws-ebs-csi-driver-node-vtpzl\" (UID: \"9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtpzl"
Sep 05 06:25:36.651763 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.651737    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2zhc\" (UniqueName: \"kubernetes.io/projected/6258b8f7-e185-4e63-8f2d-5f693cd6f19a-kube-api-access-v2zhc\") pod \"node-resolver-gqtqf\" (UID: \"6258b8f7-e185-4e63-8f2d-5f693cd6f19a\") " pod="openshift-dns/node-resolver-gqtqf"
Sep 05 06:25:36.651763 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.651761    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b130d031-50f3-4eb7-814d-fa16c13948cd-etc-sysctl-d\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.652741 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.651784    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjrrv\" (UniqueName: \"kubernetes.io/projected/b130d031-50f3-4eb7-814d-fa16c13948cd-kube-api-access-rjrrv\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.652741 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.651801    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-system-cni-dir\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.652741 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.651816    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-multus-cni-dir\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.652741 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.651831    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c2189095-f1cc-411d-b6ec-7ddc003732f7-cni-binary-copy\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.652741 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.651856    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c2189095-f1cc-411d-b6ec-7ddc003732f7-multus-daemon-config\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.652741 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.651883    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cfb4483c-d0eb-4434-95e5-46fdb9618271-host\") pod \"node-ca-d8ftv\" (UID: \"cfb4483c-d0eb-4434-95e5-46fdb9618271\") " pod="openshift-image-registry/node-ca-d8ftv"
Sep 05 06:25:36.652741 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.651910    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/78512c00-0c79-4b8a-8f76-7c852a909337-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d6lsz\" (UID: \"78512c00-0c79-4b8a-8f76-7c852a909337\") " pod="openshift-multus/multus-additional-cni-plugins-d6lsz"
Sep 05 06:25:36.652741 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.651940    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/486067d7-7a47-4c88-86d6-721fcd141e43-kubelet-config\") pod \"global-pull-secret-syncer-ddpb9\" (UID: \"486067d7-7a47-4c88-86d6-721fcd141e43\") " pod="kube-system/global-pull-secret-syncer-ddpb9"
Sep 05 06:25:36.652741 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.651956    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-host-run-netns\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.652741 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.651963    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf-sys-fs\") pod \"aws-ebs-csi-driver-node-vtpzl\" (UID: \"9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtpzl"
Sep 05 06:25:36.652741 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.652029    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b130d031-50f3-4eb7-814d-fa16c13948cd-host\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.652741 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.652058    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf-sys-fs\") pod \"aws-ebs-csi-driver-node-vtpzl\" (UID: \"9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtpzl"
Sep 05 06:25:36.652741 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.652081    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b63a35b8-5230-4b6a-8237-e7afcaf6182e-metrics-certs\") pod \"network-metrics-daemon-sdsjs\" (UID: \"b63a35b8-5230-4b6a-8237-e7afcaf6182e\") " pod="openshift-multus/network-metrics-daemon-sdsjs"
Sep 05 06:25:36.652741 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.652115    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-etc-kubernetes\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.652741 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.652151    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/78512c00-0c79-4b8a-8f76-7c852a909337-cni-binary-copy\") pod \"multus-additional-cni-plugins-d6lsz\" (UID: \"78512c00-0c79-4b8a-8f76-7c852a909337\") " pod="openshift-multus/multus-additional-cni-plugins-d6lsz"
Sep 05 06:25:36.652741 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.652178    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b7ed807e-6f50-4ceb-bc81-c95d18d4c24f-agent-certs\") pod \"konnectivity-agent-snbwl\" (UID: \"b7ed807e-6f50-4ceb-bc81-c95d18d4c24f\") " pod="kube-system/konnectivity-agent-snbwl"
Sep 05 06:25:36.652741 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.652183    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6258b8f7-e185-4e63-8f2d-5f693cd6f19a-tmp-dir\") pod \"node-resolver-gqtqf\" (UID: \"6258b8f7-e185-4e63-8f2d-5f693cd6f19a\") " pod="openshift-dns/node-resolver-gqtqf"
Sep 05 06:25:36.652741 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.652206    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78512c00-0c79-4b8a-8f76-7c852a909337-system-cni-dir\") pod \"multus-additional-cni-plugins-d6lsz\" (UID: \"78512c00-0c79-4b8a-8f76-7c852a909337\") " pod="openshift-multus/multus-additional-cni-plugins-d6lsz"
Sep 05 06:25:36.653652 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.652224    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf-socket-dir\") pod \"aws-ebs-csi-driver-node-vtpzl\" (UID: \"9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtpzl"
Sep 05 06:25:36.653652 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.652233    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/78512c00-0c79-4b8a-8f76-7c852a909337-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d6lsz\" (UID: \"78512c00-0c79-4b8a-8f76-7c852a909337\") " pod="openshift-multus/multus-additional-cni-plugins-d6lsz"
Sep 05 06:25:36.653652 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.652282    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/78512c00-0c79-4b8a-8f76-7c852a909337-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d6lsz\" (UID: \"78512c00-0c79-4b8a-8f76-7c852a909337\") " pod="openshift-multus/multus-additional-cni-plugins-d6lsz"
Sep 05 06:25:36.653652 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.652290    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-host-run-multus-certs\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.653652 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.652313    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b130d031-50f3-4eb7-814d-fa16c13948cd-etc-sysconfig\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.653652 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.652343    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b130d031-50f3-4eb7-814d-fa16c13948cd-sys\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.653652 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.652371    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-multus-socket-dir-parent\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.653652 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.652399    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b130d031-50f3-4eb7-814d-fa16c13948cd-etc-systemd\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.653652 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.652432    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cfb4483c-d0eb-4434-95e5-46fdb9618271-serviceca\") pod \"node-ca-d8ftv\" (UID: \"cfb4483c-d0eb-4434-95e5-46fdb9618271\") " pod="openshift-image-registry/node-ca-d8ftv"
Sep 05 06:25:36.653652 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.652459    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf-registration-dir\") pod \"aws-ebs-csi-driver-node-vtpzl\" (UID: \"9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtpzl"
Sep 05 06:25:36.653652 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.652485    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-host-var-lib-cni-bin\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.653652 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.652532    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-host-var-lib-cni-bin\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.653652 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.652534    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b130d031-50f3-4eb7-814d-fa16c13948cd-etc-sysctl-d\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.653652 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.652740    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-system-cni-dir\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.653652 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.652754    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-host-var-lib-cni-multus\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.653652 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.652795    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/486067d7-7a47-4c88-86d6-721fcd141e43-original-pull-secret\") pod \"global-pull-secret-syncer-ddpb9\" (UID: \"486067d7-7a47-4c88-86d6-721fcd141e43\") " pod="kube-system/global-pull-secret-syncer-ddpb9"
Sep 05 06:25:36.653652 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.652819    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b130d031-50f3-4eb7-814d-fa16c13948cd-tmp\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.654459 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.652836    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b7ed807e-6f50-4ceb-bc81-c95d18d4c24f-konnectivity-ca\") pod \"konnectivity-agent-snbwl\" (UID: \"b7ed807e-6f50-4ceb-bc81-c95d18d4c24f\") " pod="kube-system/konnectivity-agent-snbwl"
Sep 05 06:25:36.654459 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.652845    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vtpzl\" (UID: \"9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtpzl"
Sep 05 06:25:36.654459 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.652869    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-multus-cni-dir\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.654459 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.652874    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf-etc-selinux\") pod \"aws-ebs-csi-driver-node-vtpzl\" (UID: \"9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtpzl"
Sep 05 06:25:36.654459 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.652903    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-host-run-k8s-cni-cncf-io\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.654459 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.652945    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-host-run-k8s-cni-cncf-io\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.654459 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.652986    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-host-var-lib-cni-multus\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.654459 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.652989    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b130d031-50f3-4eb7-814d-fa16c13948cd-etc-sysctl-conf\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.654459 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.653069    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/78512c00-0c79-4b8a-8f76-7c852a909337-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d6lsz\" (UID: \"78512c00-0c79-4b8a-8f76-7c852a909337\") " pod="openshift-multus/multus-additional-cni-plugins-d6lsz"
Sep 05 06:25:36.654459 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:36.653074    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 05 06:25:36.654459 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.653138    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b130d031-50f3-4eb7-814d-fa16c13948cd-lib-modules\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.654459 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.653198    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b130d031-50f3-4eb7-814d-fa16c13948cd-var-lib-kubelet\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.654459 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:36.653209    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/486067d7-7a47-4c88-86d6-721fcd141e43-original-pull-secret podName:486067d7-7a47-4c88-86d6-721fcd141e43 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:37.153167786 +0000 UTC m=+3.126922457 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/486067d7-7a47-4c88-86d6-721fcd141e43-original-pull-secret") pod "global-pull-secret-syncer-ddpb9" (UID: "486067d7-7a47-4c88-86d6-721fcd141e43") : object "kube-system"/"original-pull-secret" not registered
Sep 05 06:25:36.654459 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.653259    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b130d031-50f3-4eb7-814d-fa16c13948cd-etc-sysconfig\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.654459 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.653299    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-host-var-lib-kubelet\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.654459 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.653308    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b130d031-50f3-4eb7-814d-fa16c13948cd-host\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.654459 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.653344    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b130d031-50f3-4eb7-814d-fa16c13948cd-etc-systemd\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.654459 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:36.653416    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 05 06:25:36.655003 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.653418    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf-registration-dir\") pod \"aws-ebs-csi-driver-node-vtpzl\" (UID: \"9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtpzl"
Sep 05 06:25:36.655003 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:36.653459    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b63a35b8-5230-4b6a-8237-e7afcaf6182e-metrics-certs podName:b63a35b8-5230-4b6a-8237-e7afcaf6182e nodeName:}" failed. No retries permitted until 2026-09-05 06:25:37.153444841 +0000 UTC m=+3.127199503 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b63a35b8-5230-4b6a-8237-e7afcaf6182e-metrics-certs") pod "network-metrics-daemon-sdsjs" (UID: "b63a35b8-5230-4b6a-8237-e7afcaf6182e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 05 06:25:36.655003 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.651903    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b130d031-50f3-4eb7-814d-fa16c13948cd-etc-modprobe-d\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.655003 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.653491    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-etc-kubernetes\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.655003 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.653504    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c2189095-f1cc-411d-b6ec-7ddc003732f7-multus-daemon-config\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.655003 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.653582    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-multus-conf-dir\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.655003 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.653652    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6258b8f7-e185-4e63-8f2d-5f693cd6f19a-hosts-file\") pod \"node-resolver-gqtqf\" (UID: \"6258b8f7-e185-4e63-8f2d-5f693cd6f19a\") " pod="openshift-dns/node-resolver-gqtqf"
Sep 05 06:25:36.655003 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.653657    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/78512c00-0c79-4b8a-8f76-7c852a909337-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d6lsz\" (UID: \"78512c00-0c79-4b8a-8f76-7c852a909337\") " pod="openshift-multus/multus-additional-cni-plugins-d6lsz"
Sep 05 06:25:36.655003 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.653697    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78512c00-0c79-4b8a-8f76-7c852a909337-system-cni-dir\") pod \"multus-additional-cni-plugins-d6lsz\" (UID: \"78512c00-0c79-4b8a-8f76-7c852a909337\") " pod="openshift-multus/multus-additional-cni-plugins-d6lsz"
Sep 05 06:25:36.655003 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.653663    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/486067d7-7a47-4c88-86d6-721fcd141e43-kubelet-config\") pod \"global-pull-secret-syncer-ddpb9\" (UID: \"486067d7-7a47-4c88-86d6-721fcd141e43\") " pod="kube-system/global-pull-secret-syncer-ddpb9"
Sep 05 06:25:36.655003 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.653262    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b130d031-50f3-4eb7-814d-fa16c13948cd-sys\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.655003 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.653760    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cfb4483c-d0eb-4434-95e5-46fdb9618271-host\") pod \"node-ca-d8ftv\" (UID: \"cfb4483c-d0eb-4434-95e5-46fdb9618271\") " pod="openshift-image-registry/node-ca-d8ftv"
Sep 05 06:25:36.655003 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.653851    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf-etc-selinux\") pod \"aws-ebs-csi-driver-node-vtpzl\" (UID: \"9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtpzl"
Sep 05 06:25:36.655003 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.653921    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vtpzl\" (UID: \"9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtpzl"
Sep 05 06:25:36.655003 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.654046    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/78512c00-0c79-4b8a-8f76-7c852a909337-cni-binary-copy\") pod \"multus-additional-cni-plugins-d6lsz\" (UID: \"78512c00-0c79-4b8a-8f76-7c852a909337\") " pod="openshift-multus/multus-additional-cni-plugins-d6lsz"
Sep 05 06:25:36.655003 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.654090    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-hostroot\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.655003 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.654141    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/78512c00-0c79-4b8a-8f76-7c852a909337-cnibin\") pod \"multus-additional-cni-plugins-d6lsz\" (UID: \"78512c00-0c79-4b8a-8f76-7c852a909337\") " pod="openshift-multus/multus-additional-cni-plugins-d6lsz"
Sep 05 06:25:36.655789 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.654164    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b130d031-50f3-4eb7-814d-fa16c13948cd-run\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.655789 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.654187    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf-device-dir\") pod \"aws-ebs-csi-driver-node-vtpzl\" (UID: \"9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtpzl"
Sep 05 06:25:36.655789 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.654213    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfsq8\" (UniqueName: \"kubernetes.io/projected/c2189095-f1cc-411d-b6ec-7ddc003732f7-kube-api-access-sfsq8\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.655789 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.654237    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqzw6\" (UniqueName: \"kubernetes.io/projected/cfb4483c-d0eb-4434-95e5-46fdb9618271-kube-api-access-tqzw6\") pod \"node-ca-d8ftv\" (UID: \"cfb4483c-d0eb-4434-95e5-46fdb9618271\") " pod="openshift-image-registry/node-ca-d8ftv"
Sep 05 06:25:36.655789 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.654265    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn726\" (UniqueName: \"kubernetes.io/projected/78512c00-0c79-4b8a-8f76-7c852a909337-kube-api-access-pn726\") pod \"multus-additional-cni-plugins-d6lsz\" (UID: \"78512c00-0c79-4b8a-8f76-7c852a909337\") " pod="openshift-multus/multus-additional-cni-plugins-d6lsz"
Sep 05 06:25:36.655789 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.654293    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/486067d7-7a47-4c88-86d6-721fcd141e43-dbus\") pod \"global-pull-secret-syncer-ddpb9\" (UID: \"486067d7-7a47-4c88-86d6-721fcd141e43\") " pod="kube-system/global-pull-secret-syncer-ddpb9"
Sep 05 06:25:36.655789 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.654316    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b130d031-50f3-4eb7-814d-fa16c13948cd-etc-kubernetes\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.655789 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.654341    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-cnibin\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.655789 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.654418    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cfb4483c-d0eb-4434-95e5-46fdb9618271-serviceca\") pod \"node-ca-d8ftv\" (UID: \"cfb4483c-d0eb-4434-95e5-46fdb9618271\") " pod="openshift-image-registry/node-ca-d8ftv"
Sep 05 06:25:36.655789 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.654434    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-cnibin\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.655789 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.654472    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-hostroot\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.655789 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.654487    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/78512c00-0c79-4b8a-8f76-7c852a909337-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d6lsz\" (UID: \"78512c00-0c79-4b8a-8f76-7c852a909337\") " pod="openshift-multus/multus-additional-cni-plugins-d6lsz"
Sep 05 06:25:36.655789 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.654515    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/78512c00-0c79-4b8a-8f76-7c852a909337-cnibin\") pod \"multus-additional-cni-plugins-d6lsz\" (UID: \"78512c00-0c79-4b8a-8f76-7c852a909337\") " pod="openshift-multus/multus-additional-cni-plugins-d6lsz"
Sep 05 06:25:36.655789 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.654568    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c2189095-f1cc-411d-b6ec-7ddc003732f7-multus-socket-dir-parent\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.655789 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.654561    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b130d031-50f3-4eb7-814d-fa16c13948cd-run\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.655789 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.654750    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/486067d7-7a47-4c88-86d6-721fcd141e43-dbus\") pod \"global-pull-secret-syncer-ddpb9\" (UID: \"486067d7-7a47-4c88-86d6-721fcd141e43\") " pod="kube-system/global-pull-secret-syncer-ddpb9"
Sep 05 06:25:36.655789 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.654796    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b130d031-50f3-4eb7-814d-fa16c13948cd-etc-kubernetes\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.655789 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.654880    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf-device-dir\") pod \"aws-ebs-csi-driver-node-vtpzl\" (UID: \"9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtpzl"
Sep 05 06:25:36.656512 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.655968    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b130d031-50f3-4eb7-814d-fa16c13948cd-tmp\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.656512 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.656225    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b130d031-50f3-4eb7-814d-fa16c13948cd-etc-tuned\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.656512 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.656252    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c2189095-f1cc-411d-b6ec-7ddc003732f7-cni-binary-copy\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.656512 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.656497    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b7ed807e-6f50-4ceb-bc81-c95d18d4c24f-agent-certs\") pod \"konnectivity-agent-snbwl\" (UID: \"b7ed807e-6f50-4ceb-bc81-c95d18d4c24f\") " pod="kube-system/konnectivity-agent-snbwl"
Sep 05 06:25:36.659600 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:36.659570    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 05 06:25:36.659766 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:36.659606    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 05 06:25:36.659766 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:36.659621    2567 projected.go:196] Error preparing data for projected volume kube-api-access-rlwh7 for pod openshift-network-diagnostics/network-check-target-sg8b7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 05 06:25:36.659766 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:36.659729    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2b1bc6a-ad1b-422b-8e17-159ee06e7990-kube-api-access-rlwh7 podName:e2b1bc6a-ad1b-422b-8e17-159ee06e7990 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:37.15967043 +0000 UTC m=+3.133425085 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rlwh7" (UniqueName: "kubernetes.io/projected/e2b1bc6a-ad1b-422b-8e17-159ee06e7990-kube-api-access-rlwh7") pod "network-check-target-sg8b7" (UID: "e2b1bc6a-ad1b-422b-8e17-159ee06e7990") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 05 06:25:36.665807 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.665768    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjrrv\" (UniqueName: \"kubernetes.io/projected/b130d031-50f3-4eb7-814d-fa16c13948cd-kube-api-access-rjrrv\") pod \"tuned-st2vb\" (UID: \"b130d031-50f3-4eb7-814d-fa16c13948cd\") " pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.665984 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.665762    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2zhc\" (UniqueName: \"kubernetes.io/projected/6258b8f7-e185-4e63-8f2d-5f693cd6f19a-kube-api-access-v2zhc\") pod \"node-resolver-gqtqf\" (UID: \"6258b8f7-e185-4e63-8f2d-5f693cd6f19a\") " pod="openshift-dns/node-resolver-gqtqf"
Sep 05 06:25:36.666408 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.666379    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqzw6\" (UniqueName: \"kubernetes.io/projected/cfb4483c-d0eb-4434-95e5-46fdb9618271-kube-api-access-tqzw6\") pod \"node-ca-d8ftv\" (UID: \"cfb4483c-d0eb-4434-95e5-46fdb9618271\") " pod="openshift-image-registry/node-ca-d8ftv"
Sep 05 06:25:36.666514 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.666494    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhrnm\" (UniqueName: \"kubernetes.io/projected/b63a35b8-5230-4b6a-8237-e7afcaf6182e-kube-api-access-jhrnm\") pod \"network-metrics-daemon-sdsjs\" (UID: \"b63a35b8-5230-4b6a-8237-e7afcaf6182e\") " pod="openshift-multus/network-metrics-daemon-sdsjs"
Sep 05 06:25:36.667174 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.667148    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn726\" (UniqueName: \"kubernetes.io/projected/78512c00-0c79-4b8a-8f76-7c852a909337-kube-api-access-pn726\") pod \"multus-additional-cni-plugins-d6lsz\" (UID: \"78512c00-0c79-4b8a-8f76-7c852a909337\") " pod="openshift-multus/multus-additional-cni-plugins-d6lsz"
Sep 05 06:25:36.668879 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.668834    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6js5z\" (UniqueName: \"kubernetes.io/projected/9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf-kube-api-access-6js5z\") pod \"aws-ebs-csi-driver-node-vtpzl\" (UID: \"9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtpzl"
Sep 05 06:25:36.671856 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.671830    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfsq8\" (UniqueName: \"kubernetes.io/projected/c2189095-f1cc-411d-b6ec-7ddc003732f7-kube-api-access-sfsq8\") pod \"multus-vzbwh\" (UID: \"c2189095-f1cc-411d-b6ec-7ddc003732f7\") " pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.755889 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.755851    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4bhxt"
Sep 05 06:25:36.770799 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.770757    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:25:36.789166 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.789124    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vzbwh"
Sep 05 06:25:36.793778 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.793750    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d8ftv"
Sep 05 06:25:36.804386 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.804348    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gqtqf"
Sep 05 06:25:36.813028 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.812988    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-st2vb"
Sep 05 06:25:36.820433 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.820400    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d6lsz"
Sep 05 06:25:36.830873 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.830835    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-snbwl"
Sep 05 06:25:36.838413 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:36.838373    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtpzl"
Sep 05 06:25:37.159359 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:37.159317    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/486067d7-7a47-4c88-86d6-721fcd141e43-original-pull-secret\") pod \"global-pull-secret-syncer-ddpb9\" (UID: \"486067d7-7a47-4c88-86d6-721fcd141e43\") " pod="kube-system/global-pull-secret-syncer-ddpb9"
Sep 05 06:25:37.159566 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:37.159420    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b63a35b8-5230-4b6a-8237-e7afcaf6182e-metrics-certs\") pod \"network-metrics-daemon-sdsjs\" (UID: \"b63a35b8-5230-4b6a-8237-e7afcaf6182e\") " pod="openshift-multus/network-metrics-daemon-sdsjs"
Sep 05 06:25:37.159566 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:37.159519    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 05 06:25:37.159566 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:37.159547    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 05 06:25:37.159681 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:37.159604    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/486067d7-7a47-4c88-86d6-721fcd141e43-original-pull-secret podName:486067d7-7a47-4c88-86d6-721fcd141e43 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:38.15958517 +0000 UTC m=+4.133339825 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/486067d7-7a47-4c88-86d6-721fcd141e43-original-pull-secret") pod "global-pull-secret-syncer-ddpb9" (UID: "486067d7-7a47-4c88-86d6-721fcd141e43") : object "kube-system"/"original-pull-secret" not registered
Sep 05 06:25:37.159681 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:37.159626    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b63a35b8-5230-4b6a-8237-e7afcaf6182e-metrics-certs podName:b63a35b8-5230-4b6a-8237-e7afcaf6182e nodeName:}" failed. No retries permitted until 2026-09-05 06:25:38.159617576 +0000 UTC m=+4.133372230 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b63a35b8-5230-4b6a-8237-e7afcaf6182e-metrics-certs") pod "network-metrics-daemon-sdsjs" (UID: "b63a35b8-5230-4b6a-8237-e7afcaf6182e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 05 06:25:37.260558 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:37.260519    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlwh7\" (UniqueName: \"kubernetes.io/projected/e2b1bc6a-ad1b-422b-8e17-159ee06e7990-kube-api-access-rlwh7\") pod \"network-check-target-sg8b7\" (UID: \"e2b1bc6a-ad1b-422b-8e17-159ee06e7990\") " pod="openshift-network-diagnostics/network-check-target-sg8b7"
Sep 05 06:25:37.260770 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:37.260736    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 05 06:25:37.260770 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:37.260769    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 05 06:25:37.260861 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:37.260785    2567 projected.go:196] Error preparing data for projected volume kube-api-access-rlwh7 for pod openshift-network-diagnostics/network-check-target-sg8b7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 05 06:25:37.260861 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:37.260858    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2b1bc6a-ad1b-422b-8e17-159ee06e7990-kube-api-access-rlwh7 podName:e2b1bc6a-ad1b-422b-8e17-159ee06e7990 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:38.260836385 +0000 UTC m=+4.234591042 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rlwh7" (UniqueName: "kubernetes.io/projected/e2b1bc6a-ad1b-422b-8e17-159ee06e7990-kube-api-access-rlwh7") pod "network-check-target-sg8b7" (UID: "e2b1bc6a-ad1b-422b-8e17-159ee06e7990") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 05 06:25:37.494221 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:37.494172    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-04 06:20:36 +0000 UTC" deadline="2028-06-04 04:46:40.888692366 +0000 UTC"
Sep 05 06:25:37.494221 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:37.494211    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15310h21m3.394485308s"
Sep 05 06:25:37.895565 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:37.895515    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6258b8f7_e185_4e63_8f2d_5f693cd6f19a.slice/crio-78616b745b68a7b19eb97aa41d71f5daab0664c23a331a9a8583e5a9b746c28a WatchSource:0}: Error finding container 78616b745b68a7b19eb97aa41d71f5daab0664c23a331a9a8583e5a9b746c28a: Status 404 returned error can't find the container with id 78616b745b68a7b19eb97aa41d71f5daab0664c23a331a9a8583e5a9b746c28a
Sep 05 06:25:37.896648 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:37.896606    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cb8aae4_4ef2_48d6_9cd7_4f51c97d8bbf.slice/crio-c76b6d3cd4b2ac1035fa84c6253ea658ee9e4506cba68617e52f7bed6502b8c4 WatchSource:0}: Error finding container c76b6d3cd4b2ac1035fa84c6253ea658ee9e4506cba68617e52f7bed6502b8c4: Status 404 returned error can't find the container with id c76b6d3cd4b2ac1035fa84c6253ea658ee9e4506cba68617e52f7bed6502b8c4
Sep 05 06:25:37.897893 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:37.897680    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb130d031_50f3_4eb7_814d_fa16c13948cd.slice/crio-fae6baa525f6f5786b0966ce4cf8fc09e8fb704d6cade7bc6170a809a124b193 WatchSource:0}: Error finding container fae6baa525f6f5786b0966ce4cf8fc09e8fb704d6cade7bc6170a809a124b193: Status 404 returned error can't find the container with id fae6baa525f6f5786b0966ce4cf8fc09e8fb704d6cade7bc6170a809a124b193
Sep 05 06:25:37.903869 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:37.903817    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7ed807e_6f50_4ceb_bc81_c95d18d4c24f.slice/crio-da99c6fbaa126aed2437f5187f93a6a6aa5ee086c63b245830dc34c856ce761d WatchSource:0}: Error finding container da99c6fbaa126aed2437f5187f93a6a6aa5ee086c63b245830dc34c856ce761d: Status 404 returned error can't find the container with id da99c6fbaa126aed2437f5187f93a6a6aa5ee086c63b245830dc34c856ce761d
Sep 05 06:25:37.904764 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:37.904739    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabbd8c4a_73d0_4380_b78a_c3ed5b70efd2.slice/crio-724b407ee061f7e653aca44a53cbe87bb7a27f72a0281d46261ed1660c1708da WatchSource:0}: Error finding container 724b407ee061f7e653aca44a53cbe87bb7a27f72a0281d46261ed1660c1708da: Status 404 returned error can't find the container with id 724b407ee061f7e653aca44a53cbe87bb7a27f72a0281d46261ed1660c1708da
Sep 05 06:25:37.906341 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:37.906252    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f8a8f16_2422_4c01_a619_1f17fe10cd4c.slice/crio-86c4cc5aabbc03cd48ebfd88e4dfd2fd20587f259b96fde55196f9b3ef590da0 WatchSource:0}: Error finding container 86c4cc5aabbc03cd48ebfd88e4dfd2fd20587f259b96fde55196f9b3ef590da0: Status 404 returned error can't find the container with id 86c4cc5aabbc03cd48ebfd88e4dfd2fd20587f259b96fde55196f9b3ef590da0
Sep 05 06:25:37.908119 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:25:37.907391    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfb4483c_d0eb_4434_95e5_46fdb9618271.slice/crio-51f10fb41d66808dd9f7508ed6c5457a17faca65a85439a8c61437a7d77e2d2c WatchSource:0}: Error finding container 51f10fb41d66808dd9f7508ed6c5457a17faca65a85439a8c61437a7d77e2d2c: Status 404 returned error can't find the container with id 51f10fb41d66808dd9f7508ed6c5457a17faca65a85439a8c61437a7d77e2d2c
Sep 05 06:25:38.169143 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:38.169097    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b63a35b8-5230-4b6a-8237-e7afcaf6182e-metrics-certs\") pod \"network-metrics-daemon-sdsjs\" (UID: \"b63a35b8-5230-4b6a-8237-e7afcaf6182e\") " pod="openshift-multus/network-metrics-daemon-sdsjs"
Sep 05 06:25:38.169315 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:38.169162    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/486067d7-7a47-4c88-86d6-721fcd141e43-original-pull-secret\") pod \"global-pull-secret-syncer-ddpb9\" (UID: \"486067d7-7a47-4c88-86d6-721fcd141e43\") " pod="kube-system/global-pull-secret-syncer-ddpb9"
Sep 05 06:25:38.169315 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:38.169228    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 05 06:25:38.169315 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:38.169267    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 05 06:25:38.169428 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:38.169314    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b63a35b8-5230-4b6a-8237-e7afcaf6182e-metrics-certs podName:b63a35b8-5230-4b6a-8237-e7afcaf6182e nodeName:}" failed. No retries permitted until 2026-09-05 06:25:40.169292579 +0000 UTC m=+6.143047239 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b63a35b8-5230-4b6a-8237-e7afcaf6182e-metrics-certs") pod "network-metrics-daemon-sdsjs" (UID: "b63a35b8-5230-4b6a-8237-e7afcaf6182e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 05 06:25:38.169428 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:38.169337    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/486067d7-7a47-4c88-86d6-721fcd141e43-original-pull-secret podName:486067d7-7a47-4c88-86d6-721fcd141e43 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:40.16933044 +0000 UTC m=+6.143085095 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/486067d7-7a47-4c88-86d6-721fcd141e43-original-pull-secret") pod "global-pull-secret-syncer-ddpb9" (UID: "486067d7-7a47-4c88-86d6-721fcd141e43") : object "kube-system"/"original-pull-secret" not registered
Sep 05 06:25:38.270164 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:38.270118    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlwh7\" (UniqueName: \"kubernetes.io/projected/e2b1bc6a-ad1b-422b-8e17-159ee06e7990-kube-api-access-rlwh7\") pod \"network-check-target-sg8b7\" (UID: \"e2b1bc6a-ad1b-422b-8e17-159ee06e7990\") " pod="openshift-network-diagnostics/network-check-target-sg8b7"
Sep 05 06:25:38.270354 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:38.270266    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 05 06:25:38.270354 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:38.270293    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 05 06:25:38.270354 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:38.270309    2567 projected.go:196] Error preparing data for projected volume kube-api-access-rlwh7 for pod openshift-network-diagnostics/network-check-target-sg8b7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 05 06:25:38.270481 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:38.270368    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2b1bc6a-ad1b-422b-8e17-159ee06e7990-kube-api-access-rlwh7 podName:e2b1bc6a-ad1b-422b-8e17-159ee06e7990 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:40.270353503 +0000 UTC m=+6.244108158 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rlwh7" (UniqueName: "kubernetes.io/projected/e2b1bc6a-ad1b-422b-8e17-159ee06e7990-kube-api-access-rlwh7") pod "network-check-target-sg8b7" (UID: "e2b1bc6a-ad1b-422b-8e17-159ee06e7990") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 05 06:25:38.495079 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:38.494980    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-04 06:20:36 +0000 UTC" deadline="2028-05-02 04:58:12.579633654 +0000 UTC"
Sep 05 06:25:38.496204 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:38.495097    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14518h32m34.084572081s"
Sep 05 06:25:38.577283 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:38.577249    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sg8b7"
Sep 05 06:25:38.577490 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:38.577398    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sg8b7" podUID="e2b1bc6a-ad1b-422b-8e17-159ee06e7990"
Sep 05 06:25:38.577883 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:38.577860    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddpb9"
Sep 05 06:25:38.577994 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:38.577972    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddpb9" podUID="486067d7-7a47-4c88-86d6-721fcd141e43"
Sep 05 06:25:38.579273 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:38.579248    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdsjs"
Sep 05 06:25:38.579414 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:38.579372    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sdsjs" podUID="b63a35b8-5230-4b6a-8237-e7afcaf6182e"
Sep 05 06:25:38.597190 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:38.597146    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-49.ec2.internal" event={"ID":"83997819976fe16ec940b23b2f10ee3f","Type":"ContainerStarted","Data":"6d7a5057aeda1584d2a4170a3719f36704571c7c45ecd351b6af4ff7b35dc05a"}
Sep 05 06:25:38.602951 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:38.602865    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d8ftv" event={"ID":"cfb4483c-d0eb-4434-95e5-46fdb9618271","Type":"ContainerStarted","Data":"51f10fb41d66808dd9f7508ed6c5457a17faca65a85439a8c61437a7d77e2d2c"}
Sep 05 06:25:38.609921 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:38.609815    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-snbwl" event={"ID":"b7ed807e-6f50-4ceb-bc81-c95d18d4c24f","Type":"ContainerStarted","Data":"da99c6fbaa126aed2437f5187f93a6a6aa5ee086c63b245830dc34c856ce761d"}
Sep 05 06:25:38.614600 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:38.613290    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-49.ec2.internal" podStartSLOduration=2.613266685 podStartE2EDuration="2.613266685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 06:25:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:25:38.612914181 +0000 UTC m=+4.586668861" watchObservedRunningTime="2026-09-05 06:25:38.613266685 +0000 UTC m=+4.587021367"
Sep 05 06:25:38.614600 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:38.614509    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vzbwh" event={"ID":"c2189095-f1cc-411d-b6ec-7ddc003732f7","Type":"ContainerStarted","Data":"fbeebf791b0a37351edb19e3b84be46db4aecec728a7a20fbb4a0d8a0f196844"}
Sep 05 06:25:38.618687 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:38.618645    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d6lsz" event={"ID":"78512c00-0c79-4b8a-8f76-7c852a909337","Type":"ContainerStarted","Data":"830c042627b362a04742f107489515fd49c6671c406c93e9203c15526b823b24"}
Sep 05 06:25:38.622994 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:38.622875    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-st2vb" event={"ID":"b130d031-50f3-4eb7-814d-fa16c13948cd","Type":"ContainerStarted","Data":"fae6baa525f6f5786b0966ce4cf8fc09e8fb704d6cade7bc6170a809a124b193"}
Sep 05 06:25:38.631005 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:38.630757    2567 generic.go:356] "Generic (PLEG): container finished" podID="8580d389453c76b8677803848f8baeb7" containerID="f398dadc00674072cebd3a6cd2fd39c8f7e0b244a03ecd0c50f9ecc69a75e8e9" exitCode=0
Sep 05 06:25:38.631710 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:38.631525    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-49.ec2.internal" event={"ID":"8580d389453c76b8677803848f8baeb7","Type":"ContainerDied","Data":"f398dadc00674072cebd3a6cd2fd39c8f7e0b244a03ecd0c50f9ecc69a75e8e9"}
Sep 05 06:25:38.641979 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:38.641911    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4" event={"ID":"7f8a8f16-2422-4c01-a619-1f17fe10cd4c","Type":"ContainerStarted","Data":"86c4cc5aabbc03cd48ebfd88e4dfd2fd20587f259b96fde55196f9b3ef590da0"}
Sep 05 06:25:38.659490 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:38.659456    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4bhxt" event={"ID":"abbd8c4a-73d0-4380-b78a-c3ed5b70efd2","Type":"ContainerStarted","Data":"724b407ee061f7e653aca44a53cbe87bb7a27f72a0281d46261ed1660c1708da"}
Sep 05 06:25:38.664860 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:38.664696    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtpzl" event={"ID":"9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf","Type":"ContainerStarted","Data":"c76b6d3cd4b2ac1035fa84c6253ea658ee9e4506cba68617e52f7bed6502b8c4"}
Sep 05 06:25:38.672529 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:38.672486    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gqtqf" event={"ID":"6258b8f7-e185-4e63-8f2d-5f693cd6f19a","Type":"ContainerStarted","Data":"78616b745b68a7b19eb97aa41d71f5daab0664c23a331a9a8583e5a9b746c28a"}
Sep 05 06:25:39.701139 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:39.700621    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-49.ec2.internal" event={"ID":"8580d389453c76b8677803848f8baeb7","Type":"ContainerStarted","Data":"4280de1de3dd483d994192b03770a665f72ef4c2efd31a78c8f0f6a7f4ab6066"}
Sep 05 06:25:39.720420 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:39.720346    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-49.ec2.internal" podStartSLOduration=3.720323655 podStartE2EDuration="3.720323655s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 06:25:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:25:39.719575346 +0000 UTC m=+5.693330023" watchObservedRunningTime="2026-09-05 06:25:39.720323655 +0000 UTC m=+5.694078331"
Sep 05 06:25:40.198551 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:40.197691    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/486067d7-7a47-4c88-86d6-721fcd141e43-original-pull-secret\") pod \"global-pull-secret-syncer-ddpb9\" (UID: \"486067d7-7a47-4c88-86d6-721fcd141e43\") " pod="kube-system/global-pull-secret-syncer-ddpb9"
Sep 05 06:25:40.198551 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:40.197811    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b63a35b8-5230-4b6a-8237-e7afcaf6182e-metrics-certs\") pod \"network-metrics-daemon-sdsjs\" (UID: \"b63a35b8-5230-4b6a-8237-e7afcaf6182e\") " pod="openshift-multus/network-metrics-daemon-sdsjs"
Sep 05 06:25:40.198551 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:40.197954    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 05 06:25:40.198551 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:40.198018    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b63a35b8-5230-4b6a-8237-e7afcaf6182e-metrics-certs podName:b63a35b8-5230-4b6a-8237-e7afcaf6182e nodeName:}" failed. No retries permitted until 2026-09-05 06:25:44.197999029 +0000 UTC m=+10.171753706 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b63a35b8-5230-4b6a-8237-e7afcaf6182e-metrics-certs") pod "network-metrics-daemon-sdsjs" (UID: "b63a35b8-5230-4b6a-8237-e7afcaf6182e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 05 06:25:40.198551 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:40.198127    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 05 06:25:40.198551 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:40.198167    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/486067d7-7a47-4c88-86d6-721fcd141e43-original-pull-secret podName:486067d7-7a47-4c88-86d6-721fcd141e43 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:44.198152798 +0000 UTC m=+10.171907473 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/486067d7-7a47-4c88-86d6-721fcd141e43-original-pull-secret") pod "global-pull-secret-syncer-ddpb9" (UID: "486067d7-7a47-4c88-86d6-721fcd141e43") : object "kube-system"/"original-pull-secret" not registered
Sep 05 06:25:40.299601 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:40.298906    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlwh7\" (UniqueName: \"kubernetes.io/projected/e2b1bc6a-ad1b-422b-8e17-159ee06e7990-kube-api-access-rlwh7\") pod \"network-check-target-sg8b7\" (UID: \"e2b1bc6a-ad1b-422b-8e17-159ee06e7990\") " pod="openshift-network-diagnostics/network-check-target-sg8b7"
Sep 05 06:25:40.299601 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:40.299145    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 05 06:25:40.299601 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:40.299167    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 05 06:25:40.299601 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:40.299180    2567 projected.go:196] Error preparing data for projected volume kube-api-access-rlwh7 for pod openshift-network-diagnostics/network-check-target-sg8b7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 05 06:25:40.299601 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:40.299252    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2b1bc6a-ad1b-422b-8e17-159ee06e7990-kube-api-access-rlwh7 podName:e2b1bc6a-ad1b-422b-8e17-159ee06e7990 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:44.299222335 +0000 UTC m=+10.272977008 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rlwh7" (UniqueName: "kubernetes.io/projected/e2b1bc6a-ad1b-422b-8e17-159ee06e7990-kube-api-access-rlwh7") pod "network-check-target-sg8b7" (UID: "e2b1bc6a-ad1b-422b-8e17-159ee06e7990") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 05 06:25:40.576762 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:40.576218    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddpb9"
Sep 05 06:25:40.576762 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:40.576222    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sg8b7"
Sep 05 06:25:40.576762 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:40.576356    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddpb9" podUID="486067d7-7a47-4c88-86d6-721fcd141e43"
Sep 05 06:25:40.576762 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:40.576384    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdsjs"
Sep 05 06:25:40.576762 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:40.576479    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sg8b7" podUID="e2b1bc6a-ad1b-422b-8e17-159ee06e7990"
Sep 05 06:25:40.576762 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:40.576576    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sdsjs" podUID="b63a35b8-5230-4b6a-8237-e7afcaf6182e"
Sep 05 06:25:42.577861 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:42.577196    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddpb9"
Sep 05 06:25:42.577861 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:42.577319    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddpb9" podUID="486067d7-7a47-4c88-86d6-721fcd141e43"
Sep 05 06:25:42.577861 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:42.577615    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdsjs"
Sep 05 06:25:42.577861 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:42.577685    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sdsjs" podUID="b63a35b8-5230-4b6a-8237-e7afcaf6182e"
Sep 05 06:25:42.577861 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:42.577715    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sg8b7"
Sep 05 06:25:42.577861 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:42.577763    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sg8b7" podUID="e2b1bc6a-ad1b-422b-8e17-159ee06e7990"
Sep 05 06:25:44.232766 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:44.232726    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b63a35b8-5230-4b6a-8237-e7afcaf6182e-metrics-certs\") pod \"network-metrics-daemon-sdsjs\" (UID: \"b63a35b8-5230-4b6a-8237-e7afcaf6182e\") " pod="openshift-multus/network-metrics-daemon-sdsjs"
Sep 05 06:25:44.232766 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:44.232772    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/486067d7-7a47-4c88-86d6-721fcd141e43-original-pull-secret\") pod \"global-pull-secret-syncer-ddpb9\" (UID: \"486067d7-7a47-4c88-86d6-721fcd141e43\") " pod="kube-system/global-pull-secret-syncer-ddpb9"
Sep 05 06:25:44.233322 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:44.232914    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 05 06:25:44.233322 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:44.232961    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 05 06:25:44.233322 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:44.232970    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/486067d7-7a47-4c88-86d6-721fcd141e43-original-pull-secret podName:486067d7-7a47-4c88-86d6-721fcd141e43 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:52.23295669 +0000 UTC m=+18.206711342 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/486067d7-7a47-4c88-86d6-721fcd141e43-original-pull-secret") pod "global-pull-secret-syncer-ddpb9" (UID: "486067d7-7a47-4c88-86d6-721fcd141e43") : object "kube-system"/"original-pull-secret" not registered
Sep 05 06:25:44.233322 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:44.233082    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b63a35b8-5230-4b6a-8237-e7afcaf6182e-metrics-certs podName:b63a35b8-5230-4b6a-8237-e7afcaf6182e nodeName:}" failed. No retries permitted until 2026-09-05 06:25:52.233058788 +0000 UTC m=+18.206813447 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b63a35b8-5230-4b6a-8237-e7afcaf6182e-metrics-certs") pod "network-metrics-daemon-sdsjs" (UID: "b63a35b8-5230-4b6a-8237-e7afcaf6182e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 05 06:25:44.333724 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:44.333680    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlwh7\" (UniqueName: \"kubernetes.io/projected/e2b1bc6a-ad1b-422b-8e17-159ee06e7990-kube-api-access-rlwh7\") pod \"network-check-target-sg8b7\" (UID: \"e2b1bc6a-ad1b-422b-8e17-159ee06e7990\") " pod="openshift-network-diagnostics/network-check-target-sg8b7"
Sep 05 06:25:44.333956 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:44.333870    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 05 06:25:44.333956 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:44.333895    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 05 06:25:44.333956 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:44.333909    2567 projected.go:196] Error preparing data for projected volume kube-api-access-rlwh7 for pod openshift-network-diagnostics/network-check-target-sg8b7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 05 06:25:44.334199 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:44.333969    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2b1bc6a-ad1b-422b-8e17-159ee06e7990-kube-api-access-rlwh7 podName:e2b1bc6a-ad1b-422b-8e17-159ee06e7990 nodeName:}" failed. No retries permitted until 2026-09-05 06:25:52.33395034 +0000 UTC m=+18.307705008 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rlwh7" (UniqueName: "kubernetes.io/projected/e2b1bc6a-ad1b-422b-8e17-159ee06e7990-kube-api-access-rlwh7") pod "network-check-target-sg8b7" (UID: "e2b1bc6a-ad1b-422b-8e17-159ee06e7990") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 05 06:25:44.575787 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:44.575457    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdsjs"
Sep 05 06:25:44.575963 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:44.575876    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sdsjs" podUID="b63a35b8-5230-4b6a-8237-e7afcaf6182e"
Sep 05 06:25:44.576343 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:44.576322    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sg8b7"
Sep 05 06:25:44.576458 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:44.576419    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sg8b7" podUID="e2b1bc6a-ad1b-422b-8e17-159ee06e7990"
Sep 05 06:25:44.576525 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:44.576478    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddpb9"
Sep 05 06:25:44.576580 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:44.576549    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddpb9" podUID="486067d7-7a47-4c88-86d6-721fcd141e43"
Sep 05 06:25:46.575679 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:46.574937    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdsjs"
Sep 05 06:25:46.575679 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:46.575104    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sdsjs" podUID="b63a35b8-5230-4b6a-8237-e7afcaf6182e"
Sep 05 06:25:46.575679 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:46.575482    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sg8b7"
Sep 05 06:25:46.575679 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:46.575571    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sg8b7" podUID="e2b1bc6a-ad1b-422b-8e17-159ee06e7990"
Sep 05 06:25:46.576316 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:46.576136    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddpb9"
Sep 05 06:25:46.576316 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:46.576247    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddpb9" podUID="486067d7-7a47-4c88-86d6-721fcd141e43"
Sep 05 06:25:48.576079 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:48.575491    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddpb9"
Sep 05 06:25:48.576079 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:48.575510    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sg8b7"
Sep 05 06:25:48.576079 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:48.575631    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddpb9" podUID="486067d7-7a47-4c88-86d6-721fcd141e43"
Sep 05 06:25:48.576079 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:48.575702    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sg8b7" podUID="e2b1bc6a-ad1b-422b-8e17-159ee06e7990"
Sep 05 06:25:48.576079 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:48.575510    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdsjs"
Sep 05 06:25:48.576079 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:48.575794    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sdsjs" podUID="b63a35b8-5230-4b6a-8237-e7afcaf6182e"
Sep 05 06:25:50.574581 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:50.574543    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddpb9"
Sep 05 06:25:50.574581 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:50.574585    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdsjs"
Sep 05 06:25:50.575238 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:50.574542    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sg8b7"
Sep 05 06:25:50.575238 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:50.574684    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddpb9" podUID="486067d7-7a47-4c88-86d6-721fcd141e43"
Sep 05 06:25:50.575238 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:50.574772    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sg8b7" podUID="e2b1bc6a-ad1b-422b-8e17-159ee06e7990"
Sep 05 06:25:50.575238 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:50.574837    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sdsjs" podUID="b63a35b8-5230-4b6a-8237-e7afcaf6182e"
Sep 05 06:25:52.302046 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:52.301989    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b63a35b8-5230-4b6a-8237-e7afcaf6182e-metrics-certs\") pod \"network-metrics-daemon-sdsjs\" (UID: \"b63a35b8-5230-4b6a-8237-e7afcaf6182e\") " pod="openshift-multus/network-metrics-daemon-sdsjs"
Sep 05 06:25:52.302462 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:52.302060    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/486067d7-7a47-4c88-86d6-721fcd141e43-original-pull-secret\") pod \"global-pull-secret-syncer-ddpb9\" (UID: \"486067d7-7a47-4c88-86d6-721fcd141e43\") " pod="kube-system/global-pull-secret-syncer-ddpb9"
Sep 05 06:25:52.302462 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:52.302166    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 05 06:25:52.302462 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:52.302173    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 05 06:25:52.302462 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:52.302221    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/486067d7-7a47-4c88-86d6-721fcd141e43-original-pull-secret podName:486067d7-7a47-4c88-86d6-721fcd141e43 nodeName:}" failed. No retries permitted until 2026-09-05 06:26:08.302207305 +0000 UTC m=+34.275961957 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/486067d7-7a47-4c88-86d6-721fcd141e43-original-pull-secret") pod "global-pull-secret-syncer-ddpb9" (UID: "486067d7-7a47-4c88-86d6-721fcd141e43") : object "kube-system"/"original-pull-secret" not registered
Sep 05 06:25:52.302462 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:52.302245    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b63a35b8-5230-4b6a-8237-e7afcaf6182e-metrics-certs podName:b63a35b8-5230-4b6a-8237-e7afcaf6182e nodeName:}" failed. No retries permitted until 2026-09-05 06:26:08.302225624 +0000 UTC m=+34.275980294 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b63a35b8-5230-4b6a-8237-e7afcaf6182e-metrics-certs") pod "network-metrics-daemon-sdsjs" (UID: "b63a35b8-5230-4b6a-8237-e7afcaf6182e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 05 06:25:52.402812 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:52.402741    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlwh7\" (UniqueName: \"kubernetes.io/projected/e2b1bc6a-ad1b-422b-8e17-159ee06e7990-kube-api-access-rlwh7\") pod \"network-check-target-sg8b7\" (UID: \"e2b1bc6a-ad1b-422b-8e17-159ee06e7990\") " pod="openshift-network-diagnostics/network-check-target-sg8b7"
Sep 05 06:25:52.403020 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:52.402948    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 05 06:25:52.403020 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:52.402975    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 05 06:25:52.403020 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:52.402993    2567 projected.go:196] Error preparing data for projected volume kube-api-access-rlwh7 for pod openshift-network-diagnostics/network-check-target-sg8b7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 05 06:25:52.403209 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:52.403072    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2b1bc6a-ad1b-422b-8e17-159ee06e7990-kube-api-access-rlwh7 podName:e2b1bc6a-ad1b-422b-8e17-159ee06e7990 nodeName:}" failed. No retries permitted until 2026-09-05 06:26:08.403055588 +0000 UTC m=+34.376810244 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rlwh7" (UniqueName: "kubernetes.io/projected/e2b1bc6a-ad1b-422b-8e17-159ee06e7990-kube-api-access-rlwh7") pod "network-check-target-sg8b7" (UID: "e2b1bc6a-ad1b-422b-8e17-159ee06e7990") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 05 06:25:52.574959 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:52.574914    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddpb9"
Sep 05 06:25:52.575158 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:52.574971    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sg8b7"
Sep 05 06:25:52.575158 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:52.574970    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdsjs"
Sep 05 06:25:52.575158 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:52.575085    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddpb9" podUID="486067d7-7a47-4c88-86d6-721fcd141e43"
Sep 05 06:25:52.575324 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:52.575208    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sg8b7" podUID="e2b1bc6a-ad1b-422b-8e17-159ee06e7990"
Sep 05 06:25:52.575324 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:52.575294    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sdsjs" podUID="b63a35b8-5230-4b6a-8237-e7afcaf6182e"
Sep 05 06:25:54.575322 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:54.575272    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdsjs"
Sep 05 06:25:54.575805 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:54.575401    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sg8b7"
Sep 05 06:25:54.575805 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:54.575410    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sdsjs" podUID="b63a35b8-5230-4b6a-8237-e7afcaf6182e"
Sep 05 06:25:54.575805 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:54.575516    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sg8b7" podUID="e2b1bc6a-ad1b-422b-8e17-159ee06e7990"
Sep 05 06:25:54.575805 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:54.575566    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddpb9"
Sep 05 06:25:54.575805 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:54.575639    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddpb9" podUID="486067d7-7a47-4c88-86d6-721fcd141e43"
Sep 05 06:25:56.575439 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:56.575406    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdsjs"
Sep 05 06:25:56.575893 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:56.575447    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddpb9"
Sep 05 06:25:56.575893 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:56.575448    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sg8b7"
Sep 05 06:25:56.575893 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:56.575554    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sdsjs" podUID="b63a35b8-5230-4b6a-8237-e7afcaf6182e"
Sep 05 06:25:56.575893 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:56.575677    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddpb9" podUID="486067d7-7a47-4c88-86d6-721fcd141e43"
Sep 05 06:25:56.575893 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:56.575750    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sg8b7" podUID="e2b1bc6a-ad1b-422b-8e17-159ee06e7990"
Sep 05 06:25:56.741992 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:56.741569    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vzbwh" event={"ID":"c2189095-f1cc-411d-b6ec-7ddc003732f7","Type":"ContainerStarted","Data":"debae47e67bd4bd72799a179ca9162707529be351b52f5587bd1de9740af80a0"}
Sep 05 06:25:56.743912 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:56.743880    2567 generic.go:356] "Generic (PLEG): container finished" podID="78512c00-0c79-4b8a-8f76-7c852a909337" containerID="3b8b653ac2433f874a5fa126716193db7321089a73107df5df0467760547bd1b" exitCode=0
Sep 05 06:25:56.744134 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:56.743967    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d6lsz" event={"ID":"78512c00-0c79-4b8a-8f76-7c852a909337","Type":"ContainerDied","Data":"3b8b653ac2433f874a5fa126716193db7321089a73107df5df0467760547bd1b"}
Sep 05 06:25:56.746132 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:56.746095    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-st2vb" event={"ID":"b130d031-50f3-4eb7-814d-fa16c13948cd","Type":"ContainerStarted","Data":"bda073dbf823124703a399e2abe875a11f9c703500052e27319fd148d91bed98"}
Sep 05 06:25:56.749434 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:56.749412    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bb4_7f8a8f16-2422-4c01-a619-1f17fe10cd4c/ovn-acl-logging/0.log"
Sep 05 06:25:56.749974 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:56.749945    2567 generic.go:356] "Generic (PLEG): container finished" podID="7f8a8f16-2422-4c01-a619-1f17fe10cd4c" containerID="828a17c89e6a82a953df8eda3ce9569091cf5bd85216070f35270003e8860ee7" exitCode=1
Sep 05 06:25:56.750110 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:56.750040    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4" event={"ID":"7f8a8f16-2422-4c01-a619-1f17fe10cd4c","Type":"ContainerStarted","Data":"ebb9f4f22f54fab74f32bee11f946125a987ca1d8c259646f84d4a293231a64c"}
Sep 05 06:25:56.750183 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:56.750133    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4" event={"ID":"7f8a8f16-2422-4c01-a619-1f17fe10cd4c","Type":"ContainerDied","Data":"828a17c89e6a82a953df8eda3ce9569091cf5bd85216070f35270003e8860ee7"}
Sep 05 06:25:56.750239 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:56.750191    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4" event={"ID":"7f8a8f16-2422-4c01-a619-1f17fe10cd4c","Type":"ContainerStarted","Data":"56961a00f0f0569183de57e45faa7d63454544abc2d8286eefe772bd2aa456d9"}
Sep 05 06:25:56.751928 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:56.751904    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtpzl" event={"ID":"9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf","Type":"ContainerStarted","Data":"7dd1d78f13c968d31816aad689aa8fb43e8e6d4650698deb6ee01ad64cad82ac"}
Sep 05 06:25:56.753450 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:56.753423    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gqtqf" event={"ID":"6258b8f7-e185-4e63-8f2d-5f693cd6f19a","Type":"ContainerStarted","Data":"d42690c4ccc11c1e5a843166edbcb2f1e7b5f86062fadab8d831e67f9294fd1b"}
Sep 05 06:25:56.755500 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:56.755478    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d8ftv" event={"ID":"cfb4483c-d0eb-4434-95e5-46fdb9618271","Type":"ContainerStarted","Data":"368fa3f9b3cb8d0871f61d9de22950f17986c0943a3a59974bbe4751002a9f03"}
Sep 05 06:25:56.756966 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:56.756944    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-snbwl" event={"ID":"b7ed807e-6f50-4ceb-bc81-c95d18d4c24f","Type":"ContainerStarted","Data":"605539ad255f29fc9c3ed15a3cc029bf9372fb197acb4f38b346ae0ce362e86f"}
Sep 05 06:25:56.760248 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:56.760200    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vzbwh" podStartSLOduration=3.483817031 podStartE2EDuration="21.760184805s" totalImagesPullingTime="18.276367774s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 06:25:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:25:56.759791659 +0000 UTC m=+22.733546339" watchObservedRunningTime="2026-09-05 06:25:56.760184805 +0000 UTC m=+22.733939479"
Sep 05 06:25:56.775796 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:56.775730    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-snbwl" podStartSLOduration=7.51580733 podStartE2EDuration="21.775713227s" totalImagesPullingTime="14.259905897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:25:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:25:56.775647058 +0000 UTC m=+22.749401763" watchObservedRunningTime="2026-09-05 06:25:56.775713227 +0000 UTC m=+22.749467902"
Sep 05 06:25:56.791774 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:56.791724    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gqtqf" podStartSLOduration=3.552675385 podStartE2EDuration="21.79170375s" totalImagesPullingTime="18.239028365s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 06:25:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:25:56.791337541 +0000 UTC m=+22.765092216" watchObservedRunningTime="2026-09-05 06:25:56.79170375 +0000 UTC m=+22.765458427"
Sep 05 06:25:56.810381 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:56.810309    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-st2vb" podStartSLOduration=3.5548089899999997 podStartE2EDuration="21.810286012s" totalImagesPullingTime="18.255477022s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 06:25:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:25:56.809822046 +0000 UTC m=+22.783576721" watchObservedRunningTime="2026-09-05 06:25:56.810286012 +0000 UTC m=+22.784040688"
Sep 05 06:25:56.898201 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:56.898142    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-d8ftv" podStartSLOduration=3.653253188 podStartE2EDuration="21.898116999s" totalImagesPullingTime="18.244863811s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 06:25:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:25:56.828505306 +0000 UTC m=+22.802259982" watchObservedRunningTime="2026-09-05 06:25:56.898116999 +0000 UTC m=+22.871871675"
Sep 05 06:25:57.451698 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:57.451520    2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 05 06:25:57.524615 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:57.524476    2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-05T06:25:57.451691041Z","UUID":"4f068494-713a-412c-82da-729cab10c7a2","Handler":null,"Name":"","Endpoint":""}
Sep 05 06:25:57.526332 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:57.526308    2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 05 06:25:57.526332 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:57.526340    2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 05 06:25:57.762908 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:57.762885    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bb4_7f8a8f16-2422-4c01-a619-1f17fe10cd4c/ovn-acl-logging/0.log"
Sep 05 06:25:57.763701 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:57.763376    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4" event={"ID":"7f8a8f16-2422-4c01-a619-1f17fe10cd4c","Type":"ContainerStarted","Data":"e7026ec75beb29d8ad7a249df11676013090150b919d6b9fe1429344dcad8e62"}
Sep 05 06:25:57.763701 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:57.763524    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4" event={"ID":"7f8a8f16-2422-4c01-a619-1f17fe10cd4c","Type":"ContainerStarted","Data":"61e0ef55100ef2e26a38e50e41cdd0206411d749ce7f578c5765166b77f5211d"}
Sep 05 06:25:57.763701 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:57.763577    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4" event={"ID":"7f8a8f16-2422-4c01-a619-1f17fe10cd4c","Type":"ContainerStarted","Data":"8ec8f8f0635377ab67b46e544a1b7f79b2db73d34bce8f57c1ab7b586b11fdae"}
Sep 05 06:25:57.767469 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:57.767441    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtpzl" event={"ID":"9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf","Type":"ContainerStarted","Data":"d5114dd0b50bf804e495988cc14cdcc9006fec7e7f5f35dd5b665f228ee7008d"}
Sep 05 06:25:58.575242 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:58.575203    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdsjs"
Sep 05 06:25:58.575242 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:58.575241    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sg8b7"
Sep 05 06:25:58.575485 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:58.575375    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sdsjs" podUID="b63a35b8-5230-4b6a-8237-e7afcaf6182e"
Sep 05 06:25:58.575485 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:58.575405    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddpb9"
Sep 05 06:25:58.575589 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:58.575527    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sg8b7" podUID="e2b1bc6a-ad1b-422b-8e17-159ee06e7990"
Sep 05 06:25:58.575641 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:25:58.575603    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddpb9" podUID="486067d7-7a47-4c88-86d6-721fcd141e43"
Sep 05 06:25:58.771541 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:58.771498    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4bhxt" event={"ID":"abbd8c4a-73d0-4380-b78a-c3ed5b70efd2","Type":"ContainerStarted","Data":"c5f9af77afd876d042c4e87328951f35850d1f337cde83dc0167d712193d2024"}
Sep 05 06:25:58.773992 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:58.773958    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtpzl" event={"ID":"9cb8aae4-4ef2-48d6-9cd7-4f51c97d8bbf","Type":"ContainerStarted","Data":"79bbfb4cada397dd64748e45003c307b63590841b81c2c059785f5b1a01f2297"}
Sep 05 06:25:58.793467 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:58.793391    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4bhxt" podStartSLOduration=6.5448857 podStartE2EDuration="24.79337001s" totalImagesPullingTime="18.24848431s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 06:25:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:25:58.792908667 +0000 UTC m=+24.766663343" watchObservedRunningTime="2026-09-05 06:25:58.79337001 +0000 UTC m=+24.767124685"
Sep 05 06:25:58.815261 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:58.815204    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtpzl" podStartSLOduration=3.77714187 podStartE2EDuration="23.815186047s" totalImagesPullingTime="20.038044177s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 06:25:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:25:58.814217705 +0000 UTC m=+24.787972380" watchObservedRunningTime="2026-09-05 06:25:58.815186047 +0000 UTC m=+24.788940719"
Sep 05 06:25:59.780096 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:59.780063    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bb4_7f8a8f16-2422-4c01-a619-1f17fe10cd4c/ovn-acl-logging/0.log"
Sep 05 06:25:59.780752 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:25:59.780725    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4" event={"ID":"7f8a8f16-2422-4c01-a619-1f17fe10cd4c","Type":"ContainerStarted","Data":"6325fd134df033f2dd7bc18e46ada098cdc1c41b642eb43a3285cd12472cccf1"}
Sep 05 06:26:00.575336 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:00.575267    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdsjs"
Sep 05 06:26:00.575563 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:00.575272    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddpb9"
Sep 05 06:26:00.575563 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:00.575421    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sdsjs" podUID="b63a35b8-5230-4b6a-8237-e7afcaf6182e"
Sep 05 06:26:00.575563 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:00.575285    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sg8b7"
Sep 05 06:26:00.575563 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:00.575473    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddpb9" podUID="486067d7-7a47-4c88-86d6-721fcd141e43"
Sep 05 06:26:00.575796 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:00.575560    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sg8b7" podUID="e2b1bc6a-ad1b-422b-8e17-159ee06e7990"
Sep 05 06:26:01.382626 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:01.382441    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-snbwl"
Sep 05 06:26:01.383068 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:01.383052    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-snbwl"
Sep 05 06:26:01.788079 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:01.788044    2567 generic.go:356] "Generic (PLEG): container finished" podID="78512c00-0c79-4b8a-8f76-7c852a909337" containerID="472491d7d2023de8fca76725d3aa6bcb59a5c9f235df150356da539c4a4a72a5" exitCode=0
Sep 05 06:26:01.788252 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:01.788127    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d6lsz" event={"ID":"78512c00-0c79-4b8a-8f76-7c852a909337","Type":"ContainerDied","Data":"472491d7d2023de8fca76725d3aa6bcb59a5c9f235df150356da539c4a4a72a5"}
Sep 05 06:26:01.791584 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:01.791564    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bb4_7f8a8f16-2422-4c01-a619-1f17fe10cd4c/ovn-acl-logging/0.log"
Sep 05 06:26:01.791893 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:01.791863    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4" event={"ID":"7f8a8f16-2422-4c01-a619-1f17fe10cd4c","Type":"ContainerStarted","Data":"338071a49e60288cec104b1c3a1289c45cd064e6bd678c420cdc10361b53b6c6"}
Sep 05 06:26:01.792252 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:01.792235    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-snbwl"
Sep 05 06:26:01.792488 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:01.792472    2567 scope.go:117] "RemoveContainer" containerID="828a17c89e6a82a953df8eda3ce9569091cf5bd85216070f35270003e8860ee7"
Sep 05 06:26:01.792544 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:01.792519    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-snbwl"
Sep 05 06:26:02.575174 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:02.575140    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sg8b7"
Sep 05 06:26:02.575174 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:02.575182    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddpb9"
Sep 05 06:26:02.575937 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:02.575280    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sg8b7" podUID="e2b1bc6a-ad1b-422b-8e17-159ee06e7990"
Sep 05 06:26:02.575937 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:02.575350    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddpb9" podUID="486067d7-7a47-4c88-86d6-721fcd141e43"
Sep 05 06:26:02.575937 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:02.575436    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdsjs"
Sep 05 06:26:02.575937 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:02.575678    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sdsjs" podUID="b63a35b8-5230-4b6a-8237-e7afcaf6182e"
Sep 05 06:26:02.797062 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:02.796956    2567 generic.go:356] "Generic (PLEG): container finished" podID="78512c00-0c79-4b8a-8f76-7c852a909337" containerID="afeac7be156d4559b376a33619193fa8686b5a0c2cb16e5bdc71e555e4749147" exitCode=0
Sep 05 06:26:02.797062 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:02.797012    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d6lsz" event={"ID":"78512c00-0c79-4b8a-8f76-7c852a909337","Type":"ContainerDied","Data":"afeac7be156d4559b376a33619193fa8686b5a0c2cb16e5bdc71e555e4749147"}
Sep 05 06:26:02.802527 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:02.802504    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bb4_7f8a8f16-2422-4c01-a619-1f17fe10cd4c/ovn-acl-logging/0.log"
Sep 05 06:26:02.803011 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:02.802977    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4" event={"ID":"7f8a8f16-2422-4c01-a619-1f17fe10cd4c","Type":"ContainerStarted","Data":"1c00646471ac97639736c4e243c7ffe38f40c39e4f503a407d1d710b459603bc"}
Sep 05 06:26:02.804242 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:02.803340    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:26:02.804242 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:02.803414    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:26:02.804242 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:02.803723    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:26:02.823519 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:02.823485    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:26:02.823743 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:02.823723    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:26:02.854649 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:02.854458    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4" podStartSLOduration=10.561639558 podStartE2EDuration="28.854439737s" totalImagesPullingTime="18.292800179s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 06:25:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:26:02.853916468 +0000 UTC m=+28.827671144" watchObservedRunningTime="2026-09-05 06:26:02.854439737 +0000 UTC m=+28.828194416"
Sep 05 06:26:03.073611 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:03.073483    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ddpb9"]
Sep 05 06:26:03.073780 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:03.073650    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddpb9"
Sep 05 06:26:03.073780 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:03.073753    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddpb9" podUID="486067d7-7a47-4c88-86d6-721fcd141e43"
Sep 05 06:26:03.077010 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:03.076976    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sdsjs"]
Sep 05 06:26:03.077192 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:03.077134    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdsjs"
Sep 05 06:26:03.077258 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:03.077243    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sdsjs" podUID="b63a35b8-5230-4b6a-8237-e7afcaf6182e"
Sep 05 06:26:03.077586 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:03.077558    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sg8b7"]
Sep 05 06:26:03.077675 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:03.077662    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sg8b7"
Sep 05 06:26:03.077789 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:03.077770    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sg8b7" podUID="e2b1bc6a-ad1b-422b-8e17-159ee06e7990"
Sep 05 06:26:03.807793 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:03.807751    2567 generic.go:356] "Generic (PLEG): container finished" podID="78512c00-0c79-4b8a-8f76-7c852a909337" containerID="ab02f6d3e2093b887a1492aab1c77babeeedf2515d5a475ac4f03098b18b6f68" exitCode=0
Sep 05 06:26:03.808379 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:03.807838    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d6lsz" event={"ID":"78512c00-0c79-4b8a-8f76-7c852a909337","Type":"ContainerDied","Data":"ab02f6d3e2093b887a1492aab1c77babeeedf2515d5a475ac4f03098b18b6f68"}
Sep 05 06:26:04.578375 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:04.578346    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdsjs"
Sep 05 06:26:04.578587 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:04.578467    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sdsjs" podUID="b63a35b8-5230-4b6a-8237-e7afcaf6182e"
Sep 05 06:26:04.578587 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:04.578555    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sg8b7"
Sep 05 06:26:04.578697 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:04.578671    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sg8b7" podUID="e2b1bc6a-ad1b-422b-8e17-159ee06e7990"
Sep 05 06:26:04.578737 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:04.578723    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddpb9"
Sep 05 06:26:04.578832 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:04.578817    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddpb9" podUID="486067d7-7a47-4c88-86d6-721fcd141e43"
Sep 05 06:26:06.575570 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:06.575527    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddpb9"
Sep 05 06:26:06.576097 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:06.575592    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sg8b7"
Sep 05 06:26:06.576097 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:06.575706    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdsjs"
Sep 05 06:26:06.576097 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:06.575708    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddpb9" podUID="486067d7-7a47-4c88-86d6-721fcd141e43"
Sep 05 06:26:06.576097 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:06.575802    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sg8b7" podUID="e2b1bc6a-ad1b-422b-8e17-159ee06e7990"
Sep 05 06:26:06.576097 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:06.575906    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sdsjs" podUID="b63a35b8-5230-4b6a-8237-e7afcaf6182e"
Sep 05 06:26:08.319345 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:08.319153    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b63a35b8-5230-4b6a-8237-e7afcaf6182e-metrics-certs\") pod \"network-metrics-daemon-sdsjs\" (UID: \"b63a35b8-5230-4b6a-8237-e7afcaf6182e\") " pod="openshift-multus/network-metrics-daemon-sdsjs"
Sep 05 06:26:08.319682 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:08.319376    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/486067d7-7a47-4c88-86d6-721fcd141e43-original-pull-secret\") pod \"global-pull-secret-syncer-ddpb9\" (UID: \"486067d7-7a47-4c88-86d6-721fcd141e43\") " pod="kube-system/global-pull-secret-syncer-ddpb9"
Sep 05 06:26:08.319682 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:08.319310    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 05 06:26:08.319682 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:08.319473    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 05 06:26:08.319682 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:08.319482    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b63a35b8-5230-4b6a-8237-e7afcaf6182e-metrics-certs podName:b63a35b8-5230-4b6a-8237-e7afcaf6182e nodeName:}" failed. No retries permitted until 2026-09-05 06:26:40.319466043 +0000 UTC m=+66.293220696 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b63a35b8-5230-4b6a-8237-e7afcaf6182e-metrics-certs") pod "network-metrics-daemon-sdsjs" (UID: "b63a35b8-5230-4b6a-8237-e7afcaf6182e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 05 06:26:08.319682 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:08.319517    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/486067d7-7a47-4c88-86d6-721fcd141e43-original-pull-secret podName:486067d7-7a47-4c88-86d6-721fcd141e43 nodeName:}" failed. No retries permitted until 2026-09-05 06:26:40.319502291 +0000 UTC m=+66.293256947 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/486067d7-7a47-4c88-86d6-721fcd141e43-original-pull-secret") pod "global-pull-secret-syncer-ddpb9" (UID: "486067d7-7a47-4c88-86d6-721fcd141e43") : object "kube-system"/"original-pull-secret" not registered
Sep 05 06:26:08.420223 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:08.420131    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlwh7\" (UniqueName: \"kubernetes.io/projected/e2b1bc6a-ad1b-422b-8e17-159ee06e7990-kube-api-access-rlwh7\") pod \"network-check-target-sg8b7\" (UID: \"e2b1bc6a-ad1b-422b-8e17-159ee06e7990\") " pod="openshift-network-diagnostics/network-check-target-sg8b7"
Sep 05 06:26:08.420403 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:08.420259    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 05 06:26:08.420403 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:08.420274    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 05 06:26:08.420403 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:08.420284    2567 projected.go:196] Error preparing data for projected volume kube-api-access-rlwh7 for pod openshift-network-diagnostics/network-check-target-sg8b7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 05 06:26:08.420403 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:08.420337    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2b1bc6a-ad1b-422b-8e17-159ee06e7990-kube-api-access-rlwh7 podName:e2b1bc6a-ad1b-422b-8e17-159ee06e7990 nodeName:}" failed. No retries permitted until 2026-09-05 06:26:40.420323725 +0000 UTC m=+66.394078378 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rlwh7" (UniqueName: "kubernetes.io/projected/e2b1bc6a-ad1b-422b-8e17-159ee06e7990-kube-api-access-rlwh7") pod "network-check-target-sg8b7" (UID: "e2b1bc6a-ad1b-422b-8e17-159ee06e7990") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 05 06:26:08.574999 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:08.574967    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sg8b7"
Sep 05 06:26:08.574999 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:08.574988    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddpb9"
Sep 05 06:26:08.575326 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:08.574967    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdsjs"
Sep 05 06:26:08.575326 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:08.575104    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sg8b7" podUID="e2b1bc6a-ad1b-422b-8e17-159ee06e7990"
Sep 05 06:26:08.575326 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:08.575190    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sdsjs" podUID="b63a35b8-5230-4b6a-8237-e7afcaf6182e"
Sep 05 06:26:08.575326 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:08.575282    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddpb9" podUID="486067d7-7a47-4c88-86d6-721fcd141e43"
Sep 05 06:26:08.822921 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:08.822886    2567 generic.go:356] "Generic (PLEG): container finished" podID="78512c00-0c79-4b8a-8f76-7c852a909337" containerID="3b949c837bbd03d24436bf34f57178392aabc9af7de72f1a1202b48abfd38478" exitCode=0
Sep 05 06:26:08.823149 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:08.822950    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d6lsz" event={"ID":"78512c00-0c79-4b8a-8f76-7c852a909337","Type":"ContainerDied","Data":"3b949c837bbd03d24436bf34f57178392aabc9af7de72f1a1202b48abfd38478"}
Sep 05 06:26:09.266428 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:09.266402    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-49.ec2.internal" event="NodeReady"
Sep 05 06:26:09.266654 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:09.266559    2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 05 06:26:09.321586 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:09.321550    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2hbc9"]
Sep 05 06:26:09.339580 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:09.339545    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qhxfc"]
Sep 05 06:26:09.339778 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:09.339659    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2hbc9"
Sep 05 06:26:09.342330 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:09.342299    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 05 06:26:09.342519 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:09.342311    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bxnqj\""
Sep 05 06:26:09.342519 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:09.342353    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 05 06:26:09.356596 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:09.356557    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2hbc9"]
Sep 05 06:26:09.356596 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:09.356604    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qhxfc"]
Sep 05 06:26:09.356803 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:09.356683    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qhxfc"
Sep 05 06:26:09.359178 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:09.359149    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 05 06:26:09.359322 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:09.359149    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 05 06:26:09.359322 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:09.359219    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 05 06:26:09.359408 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:09.359339    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ms7q2\""
Sep 05 06:26:09.427210 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:09.427168    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60948d62-de5e-4153-88a9-35f7726ca11d-tmp-dir\") pod \"dns-default-2hbc9\" (UID: \"60948d62-de5e-4153-88a9-35f7726ca11d\") " pod="openshift-dns/dns-default-2hbc9"
Sep 05 06:26:09.427442 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:09.427239    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/60948d62-de5e-4153-88a9-35f7726ca11d-config-volume\") pod \"dns-default-2hbc9\" (UID: \"60948d62-de5e-4153-88a9-35f7726ca11d\") " pod="openshift-dns/dns-default-2hbc9"
Sep 05 06:26:09.427442 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:09.427376    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60948d62-de5e-4153-88a9-35f7726ca11d-metrics-tls\") pod \"dns-default-2hbc9\" (UID: \"60948d62-de5e-4153-88a9-35f7726ca11d\") " pod="openshift-dns/dns-default-2hbc9"
Sep 05 06:26:09.427442 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:09.427414    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tzx5\" (UniqueName: \"kubernetes.io/projected/60948d62-de5e-4153-88a9-35f7726ca11d-kube-api-access-6tzx5\") pod \"dns-default-2hbc9\" (UID: \"60948d62-de5e-4153-88a9-35f7726ca11d\") " pod="openshift-dns/dns-default-2hbc9"
Sep 05 06:26:09.528464 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:09.528375    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/60948d62-de5e-4153-88a9-35f7726ca11d-config-volume\") pod \"dns-default-2hbc9\" (UID: \"60948d62-de5e-4153-88a9-35f7726ca11d\") " pod="openshift-dns/dns-default-2hbc9"
Sep 05 06:26:09.528464 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:09.528414    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfscq\" (UniqueName: \"kubernetes.io/projected/eb9b64fc-5965-4eb1-95e0-df1dc72f4e2d-kube-api-access-jfscq\") pod \"ingress-canary-qhxfc\" (UID: \"eb9b64fc-5965-4eb1-95e0-df1dc72f4e2d\") " pod="openshift-ingress-canary/ingress-canary-qhxfc"
Sep 05 06:26:09.528464 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:09.528463    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60948d62-de5e-4153-88a9-35f7726ca11d-metrics-tls\") pod \"dns-default-2hbc9\" (UID: \"60948d62-de5e-4153-88a9-35f7726ca11d\") " pod="openshift-dns/dns-default-2hbc9"
Sep 05 06:26:09.528746 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:09.528480    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tzx5\" (UniqueName: \"kubernetes.io/projected/60948d62-de5e-4153-88a9-35f7726ca11d-kube-api-access-6tzx5\") pod \"dns-default-2hbc9\" (UID: \"60948d62-de5e-4153-88a9-35f7726ca11d\") " pod="openshift-dns/dns-default-2hbc9"
Sep 05 06:26:09.528746 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:09.528499    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb9b64fc-5965-4eb1-95e0-df1dc72f4e2d-cert\") pod \"ingress-canary-qhxfc\" (UID: \"eb9b64fc-5965-4eb1-95e0-df1dc72f4e2d\") " pod="openshift-ingress-canary/ingress-canary-qhxfc"
Sep 05 06:26:09.528746 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:09.528519    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60948d62-de5e-4153-88a9-35f7726ca11d-tmp-dir\") pod \"dns-default-2hbc9\" (UID: \"60948d62-de5e-4153-88a9-35f7726ca11d\") " pod="openshift-dns/dns-default-2hbc9"
Sep 05 06:26:09.528746 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:09.528609    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 05 06:26:09.528881 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:09.528758    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60948d62-de5e-4153-88a9-35f7726ca11d-metrics-tls podName:60948d62-de5e-4153-88a9-35f7726ca11d nodeName:}" failed. No retries permitted until 2026-09-05 06:26:10.028734552 +0000 UTC m=+36.002489209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/60948d62-de5e-4153-88a9-35f7726ca11d-metrics-tls") pod "dns-default-2hbc9" (UID: "60948d62-de5e-4153-88a9-35f7726ca11d") : secret "dns-default-metrics-tls" not found
Sep 05 06:26:09.528881 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:09.528851    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60948d62-de5e-4153-88a9-35f7726ca11d-tmp-dir\") pod \"dns-default-2hbc9\" (UID: \"60948d62-de5e-4153-88a9-35f7726ca11d\") " pod="openshift-dns/dns-default-2hbc9"
Sep 05 06:26:09.529004 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:09.528986    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/60948d62-de5e-4153-88a9-35f7726ca11d-config-volume\") pod \"dns-default-2hbc9\" (UID: \"60948d62-de5e-4153-88a9-35f7726ca11d\") " pod="openshift-dns/dns-default-2hbc9"
Sep 05 06:26:09.540011 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:09.539972    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tzx5\" (UniqueName: \"kubernetes.io/projected/60948d62-de5e-4153-88a9-35f7726ca11d-kube-api-access-6tzx5\") pod \"dns-default-2hbc9\" (UID: \"60948d62-de5e-4153-88a9-35f7726ca11d\") " pod="openshift-dns/dns-default-2hbc9"
Sep 05 06:26:09.629253 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:09.629209    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb9b64fc-5965-4eb1-95e0-df1dc72f4e2d-cert\") pod \"ingress-canary-qhxfc\" (UID: \"eb9b64fc-5965-4eb1-95e0-df1dc72f4e2d\") " pod="openshift-ingress-canary/ingress-canary-qhxfc"
Sep 05 06:26:09.629444 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:09.629270    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfscq\" (UniqueName: \"kubernetes.io/projected/eb9b64fc-5965-4eb1-95e0-df1dc72f4e2d-kube-api-access-jfscq\") pod \"ingress-canary-qhxfc\" (UID: \"eb9b64fc-5965-4eb1-95e0-df1dc72f4e2d\") " pod="openshift-ingress-canary/ingress-canary-qhxfc"
Sep 05 06:26:09.632152 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:09.632128    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb9b64fc-5965-4eb1-95e0-df1dc72f4e2d-cert\") pod \"ingress-canary-qhxfc\" (UID: \"eb9b64fc-5965-4eb1-95e0-df1dc72f4e2d\") " pod="openshift-ingress-canary/ingress-canary-qhxfc"
Sep 05 06:26:09.639872 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:09.639838    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfscq\" (UniqueName: \"kubernetes.io/projected/eb9b64fc-5965-4eb1-95e0-df1dc72f4e2d-kube-api-access-jfscq\") pod \"ingress-canary-qhxfc\" (UID: \"eb9b64fc-5965-4eb1-95e0-df1dc72f4e2d\") " pod="openshift-ingress-canary/ingress-canary-qhxfc"
Sep 05 06:26:09.665926 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:09.665887    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qhxfc"
Sep 05 06:26:09.829125 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:09.829006    2567 generic.go:356] "Generic (PLEG): container finished" podID="78512c00-0c79-4b8a-8f76-7c852a909337" containerID="8c4c477a0db456de84154dac91d44761016d3e52f0ada0c915f9020b659aad05" exitCode=0
Sep 05 06:26:09.829125 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:09.829065    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d6lsz" event={"ID":"78512c00-0c79-4b8a-8f76-7c852a909337","Type":"ContainerDied","Data":"8c4c477a0db456de84154dac91d44761016d3e52f0ada0c915f9020b659aad05"}
Sep 05 06:26:09.994229 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:09.994041    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qhxfc"]
Sep 05 06:26:09.997356 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:26:09.997328    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb9b64fc_5965_4eb1_95e0_df1dc72f4e2d.slice/crio-463b9cb3639bcc581be3eb362284ec1d10d4ec6cb8a6ea5481a86d25b40336bf WatchSource:0}: Error finding container 463b9cb3639bcc581be3eb362284ec1d10d4ec6cb8a6ea5481a86d25b40336bf: Status 404 returned error can't find the container with id 463b9cb3639bcc581be3eb362284ec1d10d4ec6cb8a6ea5481a86d25b40336bf
Sep 05 06:26:10.032791 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:10.032747    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60948d62-de5e-4153-88a9-35f7726ca11d-metrics-tls\") pod \"dns-default-2hbc9\" (UID: \"60948d62-de5e-4153-88a9-35f7726ca11d\") " pod="openshift-dns/dns-default-2hbc9"
Sep 05 06:26:10.032967 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:10.032891    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 05 06:26:10.032967 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:10.032956    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60948d62-de5e-4153-88a9-35f7726ca11d-metrics-tls podName:60948d62-de5e-4153-88a9-35f7726ca11d nodeName:}" failed. No retries permitted until 2026-09-05 06:26:11.032940469 +0000 UTC m=+37.006695122 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/60948d62-de5e-4153-88a9-35f7726ca11d-metrics-tls") pod "dns-default-2hbc9" (UID: "60948d62-de5e-4153-88a9-35f7726ca11d") : secret "dns-default-metrics-tls" not found
Sep 05 06:26:10.575483 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:10.575444    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdsjs"
Sep 05 06:26:10.576526 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:10.575444    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddpb9"
Sep 05 06:26:10.576526 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:10.575457    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sg8b7"
Sep 05 06:26:10.580501 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:10.580476    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 05 06:26:10.580940 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:10.580909    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 05 06:26:10.581100 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:10.580961    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6v7qh\""
Sep 05 06:26:10.581100 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:10.581046    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 05 06:26:10.581833 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:10.580477    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 05 06:26:10.582160 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:10.582140    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gt2zc\""
Sep 05 06:26:10.833858 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:10.833771    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qhxfc" event={"ID":"eb9b64fc-5965-4eb1-95e0-df1dc72f4e2d","Type":"ContainerStarted","Data":"463b9cb3639bcc581be3eb362284ec1d10d4ec6cb8a6ea5481a86d25b40336bf"}
Sep 05 06:26:10.838335 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:10.838297    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d6lsz" event={"ID":"78512c00-0c79-4b8a-8f76-7c852a909337","Type":"ContainerStarted","Data":"8ed1d6f4a262cf34db6a8e22b44bb28f421e441187b5ee267e38f8cfefd6fb41"}
Sep 05 06:26:10.865285 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:10.865226    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-d6lsz" podStartSLOduration=7.89779062 podStartE2EDuration="35.865207292s" totalImagesPullingTime="27.967416672s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 06:25:35 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:26:10.863555672 +0000 UTC m=+36.837310382" watchObservedRunningTime="2026-09-05 06:26:10.865207292 +0000 UTC m=+36.838961966"
Sep 05 06:26:11.040046 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:11.039986    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60948d62-de5e-4153-88a9-35f7726ca11d-metrics-tls\") pod \"dns-default-2hbc9\" (UID: \"60948d62-de5e-4153-88a9-35f7726ca11d\") " pod="openshift-dns/dns-default-2hbc9"
Sep 05 06:26:11.040222 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:11.040146    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 05 06:26:11.040272 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:11.040223    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60948d62-de5e-4153-88a9-35f7726ca11d-metrics-tls podName:60948d62-de5e-4153-88a9-35f7726ca11d nodeName:}" failed. No retries permitted until 2026-09-05 06:26:13.040203482 +0000 UTC m=+39.013958135 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/60948d62-de5e-4153-88a9-35f7726ca11d-metrics-tls") pod "dns-default-2hbc9" (UID: "60948d62-de5e-4153-88a9-35f7726ca11d") : secret "dns-default-metrics-tls" not found
Sep 05 06:26:12.845511 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:12.845428    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qhxfc" event={"ID":"eb9b64fc-5965-4eb1-95e0-df1dc72f4e2d","Type":"ContainerStarted","Data":"bbf5350dea99d1defa600fb4263ca94dbc5a8bd3d609dffe8fe32dadf470d78b"}
Sep 05 06:26:12.862699 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:12.862643    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qhxfc" podStartSLOduration=1.346822454 podStartE2EDuration="3.862627349s" totalImagesPullingTime="2.515804895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:26:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:26:12.862573994 +0000 UTC m=+38.836328670" watchObservedRunningTime="2026-09-05 06:26:12.862627349 +0000 UTC m=+38.836382023"
Sep 05 06:26:13.056281 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:13.056239    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60948d62-de5e-4153-88a9-35f7726ca11d-metrics-tls\") pod \"dns-default-2hbc9\" (UID: \"60948d62-de5e-4153-88a9-35f7726ca11d\") " pod="openshift-dns/dns-default-2hbc9"
Sep 05 06:26:13.056458 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:13.056390    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 05 06:26:13.056458 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:13.056455    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60948d62-de5e-4153-88a9-35f7726ca11d-metrics-tls podName:60948d62-de5e-4153-88a9-35f7726ca11d nodeName:}" failed. No retries permitted until 2026-09-05 06:26:17.056438882 +0000 UTC m=+43.030193538 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/60948d62-de5e-4153-88a9-35f7726ca11d-metrics-tls") pod "dns-default-2hbc9" (UID: "60948d62-de5e-4153-88a9-35f7726ca11d") : secret "dns-default-metrics-tls" not found
Sep 05 06:26:17.084380 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:17.084333    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60948d62-de5e-4153-88a9-35f7726ca11d-metrics-tls\") pod \"dns-default-2hbc9\" (UID: \"60948d62-de5e-4153-88a9-35f7726ca11d\") " pod="openshift-dns/dns-default-2hbc9"
Sep 05 06:26:17.084767 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:17.084453    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 05 06:26:17.084767 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:17.084510    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60948d62-de5e-4153-88a9-35f7726ca11d-metrics-tls podName:60948d62-de5e-4153-88a9-35f7726ca11d nodeName:}" failed. No retries permitted until 2026-09-05 06:26:25.084493856 +0000 UTC m=+51.058248509 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/60948d62-de5e-4153-88a9-35f7726ca11d-metrics-tls") pod "dns-default-2hbc9" (UID: "60948d62-de5e-4153-88a9-35f7726ca11d") : secret "dns-default-metrics-tls" not found
Sep 05 06:26:25.144555 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:25.144505    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60948d62-de5e-4153-88a9-35f7726ca11d-metrics-tls\") pod \"dns-default-2hbc9\" (UID: \"60948d62-de5e-4153-88a9-35f7726ca11d\") " pod="openshift-dns/dns-default-2hbc9"
Sep 05 06:26:25.144955 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:25.144658    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 05 06:26:25.144955 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:25.144729    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60948d62-de5e-4153-88a9-35f7726ca11d-metrics-tls podName:60948d62-de5e-4153-88a9-35f7726ca11d nodeName:}" failed. No retries permitted until 2026-09-05 06:26:41.144711795 +0000 UTC m=+67.118466448 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/60948d62-de5e-4153-88a9-35f7726ca11d-metrics-tls") pod "dns-default-2hbc9" (UID: "60948d62-de5e-4153-88a9-35f7726ca11d") : secret "dns-default-metrics-tls" not found
Sep 05 06:26:34.822283 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:34.822254    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v7bb4"
Sep 05 06:26:40.352002 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:40.351952    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b63a35b8-5230-4b6a-8237-e7afcaf6182e-metrics-certs\") pod \"network-metrics-daemon-sdsjs\" (UID: \"b63a35b8-5230-4b6a-8237-e7afcaf6182e\") " pod="openshift-multus/network-metrics-daemon-sdsjs"
Sep 05 06:26:40.352493 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:40.352046    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/486067d7-7a47-4c88-86d6-721fcd141e43-original-pull-secret\") pod \"global-pull-secret-syncer-ddpb9\" (UID: \"486067d7-7a47-4c88-86d6-721fcd141e43\") " pod="kube-system/global-pull-secret-syncer-ddpb9"
Sep 05 06:26:40.355261 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:40.355234    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 05 06:26:40.355340 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:40.355299    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 05 06:26:40.362529 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:40.362492    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 05 06:26:40.362644 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:40.362589    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b63a35b8-5230-4b6a-8237-e7afcaf6182e-metrics-certs podName:b63a35b8-5230-4b6a-8237-e7afcaf6182e nodeName:}" failed. No retries permitted until 2026-09-05 06:27:44.362569009 +0000 UTC m=+130.336323685 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b63a35b8-5230-4b6a-8237-e7afcaf6182e-metrics-certs") pod "network-metrics-daemon-sdsjs" (UID: "b63a35b8-5230-4b6a-8237-e7afcaf6182e") : secret "metrics-daemon-secret" not found
Sep 05 06:26:40.366357 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:40.366332    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/486067d7-7a47-4c88-86d6-721fcd141e43-original-pull-secret\") pod \"global-pull-secret-syncer-ddpb9\" (UID: \"486067d7-7a47-4c88-86d6-721fcd141e43\") " pod="kube-system/global-pull-secret-syncer-ddpb9"
Sep 05 06:26:40.453138 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:40.453100    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlwh7\" (UniqueName: \"kubernetes.io/projected/e2b1bc6a-ad1b-422b-8e17-159ee06e7990-kube-api-access-rlwh7\") pod \"network-check-target-sg8b7\" (UID: \"e2b1bc6a-ad1b-422b-8e17-159ee06e7990\") " pod="openshift-network-diagnostics/network-check-target-sg8b7"
Sep 05 06:26:40.456237 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:40.456215    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 05 06:26:40.465950 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:40.465922    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 05 06:26:40.476678 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:40.476644    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlwh7\" (UniqueName: \"kubernetes.io/projected/e2b1bc6a-ad1b-422b-8e17-159ee06e7990-kube-api-access-rlwh7\") pod \"network-check-target-sg8b7\" (UID: \"e2b1bc6a-ad1b-422b-8e17-159ee06e7990\") " pod="openshift-network-diagnostics/network-check-target-sg8b7"
Sep 05 06:26:40.597909 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:40.597867    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddpb9"
Sep 05 06:26:40.606807 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:40.606744    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gt2zc\""
Sep 05 06:26:40.614355 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:40.614320    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sg8b7"
Sep 05 06:26:40.914762 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:40.914653    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ddpb9"]
Sep 05 06:26:40.919935 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:26:40.919903    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod486067d7_7a47_4c88_86d6_721fcd141e43.slice/crio-8183de6d7310440dfda92e485fefd2b743e8043daaba4231933ba45953129bd4 WatchSource:0}: Error finding container 8183de6d7310440dfda92e485fefd2b743e8043daaba4231933ba45953129bd4: Status 404 returned error can't find the container with id 8183de6d7310440dfda92e485fefd2b743e8043daaba4231933ba45953129bd4
Sep 05 06:26:40.936763 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:40.936669    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sg8b7"]
Sep 05 06:26:40.939339 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:26:40.939309    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2b1bc6a_ad1b_422b_8e17_159ee06e7990.slice/crio-a86eea3f44d450e11589d8b1f84cf80e82b42ec86cedef90da6aeeea1dd85740 WatchSource:0}: Error finding container a86eea3f44d450e11589d8b1f84cf80e82b42ec86cedef90da6aeeea1dd85740: Status 404 returned error can't find the container with id a86eea3f44d450e11589d8b1f84cf80e82b42ec86cedef90da6aeeea1dd85740
Sep 05 06:26:41.158044 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:41.157992    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60948d62-de5e-4153-88a9-35f7726ca11d-metrics-tls\") pod \"dns-default-2hbc9\" (UID: \"60948d62-de5e-4153-88a9-35f7726ca11d\") " pod="openshift-dns/dns-default-2hbc9"
Sep 05 06:26:41.158272 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:41.158177    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 05 06:26:41.158272 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:26:41.158262    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60948d62-de5e-4153-88a9-35f7726ca11d-metrics-tls podName:60948d62-de5e-4153-88a9-35f7726ca11d nodeName:}" failed. No retries permitted until 2026-09-05 06:27:13.15823747 +0000 UTC m=+99.131992150 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/60948d62-de5e-4153-88a9-35f7726ca11d-metrics-tls") pod "dns-default-2hbc9" (UID: "60948d62-de5e-4153-88a9-35f7726ca11d") : secret "dns-default-metrics-tls" not found
Sep 05 06:26:41.924959 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:41.924912    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sg8b7" event={"ID":"e2b1bc6a-ad1b-422b-8e17-159ee06e7990","Type":"ContainerStarted","Data":"a86eea3f44d450e11589d8b1f84cf80e82b42ec86cedef90da6aeeea1dd85740"}
Sep 05 06:26:41.926593 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:41.926558    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ddpb9" event={"ID":"486067d7-7a47-4c88-86d6-721fcd141e43","Type":"ContainerStarted","Data":"8183de6d7310440dfda92e485fefd2b743e8043daaba4231933ba45953129bd4"}
Sep 05 06:26:45.940529 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:45.940481    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sg8b7" event={"ID":"e2b1bc6a-ad1b-422b-8e17-159ee06e7990","Type":"ContainerStarted","Data":"7464dac25dc59fdae1b46ee191520dead7aa61ea28abd9f073faf1384471a6ac"}
Sep 05 06:26:45.940973 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:45.940586    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-sg8b7"
Sep 05 06:26:45.942302 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:45.942271    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ddpb9" event={"ID":"486067d7-7a47-4c88-86d6-721fcd141e43","Type":"ContainerStarted","Data":"4922ba7d9ca946a9d1ffc2e363b9cfcabde643183a6dc882b43a3b2b1b05af1a"}
Sep 05 06:26:45.958712 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:45.958610    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-sg8b7" podStartSLOduration=66.199068394 podStartE2EDuration="1m10.958593079s" totalImagesPullingTime="4.759524685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:25:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:26:45.957868265 +0000 UTC m=+71.931622940" watchObservedRunningTime="2026-09-05 06:26:45.958593079 +0000 UTC m=+71.932347744"
Sep 05 06:26:45.977165 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:26:45.977112    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ddpb9" podStartSLOduration=66.193762757 podStartE2EDuration="1m10.977093294s" totalImagesPullingTime="4.783330537s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 06:25:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:26:45.976611939 +0000 UTC m=+71.950366606" watchObservedRunningTime="2026-09-05 06:26:45.977093294 +0000 UTC m=+71.950847968"
Sep 05 06:27:13.184850 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:13.184788    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60948d62-de5e-4153-88a9-35f7726ca11d-metrics-tls\") pod \"dns-default-2hbc9\" (UID: \"60948d62-de5e-4153-88a9-35f7726ca11d\") " pod="openshift-dns/dns-default-2hbc9"
Sep 05 06:27:13.185329 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:13.184947    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 05 06:27:13.185329 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:13.185021    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60948d62-de5e-4153-88a9-35f7726ca11d-metrics-tls podName:60948d62-de5e-4153-88a9-35f7726ca11d nodeName:}" failed. No retries permitted until 2026-09-05 06:28:17.185005036 +0000 UTC m=+163.158759688 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/60948d62-de5e-4153-88a9-35f7726ca11d-metrics-tls") pod "dns-default-2hbc9" (UID: "60948d62-de5e-4153-88a9-35f7726ca11d") : secret "dns-default-metrics-tls" not found
Sep 05 06:27:15.645409 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.645378    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5885f47846-fxgw4"]
Sep 05 06:27:15.649844 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.649823    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5885f47846-fxgw4"
Sep 05 06:27:15.652524 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.652496    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 05 06:27:15.652687 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.652552    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 05 06:27:15.652687 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.652597    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7nkm7\""
Sep 05 06:27:15.652687 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.652612    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 05 06:27:15.652687 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.652603    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 05 06:27:15.652855 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.652820    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 05 06:27:15.652855 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.652842    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 05 06:27:15.663900 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.663872    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5885f47846-fxgw4"]
Sep 05 06:27:15.702046 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.702003    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stmvl\" (UniqueName: \"kubernetes.io/projected/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-kube-api-access-stmvl\") pod \"router-default-5885f47846-fxgw4\" (UID: \"2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4\") " pod="openshift-ingress/router-default-5885f47846-fxgw4"
Sep 05 06:27:15.702230 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.702074    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-metrics-certs\") pod \"router-default-5885f47846-fxgw4\" (UID: \"2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4\") " pod="openshift-ingress/router-default-5885f47846-fxgw4"
Sep 05 06:27:15.702230 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.702137    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-default-certificate\") pod \"router-default-5885f47846-fxgw4\" (UID: \"2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4\") " pod="openshift-ingress/router-default-5885f47846-fxgw4"
Sep 05 06:27:15.702230 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.702159    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-service-ca-bundle\") pod \"router-default-5885f47846-fxgw4\" (UID: \"2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4\") " pod="openshift-ingress/router-default-5885f47846-fxgw4"
Sep 05 06:27:15.702230 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.702183    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-stats-auth\") pod \"router-default-5885f47846-fxgw4\" (UID: \"2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4\") " pod="openshift-ingress/router-default-5885f47846-fxgw4"
Sep 05 06:27:15.750923 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.750883    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-79wkv"]
Sep 05 06:27:15.753726 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.753705    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-9l7k2"]
Sep 05 06:27:15.753872 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.753853    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-79wkv"
Sep 05 06:27:15.756460 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.756436    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-9l7k2"
Sep 05 06:27:15.757313 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.757290    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 05 06:27:15.757428 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.757412    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 05 06:27:15.757475 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.757438    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 05 06:27:15.757662 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.757648    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-xhpmb\""
Sep 05 06:27:15.759378 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.759357    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 05 06:27:15.759571 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.759558    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 05 06:27:15.759619 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.759592    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-ts26l\""
Sep 05 06:27:15.760045 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.760011    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 05 06:27:15.761056 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.761016    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 05 06:27:15.771571 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.771541    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-9l7k2"]
Sep 05 06:27:15.772306 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.772289    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-79wkv"]
Sep 05 06:27:15.803294 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.803261    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-default-certificate\") pod \"router-default-5885f47846-fxgw4\" (UID: \"2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4\") " pod="openshift-ingress/router-default-5885f47846-fxgw4"
Sep 05 06:27:15.803294 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.803301    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a65ba1aa-6e50-451b-85ba-e38e380ecd68-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-9l7k2\" (UID: \"a65ba1aa-6e50-451b-85ba-e38e380ecd68\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-9l7k2"
Sep 05 06:27:15.803536 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.803322    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-service-ca-bundle\") pod \"router-default-5885f47846-fxgw4\" (UID: \"2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4\") " pod="openshift-ingress/router-default-5885f47846-fxgw4"
Sep 05 06:27:15.803536 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.803343    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-stats-auth\") pod \"router-default-5885f47846-fxgw4\" (UID: \"2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4\") " pod="openshift-ingress/router-default-5885f47846-fxgw4"
Sep 05 06:27:15.803536 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.803406    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a65ba1aa-6e50-451b-85ba-e38e380ecd68-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-9l7k2\" (UID: \"a65ba1aa-6e50-451b-85ba-e38e380ecd68\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-9l7k2"
Sep 05 06:27:15.803536 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.803440    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0245de71-4a5a-4b49-a7e2-b56c22c5c39e-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-79wkv\" (UID: \"0245de71-4a5a-4b49-a7e2-b56c22c5c39e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-79wkv"
Sep 05 06:27:15.803536 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:15.803475    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-service-ca-bundle podName:2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:16.303453206 +0000 UTC m=+102.277207863 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-service-ca-bundle") pod "router-default-5885f47846-fxgw4" (UID: "2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4") : configmap references non-existent config key: service-ca.crt
Sep 05 06:27:15.803848 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.803596    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stmvl\" (UniqueName: \"kubernetes.io/projected/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-kube-api-access-stmvl\") pod \"router-default-5885f47846-fxgw4\" (UID: \"2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4\") " pod="openshift-ingress/router-default-5885f47846-fxgw4"
Sep 05 06:27:15.803848 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.803633    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbg26\" (UniqueName: \"kubernetes.io/projected/a65ba1aa-6e50-451b-85ba-e38e380ecd68-kube-api-access-fbg26\") pod \"kube-storage-version-migrator-operator-8d7dd4675-9l7k2\" (UID: \"a65ba1aa-6e50-451b-85ba-e38e380ecd68\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-9l7k2"
Sep 05 06:27:15.803848 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.803674    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-metrics-certs\") pod \"router-default-5885f47846-fxgw4\" (UID: \"2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4\") " pod="openshift-ingress/router-default-5885f47846-fxgw4"
Sep 05 06:27:15.803848 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.803700    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9rcc\" (UniqueName: \"kubernetes.io/projected/0245de71-4a5a-4b49-a7e2-b56c22c5c39e-kube-api-access-j9rcc\") pod \"cluster-samples-operator-7cdcfcf76c-79wkv\" (UID: \"0245de71-4a5a-4b49-a7e2-b56c22c5c39e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-79wkv"
Sep 05 06:27:15.803848 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:15.803759    2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 05 06:27:15.803848 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:15.803811    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-metrics-certs podName:2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:16.303793946 +0000 UTC m=+102.277548602 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-metrics-certs") pod "router-default-5885f47846-fxgw4" (UID: "2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4") : secret "router-metrics-certs-default" not found
Sep 05 06:27:15.805976 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.805954    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-default-certificate\") pod \"router-default-5885f47846-fxgw4\" (UID: \"2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4\") " pod="openshift-ingress/router-default-5885f47846-fxgw4"
Sep 05 06:27:15.806127 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.806022    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-stats-auth\") pod \"router-default-5885f47846-fxgw4\" (UID: \"2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4\") " pod="openshift-ingress/router-default-5885f47846-fxgw4"
Sep 05 06:27:15.812290 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.812256    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stmvl\" (UniqueName: \"kubernetes.io/projected/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-kube-api-access-stmvl\") pod \"router-default-5885f47846-fxgw4\" (UID: \"2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4\") " pod="openshift-ingress/router-default-5885f47846-fxgw4"
Sep 05 06:27:15.845954 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.845909    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-nm4mr"]
Sep 05 06:27:15.849125 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.849097    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-nm4mr"
Sep 05 06:27:15.849125 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.849126    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7ff756899b-tg2xn"]
Sep 05 06:27:15.851558 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.851528    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 05 06:27:15.851740 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.851717    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 05 06:27:15.851859 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.851775    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 05 06:27:15.851859 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.851834    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-w82xc\""
Sep 05 06:27:15.852049 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.851998    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7ff756899b-tg2xn"
Sep 05 06:27:15.852150 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.852020    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 05 06:27:15.854694 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.854672    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lvk4p\""
Sep 05 06:27:15.854694 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.854686    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 05 06:27:15.854846 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.854677    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 05 06:27:15.855121 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.855102    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 05 06:27:15.859204 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.859182    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 05 06:27:15.861720 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.861642    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 05 06:27:15.862465 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.862441    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-nm4mr"]
Sep 05 06:27:15.866240 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.866217    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7ff756899b-tg2xn"]
Sep 05 06:27:15.905214 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.905112    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9rcc\" (UniqueName: \"kubernetes.io/projected/0245de71-4a5a-4b49-a7e2-b56c22c5c39e-kube-api-access-j9rcc\") pod \"cluster-samples-operator-7cdcfcf76c-79wkv\" (UID: \"0245de71-4a5a-4b49-a7e2-b56c22c5c39e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-79wkv"
Sep 05 06:27:15.905214 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.905156    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b5cb46b5-67ef-465d-b925-0edfdd986903-registry-certificates\") pod \"image-registry-7ff756899b-tg2xn\" (UID: \"b5cb46b5-67ef-465d-b925-0edfdd986903\") " pod="openshift-image-registry/image-registry-7ff756899b-tg2xn"
Sep 05 06:27:15.905465 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.905294    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b5cb46b5-67ef-465d-b925-0edfdd986903-trusted-ca\") pod \"image-registry-7ff756899b-tg2xn\" (UID: \"b5cb46b5-67ef-465d-b925-0edfdd986903\") " pod="openshift-image-registry/image-registry-7ff756899b-tg2xn"
Sep 05 06:27:15.905465 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.905340    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a65ba1aa-6e50-451b-85ba-e38e380ecd68-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-9l7k2\" (UID: \"a65ba1aa-6e50-451b-85ba-e38e380ecd68\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-9l7k2"
Sep 05 06:27:15.905465 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.905374    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78xtr\" (UniqueName: \"kubernetes.io/projected/b5cb46b5-67ef-465d-b925-0edfdd986903-kube-api-access-78xtr\") pod \"image-registry-7ff756899b-tg2xn\" (UID: \"b5cb46b5-67ef-465d-b925-0edfdd986903\") " pod="openshift-image-registry/image-registry-7ff756899b-tg2xn"
Sep 05 06:27:15.905465 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.905402    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0245de71-4a5a-4b49-a7e2-b56c22c5c39e-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-79wkv\" (UID: \"0245de71-4a5a-4b49-a7e2-b56c22c5c39e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-79wkv"
Sep 05 06:27:15.905670 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:15.905529    2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 05 06:27:15.905670 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.905540    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0721b53-eb71-4fff-8b34-a59dbe3afeb0-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-nm4mr\" (UID: \"e0721b53-eb71-4fff-8b34-a59dbe3afeb0\") " pod="openshift-insights/insights-operator-76bcd6ccf5-nm4mr"
Sep 05 06:27:15.905670 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.905580    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b5cb46b5-67ef-465d-b925-0edfdd986903-registry-tls\") pod \"image-registry-7ff756899b-tg2xn\" (UID: \"b5cb46b5-67ef-465d-b925-0edfdd986903\") " pod="openshift-image-registry/image-registry-7ff756899b-tg2xn"
Sep 05 06:27:15.905670 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:15.905625    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0245de71-4a5a-4b49-a7e2-b56c22c5c39e-samples-operator-tls podName:0245de71-4a5a-4b49-a7e2-b56c22c5c39e nodeName:}" failed. No retries permitted until 2026-09-05 06:27:16.405602552 +0000 UTC m=+102.379357220 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0245de71-4a5a-4b49-a7e2-b56c22c5c39e-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-79wkv" (UID: "0245de71-4a5a-4b49-a7e2-b56c22c5c39e") : secret "samples-operator-tls" not found
Sep 05 06:27:15.905670 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.905608    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0721b53-eb71-4fff-8b34-a59dbe3afeb0-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-nm4mr\" (UID: \"e0721b53-eb71-4fff-8b34-a59dbe3afeb0\") " pod="openshift-insights/insights-operator-76bcd6ccf5-nm4mr"
Sep 05 06:27:15.905930 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.905674    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a65ba1aa-6e50-451b-85ba-e38e380ecd68-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-9l7k2\" (UID: \"a65ba1aa-6e50-451b-85ba-e38e380ecd68\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-9l7k2"
Sep 05 06:27:15.905930 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.905699    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b5cb46b5-67ef-465d-b925-0edfdd986903-installation-pull-secrets\") pod \"image-registry-7ff756899b-tg2xn\" (UID: \"b5cb46b5-67ef-465d-b925-0edfdd986903\") " pod="openshift-image-registry/image-registry-7ff756899b-tg2xn"
Sep 05 06:27:15.905930 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.905758    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b5cb46b5-67ef-465d-b925-0edfdd986903-ca-trust-extracted\") pod \"image-registry-7ff756899b-tg2xn\" (UID: \"b5cb46b5-67ef-465d-b925-0edfdd986903\") " pod="openshift-image-registry/image-registry-7ff756899b-tg2xn"
Sep 05 06:27:15.905930 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.905797    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e0721b53-eb71-4fff-8b34-a59dbe3afeb0-snapshots\") pod \"insights-operator-76bcd6ccf5-nm4mr\" (UID: \"e0721b53-eb71-4fff-8b34-a59dbe3afeb0\") " pod="openshift-insights/insights-operator-76bcd6ccf5-nm4mr"
Sep 05 06:27:15.905930 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.905822    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b5cb46b5-67ef-465d-b925-0edfdd986903-image-registry-private-configuration\") pod \"image-registry-7ff756899b-tg2xn\" (UID: \"b5cb46b5-67ef-465d-b925-0edfdd986903\") " pod="openshift-image-registry/image-registry-7ff756899b-tg2xn"
Sep 05 06:27:15.905930 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.905873    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0721b53-eb71-4fff-8b34-a59dbe3afeb0-tmp\") pod \"insights-operator-76bcd6ccf5-nm4mr\" (UID: \"e0721b53-eb71-4fff-8b34-a59dbe3afeb0\") " pod="openshift-insights/insights-operator-76bcd6ccf5-nm4mr"
Sep 05 06:27:15.905930 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.905902    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b5cb46b5-67ef-465d-b925-0edfdd986903-bound-sa-token\") pod \"image-registry-7ff756899b-tg2xn\" (UID: \"b5cb46b5-67ef-465d-b925-0edfdd986903\") " pod="openshift-image-registry/image-registry-7ff756899b-tg2xn"
Sep 05 06:27:15.906240 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.905933    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbg26\" (UniqueName: \"kubernetes.io/projected/a65ba1aa-6e50-451b-85ba-e38e380ecd68-kube-api-access-fbg26\") pod \"kube-storage-version-migrator-operator-8d7dd4675-9l7k2\" (UID: \"a65ba1aa-6e50-451b-85ba-e38e380ecd68\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-9l7k2"
Sep 05 06:27:15.906240 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.905949    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcsr7\" (UniqueName: \"kubernetes.io/projected/e0721b53-eb71-4fff-8b34-a59dbe3afeb0-kube-api-access-bcsr7\") pod \"insights-operator-76bcd6ccf5-nm4mr\" (UID: \"e0721b53-eb71-4fff-8b34-a59dbe3afeb0\") " pod="openshift-insights/insights-operator-76bcd6ccf5-nm4mr"
Sep 05 06:27:15.906240 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.905948    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a65ba1aa-6e50-451b-85ba-e38e380ecd68-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-9l7k2\" (UID: \"a65ba1aa-6e50-451b-85ba-e38e380ecd68\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-9l7k2"
Sep 05 06:27:15.906240 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.906001    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e0721b53-eb71-4fff-8b34-a59dbe3afeb0-serving-cert\") pod \"insights-operator-76bcd6ccf5-nm4mr\" (UID: \"e0721b53-eb71-4fff-8b34-a59dbe3afeb0\") " pod="openshift-insights/insights-operator-76bcd6ccf5-nm4mr"
Sep 05 06:27:15.908127 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.908106    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a65ba1aa-6e50-451b-85ba-e38e380ecd68-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-9l7k2\" (UID: \"a65ba1aa-6e50-451b-85ba-e38e380ecd68\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-9l7k2"
Sep 05 06:27:15.914630 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.914594    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbg26\" (UniqueName: \"kubernetes.io/projected/a65ba1aa-6e50-451b-85ba-e38e380ecd68-kube-api-access-fbg26\") pod \"kube-storage-version-migrator-operator-8d7dd4675-9l7k2\" (UID: \"a65ba1aa-6e50-451b-85ba-e38e380ecd68\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-9l7k2"
Sep 05 06:27:15.914757 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:15.914729    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9rcc\" (UniqueName: \"kubernetes.io/projected/0245de71-4a5a-4b49-a7e2-b56c22c5c39e-kube-api-access-j9rcc\") pod \"cluster-samples-operator-7cdcfcf76c-79wkv\" (UID: \"0245de71-4a5a-4b49-a7e2-b56c22c5c39e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-79wkv"
Sep 05 06:27:16.006890 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:16.006846    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b5cb46b5-67ef-465d-b925-0edfdd986903-trusted-ca\") pod \"image-registry-7ff756899b-tg2xn\" (UID: \"b5cb46b5-67ef-465d-b925-0edfdd986903\") " pod="openshift-image-registry/image-registry-7ff756899b-tg2xn"
Sep 05 06:27:16.006890 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:16.006902    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78xtr\" (UniqueName: \"kubernetes.io/projected/b5cb46b5-67ef-465d-b925-0edfdd986903-kube-api-access-78xtr\") pod \"image-registry-7ff756899b-tg2xn\" (UID: \"b5cb46b5-67ef-465d-b925-0edfdd986903\") " pod="openshift-image-registry/image-registry-7ff756899b-tg2xn"
Sep 05 06:27:16.007202 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:16.007037    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0721b53-eb71-4fff-8b34-a59dbe3afeb0-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-nm4mr\" (UID: \"e0721b53-eb71-4fff-8b34-a59dbe3afeb0\") " pod="openshift-insights/insights-operator-76bcd6ccf5-nm4mr"
Sep 05 06:27:16.007202 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:16.007083    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b5cb46b5-67ef-465d-b925-0edfdd986903-registry-tls\") pod \"image-registry-7ff756899b-tg2xn\" (UID: \"b5cb46b5-67ef-465d-b925-0edfdd986903\") " pod="openshift-image-registry/image-registry-7ff756899b-tg2xn"
Sep 05 06:27:16.007202 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:16.007152    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 05 06:27:16.007202 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:16.007164    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7ff756899b-tg2xn: secret "image-registry-tls" not found
Sep 05 06:27:16.007417 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:16.007222    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5cb46b5-67ef-465d-b925-0edfdd986903-registry-tls podName:b5cb46b5-67ef-465d-b925-0edfdd986903 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:16.507201142 +0000 UTC m=+102.480955797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b5cb46b5-67ef-465d-b925-0edfdd986903-registry-tls") pod "image-registry-7ff756899b-tg2xn" (UID: "b5cb46b5-67ef-465d-b925-0edfdd986903") : secret "image-registry-tls" not found
Sep 05 06:27:16.007417 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:16.007249    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0721b53-eb71-4fff-8b34-a59dbe3afeb0-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-nm4mr\" (UID: \"e0721b53-eb71-4fff-8b34-a59dbe3afeb0\") " pod="openshift-insights/insights-operator-76bcd6ccf5-nm4mr"
Sep 05 06:27:16.007417 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:16.007305    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b5cb46b5-67ef-465d-b925-0edfdd986903-installation-pull-secrets\") pod \"image-registry-7ff756899b-tg2xn\" (UID: \"b5cb46b5-67ef-465d-b925-0edfdd986903\") " pod="openshift-image-registry/image-registry-7ff756899b-tg2xn"
Sep 05 06:27:16.007417 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:16.007349    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b5cb46b5-67ef-465d-b925-0edfdd986903-ca-trust-extracted\") pod \"image-registry-7ff756899b-tg2xn\" (UID: \"b5cb46b5-67ef-465d-b925-0edfdd986903\") " pod="openshift-image-registry/image-registry-7ff756899b-tg2xn"
Sep 05 06:27:16.007417 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:16.007378    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e0721b53-eb71-4fff-8b34-a59dbe3afeb0-snapshots\") pod \"insights-operator-76bcd6ccf5-nm4mr\" (UID: \"e0721b53-eb71-4fff-8b34-a59dbe3afeb0\") " pod="openshift-insights/insights-operator-76bcd6ccf5-nm4mr"
Sep 05 06:27:16.007668 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:16.007419    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b5cb46b5-67ef-465d-b925-0edfdd986903-image-registry-private-configuration\") pod \"image-registry-7ff756899b-tg2xn\" (UID: \"b5cb46b5-67ef-465d-b925-0edfdd986903\") " pod="openshift-image-registry/image-registry-7ff756899b-tg2xn"
Sep 05 06:27:16.007668 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:16.007465    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0721b53-eb71-4fff-8b34-a59dbe3afeb0-tmp\") pod \"insights-operator-76bcd6ccf5-nm4mr\" (UID: \"e0721b53-eb71-4fff-8b34-a59dbe3afeb0\") " pod="openshift-insights/insights-operator-76bcd6ccf5-nm4mr"
Sep 05 06:27:16.007668 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:16.007498    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b5cb46b5-67ef-465d-b925-0edfdd986903-bound-sa-token\") pod \"image-registry-7ff756899b-tg2xn\" (UID: \"b5cb46b5-67ef-465d-b925-0edfdd986903\") " pod="openshift-image-registry/image-registry-7ff756899b-tg2xn"
Sep 05 06:27:16.007668 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:16.007530    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcsr7\" (UniqueName: \"kubernetes.io/projected/e0721b53-eb71-4fff-8b34-a59dbe3afeb0-kube-api-access-bcsr7\") pod \"insights-operator-76bcd6ccf5-nm4mr\" (UID: \"e0721b53-eb71-4fff-8b34-a59dbe3afeb0\") " pod="openshift-insights/insights-operator-76bcd6ccf5-nm4mr"
Sep 05 06:27:16.007668 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:16.007555    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e0721b53-eb71-4fff-8b34-a59dbe3afeb0-serving-cert\") pod \"insights-operator-76bcd6ccf5-nm4mr\" (UID: \"e0721b53-eb71-4fff-8b34-a59dbe3afeb0\") " pod="openshift-insights/insights-operator-76bcd6ccf5-nm4mr"
Sep 05 06:27:16.007668 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:16.007595    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b5cb46b5-67ef-465d-b925-0edfdd986903-registry-certificates\") pod \"image-registry-7ff756899b-tg2xn\" (UID: \"b5cb46b5-67ef-465d-b925-0edfdd986903\") " pod="openshift-image-registry/image-registry-7ff756899b-tg2xn"
Sep 05 06:27:16.007961 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:16.007827    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b5cb46b5-67ef-465d-b925-0edfdd986903-ca-trust-extracted\") pod \"image-registry-7ff756899b-tg2xn\" (UID: \"b5cb46b5-67ef-465d-b925-0edfdd986903\") " pod="openshift-image-registry/image-registry-7ff756899b-tg2xn"
Sep 05 06:27:16.007961 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:16.007947    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0721b53-eb71-4fff-8b34-a59dbe3afeb0-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-nm4mr\" (UID: \"e0721b53-eb71-4fff-8b34-a59dbe3afeb0\") " pod="openshift-insights/insights-operator-76bcd6ccf5-nm4mr"
Sep 05 06:27:16.008099 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:16.007955    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0721b53-eb71-4fff-8b34-a59dbe3afeb0-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-nm4mr\" (UID: \"e0721b53-eb71-4fff-8b34-a59dbe3afeb0\") " pod="openshift-insights/insights-operator-76bcd6ccf5-nm4mr"
Sep 05 06:27:16.008099 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:16.007976    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e0721b53-eb71-4fff-8b34-a59dbe3afeb0-snapshots\") pod \"insights-operator-76bcd6ccf5-nm4mr\" (UID: \"e0721b53-eb71-4fff-8b34-a59dbe3afeb0\") " pod="openshift-insights/insights-operator-76bcd6ccf5-nm4mr"
Sep 05 06:27:16.008099 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:16.007967    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b5cb46b5-67ef-465d-b925-0edfdd986903-trusted-ca\") pod \"image-registry-7ff756899b-tg2xn\" (UID: \"b5cb46b5-67ef-465d-b925-0edfdd986903\") " pod="openshift-image-registry/image-registry-7ff756899b-tg2xn"
Sep 05 06:27:16.008099 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:16.008081    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0721b53-eb71-4fff-8b34-a59dbe3afeb0-tmp\") pod \"insights-operator-76bcd6ccf5-nm4mr\" (UID: \"e0721b53-eb71-4fff-8b34-a59dbe3afeb0\") " pod="openshift-insights/insights-operator-76bcd6ccf5-nm4mr"
Sep 05 06:27:16.008499 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:16.008476    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b5cb46b5-67ef-465d-b925-0edfdd986903-registry-certificates\") pod \"image-registry-7ff756899b-tg2xn\" (UID: \"b5cb46b5-67ef-465d-b925-0edfdd986903\") " pod="openshift-image-registry/image-registry-7ff756899b-tg2xn"
Sep 05 06:27:16.010137 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:16.010118    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b5cb46b5-67ef-465d-b925-0edfdd986903-image-registry-private-configuration\") pod \"image-registry-7ff756899b-tg2xn\" (UID: \"b5cb46b5-67ef-465d-b925-0edfdd986903\") " pod="openshift-image-registry/image-registry-7ff756899b-tg2xn"
Sep 05 06:27:16.010269 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:16.010249    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e0721b53-eb71-4fff-8b34-a59dbe3afeb0-serving-cert\") pod \"insights-operator-76bcd6ccf5-nm4mr\" (UID: \"e0721b53-eb71-4fff-8b34-a59dbe3afeb0\") " pod="openshift-insights/insights-operator-76bcd6ccf5-nm4mr"
Sep 05 06:27:16.010307 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:16.010285    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b5cb46b5-67ef-465d-b925-0edfdd986903-installation-pull-secrets\") pod \"image-registry-7ff756899b-tg2xn\" (UID: \"b5cb46b5-67ef-465d-b925-0edfdd986903\") " pod="openshift-image-registry/image-registry-7ff756899b-tg2xn"
Sep 05 06:27:16.019797 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:16.016857    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78xtr\" (UniqueName: \"kubernetes.io/projected/b5cb46b5-67ef-465d-b925-0edfdd986903-kube-api-access-78xtr\") pod \"image-registry-7ff756899b-tg2xn\" (UID: \"b5cb46b5-67ef-465d-b925-0edfdd986903\") " pod="openshift-image-registry/image-registry-7ff756899b-tg2xn"
Sep 05 06:27:16.019797 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:16.017020    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b5cb46b5-67ef-465d-b925-0edfdd986903-bound-sa-token\") pod \"image-registry-7ff756899b-tg2xn\" (UID: \"b5cb46b5-67ef-465d-b925-0edfdd986903\") " pod="openshift-image-registry/image-registry-7ff756899b-tg2xn"
Sep 05 06:27:16.019797 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:16.017207    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcsr7\" (UniqueName: \"kubernetes.io/projected/e0721b53-eb71-4fff-8b34-a59dbe3afeb0-kube-api-access-bcsr7\") pod \"insights-operator-76bcd6ccf5-nm4mr\" (UID: \"e0721b53-eb71-4fff-8b34-a59dbe3afeb0\") " pod="openshift-insights/insights-operator-76bcd6ccf5-nm4mr"
Sep 05 06:27:16.069245 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:16.069197    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-9l7k2"
Sep 05 06:27:16.160488 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:16.160394    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-nm4mr"
Sep 05 06:27:16.312141 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:16.312084    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-service-ca-bundle\") pod \"router-default-5885f47846-fxgw4\" (UID: \"2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4\") " pod="openshift-ingress/router-default-5885f47846-fxgw4"
Sep 05 06:27:16.312141 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:16.312154    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-metrics-certs\") pod \"router-default-5885f47846-fxgw4\" (UID: \"2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4\") " pod="openshift-ingress/router-default-5885f47846-fxgw4"
Sep 05 06:27:16.312399 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:16.312219    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-service-ca-bundle podName:2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:17.312199656 +0000 UTC m=+103.285954309 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-service-ca-bundle") pod "router-default-5885f47846-fxgw4" (UID: "2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4") : configmap references non-existent config key: service-ca.crt
Sep 05 06:27:16.312399 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:16.312273    2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 05 06:27:16.312399 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:16.312311    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-metrics-certs podName:2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:17.312299933 +0000 UTC m=+103.286054599 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-metrics-certs") pod "router-default-5885f47846-fxgw4" (UID: "2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4") : secret "router-metrics-certs-default" not found
Sep 05 06:27:16.339288 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:16.339257    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-9l7k2"]
Sep 05 06:27:16.342613 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:27:16.342588    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda65ba1aa_6e50_451b_85ba_e38e380ecd68.slice/crio-0bda438e49b0b237ef18778da855ffd09390c4046fac5bb8a28a607138c30413 WatchSource:0}: Error finding container 0bda438e49b0b237ef18778da855ffd09390c4046fac5bb8a28a607138c30413: Status 404 returned error can't find the container with id 0bda438e49b0b237ef18778da855ffd09390c4046fac5bb8a28a607138c30413
Sep 05 06:27:16.413324 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:16.413243    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0245de71-4a5a-4b49-a7e2-b56c22c5c39e-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-79wkv\" (UID: \"0245de71-4a5a-4b49-a7e2-b56c22c5c39e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-79wkv"
Sep 05 06:27:16.413456 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:16.413394    2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 05 06:27:16.413494 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:16.413456    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0245de71-4a5a-4b49-a7e2-b56c22c5c39e-samples-operator-tls podName:0245de71-4a5a-4b49-a7e2-b56c22c5c39e nodeName:}" failed. No retries permitted until 2026-09-05 06:27:17.413440183 +0000 UTC m=+103.387194840 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0245de71-4a5a-4b49-a7e2-b56c22c5c39e-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-79wkv" (UID: "0245de71-4a5a-4b49-a7e2-b56c22c5c39e") : secret "samples-operator-tls" not found
Sep 05 06:27:16.430164 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:16.430134    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-nm4mr"]
Sep 05 06:27:16.432986 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:27:16.432960    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0721b53_eb71_4fff_8b34_a59dbe3afeb0.slice/crio-dccb3aa50a9829f6b24c218515d2ca13b1632d42e9303250477cdb2b32d02016 WatchSource:0}: Error finding container dccb3aa50a9829f6b24c218515d2ca13b1632d42e9303250477cdb2b32d02016: Status 404 returned error can't find the container with id dccb3aa50a9829f6b24c218515d2ca13b1632d42e9303250477cdb2b32d02016
Sep 05 06:27:16.514110 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:16.514063    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b5cb46b5-67ef-465d-b925-0edfdd986903-registry-tls\") pod \"image-registry-7ff756899b-tg2xn\" (UID: \"b5cb46b5-67ef-465d-b925-0edfdd986903\") " pod="openshift-image-registry/image-registry-7ff756899b-tg2xn"
Sep 05 06:27:16.514314 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:16.514202    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 05 06:27:16.514314 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:16.514219    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7ff756899b-tg2xn: secret "image-registry-tls" not found
Sep 05 06:27:16.514314 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:16.514282    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5cb46b5-67ef-465d-b925-0edfdd986903-registry-tls podName:b5cb46b5-67ef-465d-b925-0edfdd986903 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:17.514262809 +0000 UTC m=+103.488017465 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b5cb46b5-67ef-465d-b925-0edfdd986903-registry-tls") pod "image-registry-7ff756899b-tg2xn" (UID: "b5cb46b5-67ef-465d-b925-0edfdd986903") : secret "image-registry-tls" not found
Sep 05 06:27:16.948272 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:16.948246    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-sg8b7"
Sep 05 06:27:17.020913 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:17.020875    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-9l7k2" event={"ID":"a65ba1aa-6e50-451b-85ba-e38e380ecd68","Type":"ContainerStarted","Data":"0bda438e49b0b237ef18778da855ffd09390c4046fac5bb8a28a607138c30413"}
Sep 05 06:27:17.022304 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:17.022271    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-nm4mr" event={"ID":"e0721b53-eb71-4fff-8b34-a59dbe3afeb0","Type":"ContainerStarted","Data":"dccb3aa50a9829f6b24c218515d2ca13b1632d42e9303250477cdb2b32d02016"}
Sep 05 06:27:17.321633 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:17.321533    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-service-ca-bundle\") pod \"router-default-5885f47846-fxgw4\" (UID: \"2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4\") " pod="openshift-ingress/router-default-5885f47846-fxgw4"
Sep 05 06:27:17.321633 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:17.321608    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-metrics-certs\") pod \"router-default-5885f47846-fxgw4\" (UID: \"2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4\") " pod="openshift-ingress/router-default-5885f47846-fxgw4"
Sep 05 06:27:17.321876 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:17.321754    2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 05 06:27:17.321876 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:17.321800    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-service-ca-bundle podName:2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:19.3217532 +0000 UTC m=+105.295507883 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-service-ca-bundle") pod "router-default-5885f47846-fxgw4" (UID: "2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4") : configmap references non-existent config key: service-ca.crt
Sep 05 06:27:17.321876 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:17.321839    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-metrics-certs podName:2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:19.321825669 +0000 UTC m=+105.295580337 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-metrics-certs") pod "router-default-5885f47846-fxgw4" (UID: "2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4") : secret "router-metrics-certs-default" not found
Sep 05 06:27:17.422786 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:17.422748    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0245de71-4a5a-4b49-a7e2-b56c22c5c39e-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-79wkv\" (UID: \"0245de71-4a5a-4b49-a7e2-b56c22c5c39e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-79wkv"
Sep 05 06:27:17.422993 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:17.422955    2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 05 06:27:17.423082 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:17.423018    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0245de71-4a5a-4b49-a7e2-b56c22c5c39e-samples-operator-tls podName:0245de71-4a5a-4b49-a7e2-b56c22c5c39e nodeName:}" failed. No retries permitted until 2026-09-05 06:27:19.422998517 +0000 UTC m=+105.396753187 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0245de71-4a5a-4b49-a7e2-b56c22c5c39e-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-79wkv" (UID: "0245de71-4a5a-4b49-a7e2-b56c22c5c39e") : secret "samples-operator-tls" not found
Sep 05 06:27:17.524302 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:17.524259    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b5cb46b5-67ef-465d-b925-0edfdd986903-registry-tls\") pod \"image-registry-7ff756899b-tg2xn\" (UID: \"b5cb46b5-67ef-465d-b925-0edfdd986903\") " pod="openshift-image-registry/image-registry-7ff756899b-tg2xn"
Sep 05 06:27:17.524462 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:17.524386    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 05 06:27:17.524462 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:17.524400    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7ff756899b-tg2xn: secret "image-registry-tls" not found
Sep 05 06:27:17.524462 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:17.524458    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5cb46b5-67ef-465d-b925-0edfdd986903-registry-tls podName:b5cb46b5-67ef-465d-b925-0edfdd986903 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:19.524438666 +0000 UTC m=+105.498193328 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b5cb46b5-67ef-465d-b925-0edfdd986903-registry-tls") pod "image-registry-7ff756899b-tg2xn" (UID: "b5cb46b5-67ef-465d-b925-0edfdd986903") : secret "image-registry-tls" not found
Sep 05 06:27:19.339860 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:19.339832    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-service-ca-bundle\") pod \"router-default-5885f47846-fxgw4\" (UID: \"2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4\") " pod="openshift-ingress/router-default-5885f47846-fxgw4"
Sep 05 06:27:19.340302 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:19.339891    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-metrics-certs\") pod \"router-default-5885f47846-fxgw4\" (UID: \"2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4\") " pod="openshift-ingress/router-default-5885f47846-fxgw4"
Sep 05 06:27:19.340302 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:19.340056    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-service-ca-bundle podName:2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:23.340011882 +0000 UTC m=+109.313766555 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-service-ca-bundle") pod "router-default-5885f47846-fxgw4" (UID: "2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4") : configmap references non-existent config key: service-ca.crt
Sep 05 06:27:19.340302 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:19.340067    2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 05 06:27:19.340302 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:19.340126    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-metrics-certs podName:2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:23.340109768 +0000 UTC m=+109.313864441 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-metrics-certs") pod "router-default-5885f47846-fxgw4" (UID: "2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4") : secret "router-metrics-certs-default" not found
Sep 05 06:27:19.440914 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:19.440867    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0245de71-4a5a-4b49-a7e2-b56c22c5c39e-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-79wkv\" (UID: \"0245de71-4a5a-4b49-a7e2-b56c22c5c39e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-79wkv"
Sep 05 06:27:19.441085 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:19.441066    2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 05 06:27:19.441162 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:19.441151    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0245de71-4a5a-4b49-a7e2-b56c22c5c39e-samples-operator-tls podName:0245de71-4a5a-4b49-a7e2-b56c22c5c39e nodeName:}" failed. No retries permitted until 2026-09-05 06:27:23.441127918 +0000 UTC m=+109.414882577 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0245de71-4a5a-4b49-a7e2-b56c22c5c39e-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-79wkv" (UID: "0245de71-4a5a-4b49-a7e2-b56c22c5c39e") : secret "samples-operator-tls" not found
Sep 05 06:27:19.541681 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:19.541591    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b5cb46b5-67ef-465d-b925-0edfdd986903-registry-tls\") pod \"image-registry-7ff756899b-tg2xn\" (UID: \"b5cb46b5-67ef-465d-b925-0edfdd986903\") " pod="openshift-image-registry/image-registry-7ff756899b-tg2xn"
Sep 05 06:27:19.541842 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:19.541717    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 05 06:27:19.541842 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:19.541733    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7ff756899b-tg2xn: secret "image-registry-tls" not found
Sep 05 06:27:19.541842 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:19.541790    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5cb46b5-67ef-465d-b925-0edfdd986903-registry-tls podName:b5cb46b5-67ef-465d-b925-0edfdd986903 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:23.541776765 +0000 UTC m=+109.515531418 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b5cb46b5-67ef-465d-b925-0edfdd986903-registry-tls") pod "image-registry-7ff756899b-tg2xn" (UID: "b5cb46b5-67ef-465d-b925-0edfdd986903") : secret "image-registry-tls" not found
Sep 05 06:27:20.032805 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:20.032762    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-nm4mr" event={"ID":"e0721b53-eb71-4fff-8b34-a59dbe3afeb0","Type":"ContainerStarted","Data":"e03cfbc459907dbec14df1238c9efaecfe178f9f0ed03bfb2ebff9eb04a6b4a3"}
Sep 05 06:27:20.034480 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:20.034450    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-9l7k2" event={"ID":"a65ba1aa-6e50-451b-85ba-e38e380ecd68","Type":"ContainerStarted","Data":"efc9ba03d56e0b5395b4465088c794beb200a3e45331787f58a2a0355d9b6427"}
Sep 05 06:27:20.068925 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:20.068860    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-9l7k2" podStartSLOduration=2.178421321 podStartE2EDuration="5.068836992s" totalImagesPullingTime="2.890415671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:27:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:27:20.068009946 +0000 UTC m=+106.041764623" watchObservedRunningTime="2026-09-05 06:27:20.068836992 +0000 UTC m=+106.042591668"
Sep 05 06:27:20.069178 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:20.069151    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-nm4mr" podStartSLOduration=2.26470528 podStartE2EDuration="5.069141269s" totalImagesPullingTime="2.804435989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:27:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:27:20.050918123 +0000 UTC m=+106.024672799" watchObservedRunningTime="2026-09-05 06:27:20.069141269 +0000 UTC m=+106.042895941"
Sep 05 06:27:20.478132 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:20.478093    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xhw98"]
Sep 05 06:27:20.496520 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:20.496485    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xhw98"]
Sep 05 06:27:20.496727 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:20.496643    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xhw98"
Sep 05 06:27:20.499701 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:20.499660    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 05 06:27:20.499854 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:20.499815    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 05 06:27:20.500120 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:20.500105    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qtk85\""
Sep 05 06:27:20.653334 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:20.653298    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgzr2\" (UniqueName: \"kubernetes.io/projected/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-kube-api-access-qgzr2\") pod \"insights-runtime-extractor-xhw98\" (UID: \"83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1\") " pod="openshift-insights/insights-runtime-extractor-xhw98"
Sep 05 06:27:20.653545 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:20.653502    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-crio-socket\") pod \"insights-runtime-extractor-xhw98\" (UID: \"83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1\") " pod="openshift-insights/insights-runtime-extractor-xhw98"
Sep 05 06:27:20.653618 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:20.653579    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xhw98\" (UID: \"83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1\") " pod="openshift-insights/insights-runtime-extractor-xhw98"
Sep 05 06:27:20.653703 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:20.653685    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xhw98\" (UID: \"83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1\") " pod="openshift-insights/insights-runtime-extractor-xhw98"
Sep 05 06:27:20.653735 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:20.653713    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-data-volume\") pod \"insights-runtime-extractor-xhw98\" (UID: \"83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1\") " pod="openshift-insights/insights-runtime-extractor-xhw98"
Sep 05 06:27:20.754924 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:20.754835    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xhw98\" (UID: \"83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1\") " pod="openshift-insights/insights-runtime-extractor-xhw98"
Sep 05 06:27:20.754924 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:20.754879    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-data-volume\") pod \"insights-runtime-extractor-xhw98\" (UID: \"83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1\") " pod="openshift-insights/insights-runtime-extractor-xhw98"
Sep 05 06:27:20.755158 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:20.754964    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 05 06:27:20.755158 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:20.755021    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgzr2\" (UniqueName: \"kubernetes.io/projected/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-kube-api-access-qgzr2\") pod \"insights-runtime-extractor-xhw98\" (UID: \"83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1\") " pod="openshift-insights/insights-runtime-extractor-xhw98"
Sep 05 06:27:20.755158 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:20.755067    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-kube-rbac-proxy-cm podName:83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:21.255021931 +0000 UTC m=+107.228776587 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xhw98" (UID: "83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1") : configmap "kube-rbac-proxy" not found
Sep 05 06:27:20.755158 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:20.755121    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-crio-socket\") pod \"insights-runtime-extractor-xhw98\" (UID: \"83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1\") " pod="openshift-insights/insights-runtime-extractor-xhw98"
Sep 05 06:27:20.755343 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:20.755159    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xhw98\" (UID: \"83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1\") " pod="openshift-insights/insights-runtime-extractor-xhw98"
Sep 05 06:27:20.755343 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:20.755216    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-data-volume\") pod \"insights-runtime-extractor-xhw98\" (UID: \"83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1\") " pod="openshift-insights/insights-runtime-extractor-xhw98"
Sep 05 06:27:20.755343 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:20.755266    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 05 06:27:20.755343 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:20.755261    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-crio-socket\") pod \"insights-runtime-extractor-xhw98\" (UID: \"83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1\") " pod="openshift-insights/insights-runtime-extractor-xhw98"
Sep 05 06:27:20.755343 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:20.755303    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-insights-runtime-extractor-tls podName:83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:21.255294511 +0000 UTC m=+107.229049163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xhw98" (UID: "83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1") : secret "insights-runtime-extractor-tls" not found
Sep 05 06:27:20.764688 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:20.764662    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgzr2\" (UniqueName: \"kubernetes.io/projected/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-kube-api-access-qgzr2\") pod \"insights-runtime-extractor-xhw98\" (UID: \"83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1\") " pod="openshift-insights/insights-runtime-extractor-xhw98"
Sep 05 06:27:21.259978 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:21.259940    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xhw98\" (UID: \"83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1\") " pod="openshift-insights/insights-runtime-extractor-xhw98"
Sep 05 06:27:21.260168 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:21.260039    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xhw98\" (UID: \"83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1\") " pod="openshift-insights/insights-runtime-extractor-xhw98"
Sep 05 06:27:21.260168 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:21.260122    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 05 06:27:21.260254 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:21.260206    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-insights-runtime-extractor-tls podName:83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:22.260188417 +0000 UTC m=+108.233943069 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xhw98" (UID: "83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1") : secret "insights-runtime-extractor-tls" not found
Sep 05 06:27:21.260254 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:21.260127    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 05 06:27:21.260330 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:21.260281    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-kube-rbac-proxy-cm podName:83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:22.260265991 +0000 UTC m=+108.234020831 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xhw98" (UID: "83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1") : configmap "kube-rbac-proxy" not found
Sep 05 06:27:22.267157 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:22.267111    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xhw98\" (UID: \"83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1\") " pod="openshift-insights/insights-runtime-extractor-xhw98"
Sep 05 06:27:22.267555 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:22.267215    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xhw98\" (UID: \"83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1\") " pod="openshift-insights/insights-runtime-extractor-xhw98"
Sep 05 06:27:22.267555 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:22.267261    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 05 06:27:22.267555 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:22.267309    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 05 06:27:22.267555 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:22.267337    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-kube-rbac-proxy-cm podName:83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:24.267318814 +0000 UTC m=+110.241073497 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xhw98" (UID: "83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1") : configmap "kube-rbac-proxy" not found
Sep 05 06:27:22.267555 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:22.267359    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-insights-runtime-extractor-tls podName:83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:24.267348186 +0000 UTC m=+110.241102872 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xhw98" (UID: "83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1") : secret "insights-runtime-extractor-tls" not found
Sep 05 06:27:22.431047 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:22.430995    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gqtqf_6258b8f7-e185-4e63-8f2d-5f693cd6f19a/dns-node-resolver/0.log"
Sep 05 06:27:23.378130 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:23.378076    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-service-ca-bundle\") pod \"router-default-5885f47846-fxgw4\" (UID: \"2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4\") " pod="openshift-ingress/router-default-5885f47846-fxgw4"
Sep 05 06:27:23.378527 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:23.378147    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-metrics-certs\") pod \"router-default-5885f47846-fxgw4\" (UID: \"2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4\") " pod="openshift-ingress/router-default-5885f47846-fxgw4"
Sep 05 06:27:23.378527 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:23.378274    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-service-ca-bundle podName:2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:31.378252447 +0000 UTC m=+117.352007120 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-service-ca-bundle") pod "router-default-5885f47846-fxgw4" (UID: "2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4") : configmap references non-existent config key: service-ca.crt
Sep 05 06:27:23.378527 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:23.378283    2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 05 06:27:23.378527 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:23.378325    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-metrics-certs podName:2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:31.378313767 +0000 UTC m=+117.352068420 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-metrics-certs") pod "router-default-5885f47846-fxgw4" (UID: "2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4") : secret "router-metrics-certs-default" not found
Sep 05 06:27:23.478805 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:23.478761    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0245de71-4a5a-4b49-a7e2-b56c22c5c39e-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-79wkv\" (UID: \"0245de71-4a5a-4b49-a7e2-b56c22c5c39e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-79wkv"
Sep 05 06:27:23.478983 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:23.478917    2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 05 06:27:23.479021 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:23.478984    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0245de71-4a5a-4b49-a7e2-b56c22c5c39e-samples-operator-tls podName:0245de71-4a5a-4b49-a7e2-b56c22c5c39e nodeName:}" failed. No retries permitted until 2026-09-05 06:27:31.478967464 +0000 UTC m=+117.452722128 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0245de71-4a5a-4b49-a7e2-b56c22c5c39e-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-79wkv" (UID: "0245de71-4a5a-4b49-a7e2-b56c22c5c39e") : secret "samples-operator-tls" not found
Sep 05 06:27:23.579529 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:23.579493    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b5cb46b5-67ef-465d-b925-0edfdd986903-registry-tls\") pod \"image-registry-7ff756899b-tg2xn\" (UID: \"b5cb46b5-67ef-465d-b925-0edfdd986903\") " pod="openshift-image-registry/image-registry-7ff756899b-tg2xn"
Sep 05 06:27:23.579646 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:23.579623    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 05 06:27:23.579646 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:23.579636    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7ff756899b-tg2xn: secret "image-registry-tls" not found
Sep 05 06:27:23.579724 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:23.579684    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5cb46b5-67ef-465d-b925-0edfdd986903-registry-tls podName:b5cb46b5-67ef-465d-b925-0edfdd986903 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:31.579671837 +0000 UTC m=+117.553426490 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b5cb46b5-67ef-465d-b925-0edfdd986903-registry-tls") pod "image-registry-7ff756899b-tg2xn" (UID: "b5cb46b5-67ef-465d-b925-0edfdd986903") : secret "image-registry-tls" not found
Sep 05 06:27:23.630624 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:23.630544    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d8ftv_cfb4483c-d0eb-4434-95e5-46fdb9618271/node-ca/0.log"
Sep 05 06:27:24.285720 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:24.285675    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xhw98\" (UID: \"83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1\") " pod="openshift-insights/insights-runtime-extractor-xhw98"
Sep 05 06:27:24.285720 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:24.285749    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xhw98\" (UID: \"83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1\") " pod="openshift-insights/insights-runtime-extractor-xhw98"
Sep 05 06:27:24.285965 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:24.285875    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 05 06:27:24.285965 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:24.285884    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 05 06:27:24.285965 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:24.285945    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-insights-runtime-extractor-tls podName:83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:28.285928296 +0000 UTC m=+114.259682969 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xhw98" (UID: "83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1") : secret "insights-runtime-extractor-tls" not found
Sep 05 06:27:24.285965 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:24.285960    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-kube-rbac-proxy-cm podName:83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:28.285954117 +0000 UTC m=+114.259708769 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xhw98" (UID: "83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1") : configmap "kube-rbac-proxy" not found
Sep 05 06:27:24.435981 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:24.435950    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qhxfc_eb9b64fc-5965-4eb1-95e0-df1dc72f4e2d/serve-healthcheck-canary/0.log"
Sep 05 06:27:28.315379 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:28.315334    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xhw98\" (UID: \"83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1\") " pod="openshift-insights/insights-runtime-extractor-xhw98"
Sep 05 06:27:28.315839 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:28.315398    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xhw98\" (UID: \"83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1\") " pod="openshift-insights/insights-runtime-extractor-xhw98"
Sep 05 06:27:28.315839 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:28.315525    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 05 06:27:28.315839 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:28.315534    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 05 06:27:28.315839 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:28.315586    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-kube-rbac-proxy-cm podName:83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:36.315569347 +0000 UTC m=+122.289324020 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xhw98" (UID: "83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1") : configmap "kube-rbac-proxy" not found
Sep 05 06:27:28.315839 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:28.315601    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-insights-runtime-extractor-tls podName:83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:36.315594163 +0000 UTC m=+122.289348816 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xhw98" (UID: "83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1") : secret "insights-runtime-extractor-tls" not found
Sep 05 06:27:31.443402 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:31.443346    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-metrics-certs\") pod \"router-default-5885f47846-fxgw4\" (UID: \"2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4\") " pod="openshift-ingress/router-default-5885f47846-fxgw4"
Sep 05 06:27:31.443820 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:31.443478    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-service-ca-bundle\") pod \"router-default-5885f47846-fxgw4\" (UID: \"2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4\") " pod="openshift-ingress/router-default-5885f47846-fxgw4"
Sep 05 06:27:31.444061 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:31.444020    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-service-ca-bundle\") pod \"router-default-5885f47846-fxgw4\" (UID: \"2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4\") " pod="openshift-ingress/router-default-5885f47846-fxgw4"
Sep 05 06:27:31.445947 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:31.445924    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4-metrics-certs\") pod \"router-default-5885f47846-fxgw4\" (UID: \"2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4\") " pod="openshift-ingress/router-default-5885f47846-fxgw4"
Sep 05 06:27:31.544642 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:31.544595    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0245de71-4a5a-4b49-a7e2-b56c22c5c39e-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-79wkv\" (UID: \"0245de71-4a5a-4b49-a7e2-b56c22c5c39e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-79wkv"
Sep 05 06:27:31.547360 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:31.547332    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0245de71-4a5a-4b49-a7e2-b56c22c5c39e-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-79wkv\" (UID: \"0245de71-4a5a-4b49-a7e2-b56c22c5c39e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-79wkv"
Sep 05 06:27:31.559293 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:31.559257    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5885f47846-fxgw4"
Sep 05 06:27:31.645543 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:31.645508    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b5cb46b5-67ef-465d-b925-0edfdd986903-registry-tls\") pod \"image-registry-7ff756899b-tg2xn\" (UID: \"b5cb46b5-67ef-465d-b925-0edfdd986903\") " pod="openshift-image-registry/image-registry-7ff756899b-tg2xn"
Sep 05 06:27:31.648232 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:31.648202    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b5cb46b5-67ef-465d-b925-0edfdd986903-registry-tls\") pod \"image-registry-7ff756899b-tg2xn\" (UID: \"b5cb46b5-67ef-465d-b925-0edfdd986903\") " pod="openshift-image-registry/image-registry-7ff756899b-tg2xn"
Sep 05 06:27:31.665126 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:31.665092    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-79wkv"
Sep 05 06:27:31.766859 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:31.766817    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7ff756899b-tg2xn"
Sep 05 06:27:31.835168 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:27:31.835138    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a44b8ba_bd6c_48fd_890d_bf1e34cc6dd4.slice/crio-6137f1567c7a91b1be6c22c4069e5c56e6e16f52da2345bdd77ec76fad7ca0cc WatchSource:0}: Error finding container 6137f1567c7a91b1be6c22c4069e5c56e6e16f52da2345bdd77ec76fad7ca0cc: Status 404 returned error can't find the container with id 6137f1567c7a91b1be6c22c4069e5c56e6e16f52da2345bdd77ec76fad7ca0cc
Sep 05 06:27:31.836660 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:31.836564    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5885f47846-fxgw4"]
Sep 05 06:27:31.936505 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:31.936428    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-79wkv"]
Sep 05 06:27:32.044339 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:32.044308    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7ff756899b-tg2xn"]
Sep 05 06:27:32.047743 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:27:32.047714    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5cb46b5_67ef_465d_b925_0edfdd986903.slice/crio-bc97b2faf6321d2400dadfb2c9a703989694d5ea5ea2e8aca0a9231e1608577c WatchSource:0}: Error finding container bc97b2faf6321d2400dadfb2c9a703989694d5ea5ea2e8aca0a9231e1608577c: Status 404 returned error can't find the container with id bc97b2faf6321d2400dadfb2c9a703989694d5ea5ea2e8aca0a9231e1608577c
Sep 05 06:27:32.079170 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:32.079137    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5885f47846-fxgw4" event={"ID":"2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4","Type":"ContainerStarted","Data":"3b9645c183056d51a40dbde2ab56dc4a40d179869b054377ebe2b767a0436ea0"}
Sep 05 06:27:32.079332 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:32.079198    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5885f47846-fxgw4" event={"ID":"2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4","Type":"ContainerStarted","Data":"6137f1567c7a91b1be6c22c4069e5c56e6e16f52da2345bdd77ec76fad7ca0cc"}
Sep 05 06:27:32.080641 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:32.080609    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-79wkv" event={"ID":"0245de71-4a5a-4b49-a7e2-b56c22c5c39e","Type":"ContainerStarted","Data":"f38a9344c8242f247421da546b0d5b4ffa3c662def649fa68e761f36f6b72e4a"}
Sep 05 06:27:32.081822 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:32.081798    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ff756899b-tg2xn" event={"ID":"b5cb46b5-67ef-465d-b925-0edfdd986903","Type":"ContainerStarted","Data":"bc97b2faf6321d2400dadfb2c9a703989694d5ea5ea2e8aca0a9231e1608577c"}
Sep 05 06:27:32.100073 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:32.100005    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5885f47846-fxgw4" podStartSLOduration=17.099987801 podStartE2EDuration="17.099987801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:27:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:27:32.098731964 +0000 UTC m=+118.072486674" watchObservedRunningTime="2026-09-05 06:27:32.099987801 +0000 UTC m=+118.073742489"
Sep 05 06:27:32.560272 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:32.560231    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5885f47846-fxgw4"
Sep 05 06:27:32.563249 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:32.563222    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5885f47846-fxgw4"
Sep 05 06:27:33.086155 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:33.086117    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ff756899b-tg2xn" event={"ID":"b5cb46b5-67ef-465d-b925-0edfdd986903","Type":"ContainerStarted","Data":"19c686072395f375fb528bbd1ff1c4c11cf37d56fbf6f130f0a790f05aac7ba2"}
Sep 05 06:27:33.086346 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:33.086317    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5885f47846-fxgw4"
Sep 05 06:27:33.087627 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:33.087606    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5885f47846-fxgw4"
Sep 05 06:27:33.108449 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:33.108397    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7ff756899b-tg2xn" podStartSLOduration=18.108379415 podStartE2EDuration="18.108379415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:27:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:27:33.107659946 +0000 UTC m=+119.081414630" watchObservedRunningTime="2026-09-05 06:27:33.108379415 +0000 UTC m=+119.082134089"
Sep 05 06:27:34.091080 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:34.091039    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-79wkv" event={"ID":"0245de71-4a5a-4b49-a7e2-b56c22c5c39e","Type":"ContainerStarted","Data":"edb8e19b7797c894107587cd558e201ac43c056b3d4578db807b2b8180129089"}
Sep 05 06:27:34.091511 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:34.091402    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7ff756899b-tg2xn"
Sep 05 06:27:34.091511 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:34.091436    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-79wkv" event={"ID":"0245de71-4a5a-4b49-a7e2-b56c22c5c39e","Type":"ContainerStarted","Data":"ed3c3bfbcc841b326841757289a623b92da030d6a28761e218b4d8a1c4dd20da"}
Sep 05 06:27:34.109824 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:34.109762    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-79wkv" podStartSLOduration=17.418878403 podStartE2EDuration="19.109746766s" totalImagesPullingTime="1.690868363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:27:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:27:34.108984603 +0000 UTC m=+120.082739279" watchObservedRunningTime="2026-09-05 06:27:34.109746766 +0000 UTC m=+120.083501441"
Sep 05 06:27:36.385328 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:36.385286    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xhw98\" (UID: \"83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1\") " pod="openshift-insights/insights-runtime-extractor-xhw98"
Sep 05 06:27:36.385725 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:36.385354    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xhw98\" (UID: \"83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1\") " pod="openshift-insights/insights-runtime-extractor-xhw98"
Sep 05 06:27:36.385869 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:36.385850    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xhw98\" (UID: \"83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1\") " pod="openshift-insights/insights-runtime-extractor-xhw98"
Sep 05 06:27:36.387797 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:36.387765    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xhw98\" (UID: \"83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1\") " pod="openshift-insights/insights-runtime-extractor-xhw98"
Sep 05 06:27:36.408941 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:36.408909    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qtk85\""
Sep 05 06:27:36.416699 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:36.416672    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xhw98"
Sep 05 06:27:36.687963 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:36.687939    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xhw98"]
Sep 05 06:27:36.690415 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:27:36.690386    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83fdc0e2_36c9_4260_a169_8f8dfbcc0ff1.slice/crio-b0bfff374ee45eaec53cd759490fd61816345bf0f1d5653ef79015f710095152 WatchSource:0}: Error finding container b0bfff374ee45eaec53cd759490fd61816345bf0f1d5653ef79015f710095152: Status 404 returned error can't find the container with id b0bfff374ee45eaec53cd759490fd61816345bf0f1d5653ef79015f710095152
Sep 05 06:27:37.102272 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:37.102237    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xhw98" event={"ID":"83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1","Type":"ContainerStarted","Data":"1d1669093c5ef720448c20d6dfd3527d9fdceadbe4fdc2293849918f38a6fe27"}
Sep 05 06:27:37.102469 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:37.102305    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xhw98" event={"ID":"83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1","Type":"ContainerStarted","Data":"b0bfff374ee45eaec53cd759490fd61816345bf0f1d5653ef79015f710095152"}
Sep 05 06:27:38.108208 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:38.108161    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xhw98" event={"ID":"83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1","Type":"ContainerStarted","Data":"fbe70bfd6f36562185ca2d3d1821cde5cd6013dc40ca56c1c73ee5abad04bf9e"}
Sep 05 06:27:39.112998 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:39.112912    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xhw98" event={"ID":"83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1","Type":"ContainerStarted","Data":"ac4386f04360d8fc6132cf7caee078c7a4828d12c550ad2a8deec957e9dcec62"}
Sep 05 06:27:39.132702 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:39.132634    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xhw98" podStartSLOduration=17.172249703 podStartE2EDuration="19.132614969s" totalImagesPullingTime="1.960365266s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 06:27:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:27:39.132083287 +0000 UTC m=+125.105837961" watchObservedRunningTime="2026-09-05 06:27:39.132614969 +0000 UTC m=+125.106369645"
Sep 05 06:27:44.451234 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:44.451180    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b63a35b8-5230-4b6a-8237-e7afcaf6182e-metrics-certs\") pod \"network-metrics-daemon-sdsjs\" (UID: \"b63a35b8-5230-4b6a-8237-e7afcaf6182e\") " pod="openshift-multus/network-metrics-daemon-sdsjs"
Sep 05 06:27:44.453624 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:44.453603    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b63a35b8-5230-4b6a-8237-e7afcaf6182e-metrics-certs\") pod \"network-metrics-daemon-sdsjs\" (UID: \"b63a35b8-5230-4b6a-8237-e7afcaf6182e\") " pod="openshift-multus/network-metrics-daemon-sdsjs"
Sep 05 06:27:44.493526 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:44.493493    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6v7qh\""
Sep 05 06:27:44.501115 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:44.501088    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdsjs"
Sep 05 06:27:44.705825 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:44.705728    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7ff756899b-tg2xn"]
Sep 05 06:27:44.745428 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:44.745393    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-56b9678bf9-7cgmx"]
Sep 05 06:27:44.749749 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:44.749726    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56b9678bf9-7cgmx"
Sep 05 06:27:44.754246 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:44.754212    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e6e30ace-ad3e-48df-a76f-826f347a3a2b-image-registry-private-configuration\") pod \"image-registry-56b9678bf9-7cgmx\" (UID: \"e6e30ace-ad3e-48df-a76f-826f347a3a2b\") " pod="openshift-image-registry/image-registry-56b9678bf9-7cgmx"
Sep 05 06:27:44.754496 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:44.754476    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e6e30ace-ad3e-48df-a76f-826f347a3a2b-trusted-ca\") pod \"image-registry-56b9678bf9-7cgmx\" (UID: \"e6e30ace-ad3e-48df-a76f-826f347a3a2b\") " pod="openshift-image-registry/image-registry-56b9678bf9-7cgmx"
Sep 05 06:27:44.754655 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:44.754638    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e6e30ace-ad3e-48df-a76f-826f347a3a2b-ca-trust-extracted\") pod \"image-registry-56b9678bf9-7cgmx\" (UID: \"e6e30ace-ad3e-48df-a76f-826f347a3a2b\") " pod="openshift-image-registry/image-registry-56b9678bf9-7cgmx"
Sep 05 06:27:44.754785 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:44.754764    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e6e30ace-ad3e-48df-a76f-826f347a3a2b-registry-certificates\") pod \"image-registry-56b9678bf9-7cgmx\" (UID: \"e6e30ace-ad3e-48df-a76f-826f347a3a2b\") " pod="openshift-image-registry/image-registry-56b9678bf9-7cgmx"
Sep 05 06:27:44.754916 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:44.754790    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs29t\" (UniqueName: \"kubernetes.io/projected/e6e30ace-ad3e-48df-a76f-826f347a3a2b-kube-api-access-gs29t\") pod \"image-registry-56b9678bf9-7cgmx\" (UID: \"e6e30ace-ad3e-48df-a76f-826f347a3a2b\") " pod="openshift-image-registry/image-registry-56b9678bf9-7cgmx"
Sep 05 06:27:44.754916 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:44.754821    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6e30ace-ad3e-48df-a76f-826f347a3a2b-bound-sa-token\") pod \"image-registry-56b9678bf9-7cgmx\" (UID: \"e6e30ace-ad3e-48df-a76f-826f347a3a2b\") " pod="openshift-image-registry/image-registry-56b9678bf9-7cgmx"
Sep 05 06:27:44.754916 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:44.754849    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e6e30ace-ad3e-48df-a76f-826f347a3a2b-installation-pull-secrets\") pod \"image-registry-56b9678bf9-7cgmx\" (UID: \"e6e30ace-ad3e-48df-a76f-826f347a3a2b\") " pod="openshift-image-registry/image-registry-56b9678bf9-7cgmx"
Sep 05 06:27:44.754916 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:44.754875    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6e30ace-ad3e-48df-a76f-826f347a3a2b-registry-tls\") pod \"image-registry-56b9678bf9-7cgmx\" (UID: \"e6e30ace-ad3e-48df-a76f-826f347a3a2b\") " pod="openshift-image-registry/image-registry-56b9678bf9-7cgmx"
Sep 05 06:27:44.761482 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:44.761451    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56b9678bf9-7cgmx"]
Sep 05 06:27:44.783821 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:44.783791    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sdsjs"]
Sep 05 06:27:44.786991 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:27:44.786963    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb63a35b8_5230_4b6a_8237_e7afcaf6182e.slice/crio-4f1f46fe369bc7e9099969e1a6b9304ac8a7435b329275117edbacf13a59cb87 WatchSource:0}: Error finding container 4f1f46fe369bc7e9099969e1a6b9304ac8a7435b329275117edbacf13a59cb87: Status 404 returned error can't find the container with id 4f1f46fe369bc7e9099969e1a6b9304ac8a7435b329275117edbacf13a59cb87
Sep 05 06:27:44.855661 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:44.855622    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e6e30ace-ad3e-48df-a76f-826f347a3a2b-trusted-ca\") pod \"image-registry-56b9678bf9-7cgmx\" (UID: \"e6e30ace-ad3e-48df-a76f-826f347a3a2b\") " pod="openshift-image-registry/image-registry-56b9678bf9-7cgmx"
Sep 05 06:27:44.855661 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:44.855676    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e6e30ace-ad3e-48df-a76f-826f347a3a2b-ca-trust-extracted\") pod \"image-registry-56b9678bf9-7cgmx\" (UID: \"e6e30ace-ad3e-48df-a76f-826f347a3a2b\") " pod="openshift-image-registry/image-registry-56b9678bf9-7cgmx"
Sep 05 06:27:44.855944 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:44.855697    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e6e30ace-ad3e-48df-a76f-826f347a3a2b-registry-certificates\") pod \"image-registry-56b9678bf9-7cgmx\" (UID: \"e6e30ace-ad3e-48df-a76f-826f347a3a2b\") " pod="openshift-image-registry/image-registry-56b9678bf9-7cgmx"
Sep 05 06:27:44.855944 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:44.855712    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs29t\" (UniqueName: \"kubernetes.io/projected/e6e30ace-ad3e-48df-a76f-826f347a3a2b-kube-api-access-gs29t\") pod \"image-registry-56b9678bf9-7cgmx\" (UID: \"e6e30ace-ad3e-48df-a76f-826f347a3a2b\") " pod="openshift-image-registry/image-registry-56b9678bf9-7cgmx"
Sep 05 06:27:44.855944 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:44.855730    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6e30ace-ad3e-48df-a76f-826f347a3a2b-bound-sa-token\") pod \"image-registry-56b9678bf9-7cgmx\" (UID: \"e6e30ace-ad3e-48df-a76f-826f347a3a2b\") " pod="openshift-image-registry/image-registry-56b9678bf9-7cgmx"
Sep 05 06:27:44.855944 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:44.855881    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e6e30ace-ad3e-48df-a76f-826f347a3a2b-installation-pull-secrets\") pod \"image-registry-56b9678bf9-7cgmx\" (UID: \"e6e30ace-ad3e-48df-a76f-826f347a3a2b\") " pod="openshift-image-registry/image-registry-56b9678bf9-7cgmx"
Sep 05 06:27:44.855944 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:44.855935    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6e30ace-ad3e-48df-a76f-826f347a3a2b-registry-tls\") pod \"image-registry-56b9678bf9-7cgmx\" (UID: \"e6e30ace-ad3e-48df-a76f-826f347a3a2b\") " pod="openshift-image-registry/image-registry-56b9678bf9-7cgmx"
Sep 05 06:27:44.856204 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:44.855986    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e6e30ace-ad3e-48df-a76f-826f347a3a2b-image-registry-private-configuration\") pod \"image-registry-56b9678bf9-7cgmx\" (UID: \"e6e30ace-ad3e-48df-a76f-826f347a3a2b\") " pod="openshift-image-registry/image-registry-56b9678bf9-7cgmx"
Sep 05 06:27:44.856204 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:44.856108    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e6e30ace-ad3e-48df-a76f-826f347a3a2b-ca-trust-extracted\") pod \"image-registry-56b9678bf9-7cgmx\" (UID: \"e6e30ace-ad3e-48df-a76f-826f347a3a2b\") " pod="openshift-image-registry/image-registry-56b9678bf9-7cgmx"
Sep 05 06:27:44.856599 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:44.856575    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e6e30ace-ad3e-48df-a76f-826f347a3a2b-trusted-ca\") pod \"image-registry-56b9678bf9-7cgmx\" (UID: \"e6e30ace-ad3e-48df-a76f-826f347a3a2b\") " pod="openshift-image-registry/image-registry-56b9678bf9-7cgmx"
Sep 05 06:27:44.856708 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:44.856575    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e6e30ace-ad3e-48df-a76f-826f347a3a2b-registry-certificates\") pod \"image-registry-56b9678bf9-7cgmx\" (UID: \"e6e30ace-ad3e-48df-a76f-826f347a3a2b\") " pod="openshift-image-registry/image-registry-56b9678bf9-7cgmx"
Sep 05 06:27:44.858648 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:44.858625    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e6e30ace-ad3e-48df-a76f-826f347a3a2b-installation-pull-secrets\") pod \"image-registry-56b9678bf9-7cgmx\" (UID: \"e6e30ace-ad3e-48df-a76f-826f347a3a2b\") " pod="openshift-image-registry/image-registry-56b9678bf9-7cgmx"
Sep 05 06:27:44.858758 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:44.858722    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6e30ace-ad3e-48df-a76f-826f347a3a2b-registry-tls\") pod \"image-registry-56b9678bf9-7cgmx\" (UID: \"e6e30ace-ad3e-48df-a76f-826f347a3a2b\") " pod="openshift-image-registry/image-registry-56b9678bf9-7cgmx"
Sep 05 06:27:44.858758 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:44.858740    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e6e30ace-ad3e-48df-a76f-826f347a3a2b-image-registry-private-configuration\") pod \"image-registry-56b9678bf9-7cgmx\" (UID: \"e6e30ace-ad3e-48df-a76f-826f347a3a2b\") " pod="openshift-image-registry/image-registry-56b9678bf9-7cgmx"
Sep 05 06:27:44.864757 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:44.864703    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6e30ace-ad3e-48df-a76f-826f347a3a2b-bound-sa-token\") pod \"image-registry-56b9678bf9-7cgmx\" (UID: \"e6e30ace-ad3e-48df-a76f-826f347a3a2b\") " pod="openshift-image-registry/image-registry-56b9678bf9-7cgmx"
Sep 05 06:27:44.864891 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:44.864801    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs29t\" (UniqueName: \"kubernetes.io/projected/e6e30ace-ad3e-48df-a76f-826f347a3a2b-kube-api-access-gs29t\") pod \"image-registry-56b9678bf9-7cgmx\" (UID: \"e6e30ace-ad3e-48df-a76f-826f347a3a2b\") " pod="openshift-image-registry/image-registry-56b9678bf9-7cgmx"
Sep 05 06:27:45.060107 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:45.059991    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56b9678bf9-7cgmx"
Sep 05 06:27:45.134542 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:45.134509    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sdsjs" event={"ID":"b63a35b8-5230-4b6a-8237-e7afcaf6182e","Type":"ContainerStarted","Data":"4f1f46fe369bc7e9099969e1a6b9304ac8a7435b329275117edbacf13a59cb87"}
Sep 05 06:27:45.336019 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:45.335894    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56b9678bf9-7cgmx"]
Sep 05 06:27:45.338447 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:27:45.338409    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6e30ace_ad3e_48df_a76f_826f347a3a2b.slice/crio-3dad26eff875f10432b1533845aec578cb4419480bac5ebb98a399a894c40449 WatchSource:0}: Error finding container 3dad26eff875f10432b1533845aec578cb4419480bac5ebb98a399a894c40449: Status 404 returned error can't find the container with id 3dad26eff875f10432b1533845aec578cb4419480bac5ebb98a399a894c40449
Sep 05 06:27:46.139749 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:46.139720    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sdsjs" event={"ID":"b63a35b8-5230-4b6a-8237-e7afcaf6182e","Type":"ContainerStarted","Data":"8bc6f6218d99ecd6857cb80a741461b1794f0de6668df4e81b49a04d705f185a"}
Sep 05 06:27:46.141407 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:46.141368    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56b9678bf9-7cgmx" event={"ID":"e6e30ace-ad3e-48df-a76f-826f347a3a2b","Type":"ContainerStarted","Data":"799377086a4cb096d032c8e3570e0c86a80b9526223f28c6fb328437d2d530bb"}
Sep 05 06:27:46.141518 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:46.141419    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56b9678bf9-7cgmx" event={"ID":"e6e30ace-ad3e-48df-a76f-826f347a3a2b","Type":"ContainerStarted","Data":"3dad26eff875f10432b1533845aec578cb4419480bac5ebb98a399a894c40449"}
Sep 05 06:27:46.141518 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:46.141502    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-56b9678bf9-7cgmx"
Sep 05 06:27:47.150722 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:47.150676    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sdsjs" event={"ID":"b63a35b8-5230-4b6a-8237-e7afcaf6182e","Type":"ContainerStarted","Data":"ae14ca0fd5b843379c70d584af0fc40f13ca642aaa8b147a7e0fdca66d433ad7"}
Sep 05 06:27:47.167501 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:47.167439    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-sdsjs" podStartSLOduration=130.998580923 podStartE2EDuration="2m12.167418363s" totalImagesPullingTime="1.16883744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:25:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:27:47.167159123 +0000 UTC m=+133.140913791" watchObservedRunningTime="2026-09-05 06:27:47.167418363 +0000 UTC m=+133.141173033"
Sep 05 06:27:47.168235 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:47.168204    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-56b9678bf9-7cgmx" podStartSLOduration=3.168190736 podStartE2EDuration="3.168190736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:27:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:27:46.171764334 +0000 UTC m=+132.145519012" watchObservedRunningTime="2026-09-05 06:27:47.168190736 +0000 UTC m=+133.141945411"
Sep 05 06:27:52.434473 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.434426    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-fl7v2"]
Sep 05 06:27:52.470903 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.470870    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-fl7v2"]
Sep 05 06:27:52.471104 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.470929    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fl7v2"
Sep 05 06:27:52.476851 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.476819    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 05 06:27:52.478725 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.478175    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 05 06:27:52.478725 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.478178    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 05 06:27:52.478725 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.478212    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 05 06:27:52.478725 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.478469    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-r7lw7\""
Sep 05 06:27:52.478936 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.478785    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 05 06:27:52.509875 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.509844    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zzm9b"]
Sep 05 06:27:52.510862 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.510835    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6ccb90c-ddd5-4d93-97ea-39d417b1ba57-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-fl7v2\" (UID: \"a6ccb90c-ddd5-4d93-97ea-39d417b1ba57\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fl7v2"
Sep 05 06:27:52.511020 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.510903    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6ccb90c-ddd5-4d93-97ea-39d417b1ba57-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-fl7v2\" (UID: \"a6ccb90c-ddd5-4d93-97ea-39d417b1ba57\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fl7v2"
Sep 05 06:27:52.511020 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.511004    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a6ccb90c-ddd5-4d93-97ea-39d417b1ba57-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-fl7v2\" (UID: \"a6ccb90c-ddd5-4d93-97ea-39d417b1ba57\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fl7v2"
Sep 05 06:27:52.511136 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.511061    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl56g\" (UniqueName: \"kubernetes.io/projected/a6ccb90c-ddd5-4d93-97ea-39d417b1ba57-kube-api-access-hl56g\") pod \"openshift-state-metrics-657fd6c54-fl7v2\" (UID: \"a6ccb90c-ddd5-4d93-97ea-39d417b1ba57\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fl7v2"
Sep 05 06:27:52.533773 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.533743    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zzm9b"
Sep 05 06:27:52.537070 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.537038    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 05 06:27:52.537205 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.537096    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sgg5g\""
Sep 05 06:27:52.537269 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.537230    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 05 06:27:52.537446 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.537434    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 05 06:27:52.611862 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.611819    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz4s7\" (UniqueName: \"kubernetes.io/projected/f14b04b2-7405-41e1-9dc4-121f01eaa540-kube-api-access-qz4s7\") pod \"node-exporter-zzm9b\" (UID: \"f14b04b2-7405-41e1-9dc4-121f01eaa540\") " pod="openshift-monitoring/node-exporter-zzm9b"
Sep 05 06:27:52.611862 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.611868    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f14b04b2-7405-41e1-9dc4-121f01eaa540-node-exporter-accelerators-collector-config\") pod \"node-exporter-zzm9b\" (UID: \"f14b04b2-7405-41e1-9dc4-121f01eaa540\") " pod="openshift-monitoring/node-exporter-zzm9b"
Sep 05 06:27:52.612112 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.611923    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f14b04b2-7405-41e1-9dc4-121f01eaa540-node-exporter-textfile\") pod \"node-exporter-zzm9b\" (UID: \"f14b04b2-7405-41e1-9dc4-121f01eaa540\") " pod="openshift-monitoring/node-exporter-zzm9b"
Sep 05 06:27:52.612112 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.611971    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a6ccb90c-ddd5-4d93-97ea-39d417b1ba57-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-fl7v2\" (UID: \"a6ccb90c-ddd5-4d93-97ea-39d417b1ba57\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fl7v2"
Sep 05 06:27:52.612112 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.611995    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f14b04b2-7405-41e1-9dc4-121f01eaa540-node-exporter-wtmp\") pod \"node-exporter-zzm9b\" (UID: \"f14b04b2-7405-41e1-9dc4-121f01eaa540\") " pod="openshift-monitoring/node-exporter-zzm9b"
Sep 05 06:27:52.612112 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.612018    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f14b04b2-7405-41e1-9dc4-121f01eaa540-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zzm9b\" (UID: \"f14b04b2-7405-41e1-9dc4-121f01eaa540\") " pod="openshift-monitoring/node-exporter-zzm9b"
Sep 05 06:27:52.612112 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.612071    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl56g\" (UniqueName: \"kubernetes.io/projected/a6ccb90c-ddd5-4d93-97ea-39d417b1ba57-kube-api-access-hl56g\") pod \"openshift-state-metrics-657fd6c54-fl7v2\" (UID: \"a6ccb90c-ddd5-4d93-97ea-39d417b1ba57\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fl7v2"
Sep 05 06:27:52.612351 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.612128    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f14b04b2-7405-41e1-9dc4-121f01eaa540-node-exporter-tls\") pod \"node-exporter-zzm9b\" (UID: \"f14b04b2-7405-41e1-9dc4-121f01eaa540\") " pod="openshift-monitoring/node-exporter-zzm9b"
Sep 05 06:27:52.612351 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.612155    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6ccb90c-ddd5-4d93-97ea-39d417b1ba57-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-fl7v2\" (UID: \"a6ccb90c-ddd5-4d93-97ea-39d417b1ba57\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fl7v2"
Sep 05 06:27:52.612351 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.612181    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f14b04b2-7405-41e1-9dc4-121f01eaa540-sys\") pod \"node-exporter-zzm9b\" (UID: \"f14b04b2-7405-41e1-9dc4-121f01eaa540\") " pod="openshift-monitoring/node-exporter-zzm9b"
Sep 05 06:27:52.612351 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.612219    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f14b04b2-7405-41e1-9dc4-121f01eaa540-metrics-client-ca\") pod \"node-exporter-zzm9b\" (UID: \"f14b04b2-7405-41e1-9dc4-121f01eaa540\") " pod="openshift-monitoring/node-exporter-zzm9b"
Sep 05 06:27:52.612351 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.612239    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6ccb90c-ddd5-4d93-97ea-39d417b1ba57-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-fl7v2\" (UID: \"a6ccb90c-ddd5-4d93-97ea-39d417b1ba57\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fl7v2"
Sep 05 06:27:52.612351 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.612265    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f14b04b2-7405-41e1-9dc4-121f01eaa540-root\") pod \"node-exporter-zzm9b\" (UID: \"f14b04b2-7405-41e1-9dc4-121f01eaa540\") " pod="openshift-monitoring/node-exporter-zzm9b"
Sep 05 06:27:52.612878 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.612845    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6ccb90c-ddd5-4d93-97ea-39d417b1ba57-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-fl7v2\" (UID: \"a6ccb90c-ddd5-4d93-97ea-39d417b1ba57\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fl7v2"
Sep 05 06:27:52.614674 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.614655    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a6ccb90c-ddd5-4d93-97ea-39d417b1ba57-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-fl7v2\" (UID: \"a6ccb90c-ddd5-4d93-97ea-39d417b1ba57\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fl7v2"
Sep 05 06:27:52.614897 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.614877    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6ccb90c-ddd5-4d93-97ea-39d417b1ba57-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-fl7v2\" (UID: \"a6ccb90c-ddd5-4d93-97ea-39d417b1ba57\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fl7v2"
Sep 05 06:27:52.622179 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.622151    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl56g\" (UniqueName: \"kubernetes.io/projected/a6ccb90c-ddd5-4d93-97ea-39d417b1ba57-kube-api-access-hl56g\") pod \"openshift-state-metrics-657fd6c54-fl7v2\" (UID: \"a6ccb90c-ddd5-4d93-97ea-39d417b1ba57\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fl7v2"
Sep 05 06:27:52.713020 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.712977    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f14b04b2-7405-41e1-9dc4-121f01eaa540-node-exporter-accelerators-collector-config\") pod \"node-exporter-zzm9b\" (UID: \"f14b04b2-7405-41e1-9dc4-121f01eaa540\") " pod="openshift-monitoring/node-exporter-zzm9b"
Sep 05 06:27:52.713228 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.713061    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f14b04b2-7405-41e1-9dc4-121f01eaa540-node-exporter-textfile\") pod \"node-exporter-zzm9b\" (UID: \"f14b04b2-7405-41e1-9dc4-121f01eaa540\") " pod="openshift-monitoring/node-exporter-zzm9b"
Sep 05 06:27:52.713228 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.713096    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f14b04b2-7405-41e1-9dc4-121f01eaa540-node-exporter-wtmp\") pod \"node-exporter-zzm9b\" (UID: \"f14b04b2-7405-41e1-9dc4-121f01eaa540\") " pod="openshift-monitoring/node-exporter-zzm9b"
Sep 05 06:27:52.713228 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.713118    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f14b04b2-7405-41e1-9dc4-121f01eaa540-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zzm9b\" (UID: \"f14b04b2-7405-41e1-9dc4-121f01eaa540\") " pod="openshift-monitoring/node-exporter-zzm9b"
Sep 05 06:27:52.713228 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.713168    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f14b04b2-7405-41e1-9dc4-121f01eaa540-node-exporter-tls\") pod \"node-exporter-zzm9b\" (UID: \"f14b04b2-7405-41e1-9dc4-121f01eaa540\") " pod="openshift-monitoring/node-exporter-zzm9b"
Sep 05 06:27:52.713228 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.713200    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f14b04b2-7405-41e1-9dc4-121f01eaa540-sys\") pod \"node-exporter-zzm9b\" (UID: \"f14b04b2-7405-41e1-9dc4-121f01eaa540\") " pod="openshift-monitoring/node-exporter-zzm9b"
Sep 05 06:27:52.713471 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.713243    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f14b04b2-7405-41e1-9dc4-121f01eaa540-metrics-client-ca\") pod \"node-exporter-zzm9b\" (UID: \"f14b04b2-7405-41e1-9dc4-121f01eaa540\") " pod="openshift-monitoring/node-exporter-zzm9b"
Sep 05 06:27:52.713471 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.713278    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f14b04b2-7405-41e1-9dc4-121f01eaa540-root\") pod \"node-exporter-zzm9b\" (UID: \"f14b04b2-7405-41e1-9dc4-121f01eaa540\") " pod="openshift-monitoring/node-exporter-zzm9b"
Sep 05 06:27:52.713471 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.713302    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f14b04b2-7405-41e1-9dc4-121f01eaa540-node-exporter-wtmp\") pod \"node-exporter-zzm9b\" (UID: \"f14b04b2-7405-41e1-9dc4-121f01eaa540\") " pod="openshift-monitoring/node-exporter-zzm9b"
Sep 05 06:27:52.713471 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.713315    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f14b04b2-7405-41e1-9dc4-121f01eaa540-sys\") pod \"node-exporter-zzm9b\" (UID: \"f14b04b2-7405-41e1-9dc4-121f01eaa540\") " pod="openshift-monitoring/node-exporter-zzm9b"
Sep 05 06:27:52.713471 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:52.713342    2567 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 05 06:27:52.713471 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.713379    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f14b04b2-7405-41e1-9dc4-121f01eaa540-root\") pod \"node-exporter-zzm9b\" (UID: \"f14b04b2-7405-41e1-9dc4-121f01eaa540\") " pod="openshift-monitoring/node-exporter-zzm9b"
Sep 05 06:27:52.713471 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.713325    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz4s7\" (UniqueName: \"kubernetes.io/projected/f14b04b2-7405-41e1-9dc4-121f01eaa540-kube-api-access-qz4s7\") pod \"node-exporter-zzm9b\" (UID: \"f14b04b2-7405-41e1-9dc4-121f01eaa540\") " pod="openshift-monitoring/node-exporter-zzm9b"
Sep 05 06:27:52.713471 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:27:52.713415    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f14b04b2-7405-41e1-9dc4-121f01eaa540-node-exporter-tls podName:f14b04b2-7405-41e1-9dc4-121f01eaa540 nodeName:}" failed. No retries permitted until 2026-09-05 06:27:53.213393844 +0000 UTC m=+139.187148501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f14b04b2-7405-41e1-9dc4-121f01eaa540-node-exporter-tls") pod "node-exporter-zzm9b" (UID: "f14b04b2-7405-41e1-9dc4-121f01eaa540") : secret "node-exporter-tls" not found
Sep 05 06:27:52.713897 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.713506    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f14b04b2-7405-41e1-9dc4-121f01eaa540-node-exporter-textfile\") pod \"node-exporter-zzm9b\" (UID: \"f14b04b2-7405-41e1-9dc4-121f01eaa540\") " pod="openshift-monitoring/node-exporter-zzm9b"
Sep 05 06:27:52.713897 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.713762    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f14b04b2-7405-41e1-9dc4-121f01eaa540-node-exporter-accelerators-collector-config\") pod \"node-exporter-zzm9b\" (UID: \"f14b04b2-7405-41e1-9dc4-121f01eaa540\") " pod="openshift-monitoring/node-exporter-zzm9b"
Sep 05 06:27:52.713897 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.713891    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f14b04b2-7405-41e1-9dc4-121f01eaa540-metrics-client-ca\") pod \"node-exporter-zzm9b\" (UID: \"f14b04b2-7405-41e1-9dc4-121f01eaa540\") " pod="openshift-monitoring/node-exporter-zzm9b"
Sep 05 06:27:52.715689 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.715672    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f14b04b2-7405-41e1-9dc4-121f01eaa540-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zzm9b\" (UID: \"f14b04b2-7405-41e1-9dc4-121f01eaa540\") " pod="openshift-monitoring/node-exporter-zzm9b"
Sep 05 06:27:52.722457 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.722430    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz4s7\" (UniqueName: \"kubernetes.io/projected/f14b04b2-7405-41e1-9dc4-121f01eaa540-kube-api-access-qz4s7\") pod \"node-exporter-zzm9b\" (UID: \"f14b04b2-7405-41e1-9dc4-121f01eaa540\") " pod="openshift-monitoring/node-exporter-zzm9b"
Sep 05 06:27:52.781057 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:52.781014    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fl7v2"
Sep 05 06:27:53.082428 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:53.082196    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-fl7v2"]
Sep 05 06:27:53.085003 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:27:53.084974    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6ccb90c_ddd5_4d93_97ea_39d417b1ba57.slice/crio-46c904efbd4d3f7e1a28b2817a3354b0f097175c0b4c12d7524036f38368fa9d WatchSource:0}: Error finding container 46c904efbd4d3f7e1a28b2817a3354b0f097175c0b4c12d7524036f38368fa9d: Status 404 returned error can't find the container with id 46c904efbd4d3f7e1a28b2817a3354b0f097175c0b4c12d7524036f38368fa9d
Sep 05 06:27:53.173715 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:53.173684    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fl7v2" event={"ID":"a6ccb90c-ddd5-4d93-97ea-39d417b1ba57","Type":"ContainerStarted","Data":"3cdb2b71a8d56610177af80eec5a3224d5242f70230fd72543afae291342bf58"}
Sep 05 06:27:53.173898 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:53.173739    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fl7v2" event={"ID":"a6ccb90c-ddd5-4d93-97ea-39d417b1ba57","Type":"ContainerStarted","Data":"46c904efbd4d3f7e1a28b2817a3354b0f097175c0b4c12d7524036f38368fa9d"}
Sep 05 06:27:53.218448 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:53.218421    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f14b04b2-7405-41e1-9dc4-121f01eaa540-node-exporter-tls\") pod \"node-exporter-zzm9b\" (UID: \"f14b04b2-7405-41e1-9dc4-121f01eaa540\") " pod="openshift-monitoring/node-exporter-zzm9b"
Sep 05 06:27:53.221197 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:53.221165    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f14b04b2-7405-41e1-9dc4-121f01eaa540-node-exporter-tls\") pod \"node-exporter-zzm9b\" (UID: \"f14b04b2-7405-41e1-9dc4-121f01eaa540\") " pod="openshift-monitoring/node-exporter-zzm9b"
Sep 05 06:27:53.443499 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:53.443394    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zzm9b"
Sep 05 06:27:53.454967 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:27:53.454933    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf14b04b2_7405_41e1_9dc4_121f01eaa540.slice/crio-368fb06c8c30fa11f36cdc70bd499028b3eeee4a0a2bcb3e5ad4a07673aba100 WatchSource:0}: Error finding container 368fb06c8c30fa11f36cdc70bd499028b3eeee4a0a2bcb3e5ad4a07673aba100: Status 404 returned error can't find the container with id 368fb06c8c30fa11f36cdc70bd499028b3eeee4a0a2bcb3e5ad4a07673aba100
Sep 05 06:27:54.179520 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:54.179481    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zzm9b" event={"ID":"f14b04b2-7405-41e1-9dc4-121f01eaa540","Type":"ContainerStarted","Data":"368fb06c8c30fa11f36cdc70bd499028b3eeee4a0a2bcb3e5ad4a07673aba100"}
Sep 05 06:27:54.181600 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:54.181571    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fl7v2" event={"ID":"a6ccb90c-ddd5-4d93-97ea-39d417b1ba57","Type":"ContainerStarted","Data":"9ac9d0f23f3a28c3e6fb9dd67c6d3d3b68593752764c6e03ef798ee7bc6113a6"}
Sep 05 06:27:54.711779 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:54.711752    2567 patch_prober.go:28] interesting pod/image-registry-7ff756899b-tg2xn container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 05 06:27:54.712103 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:54.711807    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7ff756899b-tg2xn" podUID="b5cb46b5-67ef-465d-b925-0edfdd986903" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 05 06:27:55.187313 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:55.187205    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fl7v2" event={"ID":"a6ccb90c-ddd5-4d93-97ea-39d417b1ba57","Type":"ContainerStarted","Data":"4f8af9614b52a2adc73ab852df4432fef8bd41a27c3573ff62c46a3320740722"}
Sep 05 06:27:55.188813 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:55.188788    2567 generic.go:356] "Generic (PLEG): container finished" podID="f14b04b2-7405-41e1-9dc4-121f01eaa540" containerID="4b1835b7b85aafc7052ee10db898e89d28d3b383285fcc56414655366c89a49c" exitCode=0
Sep 05 06:27:55.188919 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:55.188847    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zzm9b" event={"ID":"f14b04b2-7405-41e1-9dc4-121f01eaa540","Type":"ContainerDied","Data":"4b1835b7b85aafc7052ee10db898e89d28d3b383285fcc56414655366c89a49c"}
Sep 05 06:27:55.209517 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:55.209465    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fl7v2" podStartSLOduration=1.720721063 podStartE2EDuration="3.209447045s" totalImagesPullingTime="1.488725982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:27:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:27:55.207670461 +0000 UTC m=+141.181425137" watchObservedRunningTime="2026-09-05 06:27:55.209447045 +0000 UTC m=+141.183201720"
Sep 05 06:27:56.195423 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:56.195388    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zzm9b" event={"ID":"f14b04b2-7405-41e1-9dc4-121f01eaa540","Type":"ContainerStarted","Data":"fffdeb6dbb9f4937eda9ced00639fd46185fcf22d7655151091652935b72a931"}
Sep 05 06:27:56.195811 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:56.195446    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zzm9b" event={"ID":"f14b04b2-7405-41e1-9dc4-121f01eaa540","Type":"ContainerStarted","Data":"768a01ff6d2358f70e836dd8779ff8a4066703637797e2f257c60495a9b43a3a"}
Sep 05 06:27:56.218971 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:56.218921    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zzm9b" podStartSLOduration=2.897390182 podStartE2EDuration="4.218902216s" totalImagesPullingTime="1.243014437s" totalInitContainerRuntime="78.497597ms" isStatefulPod=true podCreationTimestamp="2026-09-05 06:27:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:27:56.217246773 +0000 UTC m=+142.191001447" watchObservedRunningTime="2026-09-05 06:27:56.218902216 +0000 UTC m=+142.192656891"
Sep 05 06:27:56.836742 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:56.836707    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-76d584df7-sp8xc"]
Sep 05 06:27:56.839933 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:56.839908    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-76d584df7-sp8xc"
Sep 05 06:27:56.843923 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:56.843881    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-83s6dsugvc63\""
Sep 05 06:27:56.843923 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:56.843912    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 05 06:27:56.844175 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:56.843915    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 05 06:27:56.844175 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:56.843957    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 05 06:27:56.844175 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:56.844019    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-65h5r\""
Sep 05 06:27:56.844175 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:56.843883    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 05 06:27:56.850054 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:56.850005    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-76d584df7-sp8xc"]
Sep 05 06:27:56.951655 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:56.951613    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0957d224-5722-434b-875e-08cddf2a9179-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-76d584df7-sp8xc\" (UID: \"0957d224-5722-434b-875e-08cddf2a9179\") " pod="openshift-monitoring/metrics-server-76d584df7-sp8xc"
Sep 05 06:27:56.951655 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:56.951662    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0957d224-5722-434b-875e-08cddf2a9179-client-ca-bundle\") pod \"metrics-server-76d584df7-sp8xc\" (UID: \"0957d224-5722-434b-875e-08cddf2a9179\") " pod="openshift-monitoring/metrics-server-76d584df7-sp8xc"
Sep 05 06:27:56.951899 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:56.951700    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0957d224-5722-434b-875e-08cddf2a9179-audit-log\") pod \"metrics-server-76d584df7-sp8xc\" (UID: \"0957d224-5722-434b-875e-08cddf2a9179\") " pod="openshift-monitoring/metrics-server-76d584df7-sp8xc"
Sep 05 06:27:56.951899 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:56.951718    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0957d224-5722-434b-875e-08cddf2a9179-metrics-server-audit-profiles\") pod \"metrics-server-76d584df7-sp8xc\" (UID: \"0957d224-5722-434b-875e-08cddf2a9179\") " pod="openshift-monitoring/metrics-server-76d584df7-sp8xc"
Sep 05 06:27:56.951899 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:56.951782    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljp2w\" (UniqueName: \"kubernetes.io/projected/0957d224-5722-434b-875e-08cddf2a9179-kube-api-access-ljp2w\") pod \"metrics-server-76d584df7-sp8xc\" (UID: \"0957d224-5722-434b-875e-08cddf2a9179\") " pod="openshift-monitoring/metrics-server-76d584df7-sp8xc"
Sep 05 06:27:56.951899 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:56.951807    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0957d224-5722-434b-875e-08cddf2a9179-secret-metrics-server-tls\") pod \"metrics-server-76d584df7-sp8xc\" (UID: \"0957d224-5722-434b-875e-08cddf2a9179\") " pod="openshift-monitoring/metrics-server-76d584df7-sp8xc"
Sep 05 06:27:56.951899 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:56.951849    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0957d224-5722-434b-875e-08cddf2a9179-secret-metrics-server-client-certs\") pod \"metrics-server-76d584df7-sp8xc\" (UID: \"0957d224-5722-434b-875e-08cddf2a9179\") " pod="openshift-monitoring/metrics-server-76d584df7-sp8xc"
Sep 05 06:27:57.052168 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:57.052126    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0957d224-5722-434b-875e-08cddf2a9179-client-ca-bundle\") pod \"metrics-server-76d584df7-sp8xc\" (UID: \"0957d224-5722-434b-875e-08cddf2a9179\") " pod="openshift-monitoring/metrics-server-76d584df7-sp8xc"
Sep 05 06:27:57.052168 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:57.052179    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0957d224-5722-434b-875e-08cddf2a9179-audit-log\") pod \"metrics-server-76d584df7-sp8xc\" (UID: \"0957d224-5722-434b-875e-08cddf2a9179\") " pod="openshift-monitoring/metrics-server-76d584df7-sp8xc"
Sep 05 06:27:57.052358 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:57.052198    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0957d224-5722-434b-875e-08cddf2a9179-metrics-server-audit-profiles\") pod \"metrics-server-76d584df7-sp8xc\" (UID: \"0957d224-5722-434b-875e-08cddf2a9179\") " pod="openshift-monitoring/metrics-server-76d584df7-sp8xc"
Sep 05 06:27:57.052358 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:57.052240    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljp2w\" (UniqueName: \"kubernetes.io/projected/0957d224-5722-434b-875e-08cddf2a9179-kube-api-access-ljp2w\") pod \"metrics-server-76d584df7-sp8xc\" (UID: \"0957d224-5722-434b-875e-08cddf2a9179\") " pod="openshift-monitoring/metrics-server-76d584df7-sp8xc"
Sep 05 06:27:57.052358 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:57.052268    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0957d224-5722-434b-875e-08cddf2a9179-secret-metrics-server-tls\") pod \"metrics-server-76d584df7-sp8xc\" (UID: \"0957d224-5722-434b-875e-08cddf2a9179\") " pod="openshift-monitoring/metrics-server-76d584df7-sp8xc"
Sep 05 06:27:57.052358 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:57.052313    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0957d224-5722-434b-875e-08cddf2a9179-secret-metrics-server-client-certs\") pod \"metrics-server-76d584df7-sp8xc\" (UID: \"0957d224-5722-434b-875e-08cddf2a9179\") " pod="openshift-monitoring/metrics-server-76d584df7-sp8xc"
Sep 05 06:27:57.052522 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:57.052362    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0957d224-5722-434b-875e-08cddf2a9179-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-76d584df7-sp8xc\" (UID: \"0957d224-5722-434b-875e-08cddf2a9179\") " pod="openshift-monitoring/metrics-server-76d584df7-sp8xc"
Sep 05 06:27:57.052675 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:57.052653    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0957d224-5722-434b-875e-08cddf2a9179-audit-log\") pod \"metrics-server-76d584df7-sp8xc\" (UID: \"0957d224-5722-434b-875e-08cddf2a9179\") " pod="openshift-monitoring/metrics-server-76d584df7-sp8xc"
Sep 05 06:27:57.053302 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:57.053268    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0957d224-5722-434b-875e-08cddf2a9179-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-76d584df7-sp8xc\" (UID: \"0957d224-5722-434b-875e-08cddf2a9179\") " pod="openshift-monitoring/metrics-server-76d584df7-sp8xc"
Sep 05 06:27:57.053416 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:57.053338    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0957d224-5722-434b-875e-08cddf2a9179-metrics-server-audit-profiles\") pod \"metrics-server-76d584df7-sp8xc\" (UID: \"0957d224-5722-434b-875e-08cddf2a9179\") " pod="openshift-monitoring/metrics-server-76d584df7-sp8xc"
Sep 05 06:27:57.055107 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:57.055081    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0957d224-5722-434b-875e-08cddf2a9179-secret-metrics-server-tls\") pod \"metrics-server-76d584df7-sp8xc\" (UID: \"0957d224-5722-434b-875e-08cddf2a9179\") " pod="openshift-monitoring/metrics-server-76d584df7-sp8xc"
Sep 05 06:27:57.055288 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:57.055270    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0957d224-5722-434b-875e-08cddf2a9179-secret-metrics-server-client-certs\") pod \"metrics-server-76d584df7-sp8xc\" (UID: \"0957d224-5722-434b-875e-08cddf2a9179\") " pod="openshift-monitoring/metrics-server-76d584df7-sp8xc"
Sep 05 06:27:57.055288 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:57.055276    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0957d224-5722-434b-875e-08cddf2a9179-client-ca-bundle\") pod \"metrics-server-76d584df7-sp8xc\" (UID: \"0957d224-5722-434b-875e-08cddf2a9179\") " pod="openshift-monitoring/metrics-server-76d584df7-sp8xc"
Sep 05 06:27:57.064084 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:57.064022    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljp2w\" (UniqueName: \"kubernetes.io/projected/0957d224-5722-434b-875e-08cddf2a9179-kube-api-access-ljp2w\") pod \"metrics-server-76d584df7-sp8xc\" (UID: \"0957d224-5722-434b-875e-08cddf2a9179\") " pod="openshift-monitoring/metrics-server-76d584df7-sp8xc"
Sep 05 06:27:57.150250 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:57.150168    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-76d584df7-sp8xc"
Sep 05 06:27:57.217047 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:57.216973    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-9sk9w"]
Sep 05 06:27:57.225371 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:57.225341    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9sk9w"
Sep 05 06:27:57.228805 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:57.228742    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-svrrg\""
Sep 05 06:27:57.228805 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:57.228759    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 05 06:27:57.234752 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:57.234722    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-9sk9w"]
Sep 05 06:27:57.254315 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:57.254277    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf5xz\" (UniqueName: \"kubernetes.io/projected/40d15e42-0673-4995-9bf3-442f64a656b2-kube-api-access-nf5xz\") pod \"monitoring-plugin-85bbbbbf4-9sk9w\" (UID: \"40d15e42-0673-4995-9bf3-442f64a656b2\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9sk9w"
Sep 05 06:27:57.254520 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:57.254395    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/40d15e42-0673-4995-9bf3-442f64a656b2-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-9sk9w\" (UID: \"40d15e42-0673-4995-9bf3-442f64a656b2\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9sk9w"
Sep 05 06:27:57.355761 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:57.355707    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf5xz\" (UniqueName: \"kubernetes.io/projected/40d15e42-0673-4995-9bf3-442f64a656b2-kube-api-access-nf5xz\") pod \"monitoring-plugin-85bbbbbf4-9sk9w\" (UID: \"40d15e42-0673-4995-9bf3-442f64a656b2\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9sk9w"
Sep 05 06:27:57.355937 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:57.355811    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/40d15e42-0673-4995-9bf3-442f64a656b2-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-9sk9w\" (UID: \"40d15e42-0673-4995-9bf3-442f64a656b2\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9sk9w"
Sep 05 06:27:57.358480 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:57.358455    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/40d15e42-0673-4995-9bf3-442f64a656b2-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-9sk9w\" (UID: \"40d15e42-0673-4995-9bf3-442f64a656b2\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9sk9w"
Sep 05 06:27:57.369281 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:57.369252    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf5xz\" (UniqueName: \"kubernetes.io/projected/40d15e42-0673-4995-9bf3-442f64a656b2-kube-api-access-nf5xz\") pod \"monitoring-plugin-85bbbbbf4-9sk9w\" (UID: \"40d15e42-0673-4995-9bf3-442f64a656b2\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9sk9w"
Sep 05 06:27:57.429533 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:57.429508    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-76d584df7-sp8xc"]
Sep 05 06:27:57.432021 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:27:57.431985    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0957d224_5722_434b_875e_08cddf2a9179.slice/crio-5ca5a6ae8f92f0df8346a305ee1e08ac3bada758aefd61c71a1b7d407d929f27 WatchSource:0}: Error finding container 5ca5a6ae8f92f0df8346a305ee1e08ac3bada758aefd61c71a1b7d407d929f27: Status 404 returned error can't find the container with id 5ca5a6ae8f92f0df8346a305ee1e08ac3bada758aefd61c71a1b7d407d929f27
Sep 05 06:27:57.537380 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:57.537338    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9sk9w"
Sep 05 06:27:57.810990 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:57.810966    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-9sk9w"]
Sep 05 06:27:57.813219 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:27:57.813194    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40d15e42_0673_4995_9bf3_442f64a656b2.slice/crio-e10011df9ce4f74b9aa5fbd7756cf1de90b24f30e10b71dfdc64f054a5fd5e1d WatchSource:0}: Error finding container e10011df9ce4f74b9aa5fbd7756cf1de90b24f30e10b71dfdc64f054a5fd5e1d: Status 404 returned error can't find the container with id e10011df9ce4f74b9aa5fbd7756cf1de90b24f30e10b71dfdc64f054a5fd5e1d
Sep 05 06:27:58.206571 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.206528    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9sk9w" event={"ID":"40d15e42-0673-4995-9bf3-442f64a656b2","Type":"ContainerStarted","Data":"e10011df9ce4f74b9aa5fbd7756cf1de90b24f30e10b71dfdc64f054a5fd5e1d"}
Sep 05 06:27:58.207910 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.207881    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-76d584df7-sp8xc" event={"ID":"0957d224-5722-434b-875e-08cddf2a9179","Type":"ContainerStarted","Data":"5ca5a6ae8f92f0df8346a305ee1e08ac3bada758aefd61c71a1b7d407d929f27"}
Sep 05 06:27:58.664831 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.664737    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 05 06:27:58.669550 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.669520    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.673464 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.673179    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 05 06:27:58.673464 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.673304    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 05 06:27:58.673464 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.673349    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 05 06:27:58.673464 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.673302    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 05 06:27:58.673781 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.673505    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-n6qx9\""
Sep 05 06:27:58.673929 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.673911    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 05 06:27:58.674333 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.674305    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 05 06:27:58.674431 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.674358    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 05 06:27:58.674700 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.674683    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bhmh8a7j0jcst\""
Sep 05 06:27:58.674792 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.674703    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 05 06:27:58.674864 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.674840    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 05 06:27:58.675118 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.675089    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 05 06:27:58.675294 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.675278    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 05 06:27:58.675635 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.675616    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 05 06:27:58.677585 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.677550    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 05 06:27:58.681302 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.681273    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 05 06:27:58.686880 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.686529    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 05 06:27:58.767741 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.767701    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.767941 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.767749    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.767941 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.767818    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t8w7\" (UniqueName: \"kubernetes.io/projected/56fdcafb-d954-424b-b1e8-d6f54197e44a-kube-api-access-5t8w7\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.767941 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.767884    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.768154 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.767939    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.768154 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.767977    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.768154 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.768014    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.768154 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.768105    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.768154 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.768137    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-web-config\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.768325 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.768177    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.768325 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.768208    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-config\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.768325 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.768227    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.768325 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.768277    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/56fdcafb-d954-424b-b1e8-d6f54197e44a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.768325 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.768308    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.768510 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.768340    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.768510 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.768369    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.768510 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.768419    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/56fdcafb-d954-424b-b1e8-d6f54197e44a-config-out\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.768510 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.768482    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/56fdcafb-d954-424b-b1e8-d6f54197e44a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.768510 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.768502    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.768701 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.768528    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.869174 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.869133    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/56fdcafb-d954-424b-b1e8-d6f54197e44a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.869174 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.869179    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.869420 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.869201    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.869420 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.869220    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.869420 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.869243    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.869420 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.869272    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t8w7\" (UniqueName: \"kubernetes.io/projected/56fdcafb-d954-424b-b1e8-d6f54197e44a-kube-api-access-5t8w7\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.869420 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.869311    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.869420 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.869355    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.869420 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.869381    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.869420 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.869402    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.869778 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.869457    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.869778 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.869481    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-web-config\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.869778 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.869517    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.869778 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.869547    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-config\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.869778 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.869574    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.869778 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.869593    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/56fdcafb-d954-424b-b1e8-d6f54197e44a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.869778 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.869608    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/56fdcafb-d954-424b-b1e8-d6f54197e44a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.869778 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.869650    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.869778 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.869680    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.869778 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.869710    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.869778 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.869738    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/56fdcafb-d954-424b-b1e8-d6f54197e44a-config-out\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.870504 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.870148    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.870504 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.870248    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.870504 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.870276    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.871293 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.870775    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.871293 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.871255    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.873224 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.873014    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.873753 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.873708    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.873905 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.873880    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.873984 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.873962    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/56fdcafb-d954-424b-b1e8-d6f54197e44a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.874752 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.874726    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.874895 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.874869    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.875076 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.875009    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.875259 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.875144    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/56fdcafb-d954-424b-b1e8-d6f54197e44a-config-out\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.875452 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.875411    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.877072 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.877009    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.877176 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.877086    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.877710 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.877691    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-config\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.877800 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.877761    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-web-config\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.879504 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.879482    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t8w7\" (UniqueName: \"kubernetes.io/projected/56fdcafb-d954-424b-b1e8-d6f54197e44a-kube-api-access-5t8w7\") pod \"prometheus-k8s-0\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:58.988203 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:58.988156    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:27:59.493862 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:27:59.493762    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 05 06:27:59.497419 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:27:59.497389    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56fdcafb_d954_424b_b1e8_d6f54197e44a.slice/crio-19ff516653d173be9f17f99b6d0e8c62b84c85eff90476be462b4165fcb0dcff WatchSource:0}: Error finding container 19ff516653d173be9f17f99b6d0e8c62b84c85eff90476be462b4165fcb0dcff: Status 404 returned error can't find the container with id 19ff516653d173be9f17f99b6d0e8c62b84c85eff90476be462b4165fcb0dcff
Sep 05 06:28:00.219830 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:00.219793    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9sk9w" event={"ID":"40d15e42-0673-4995-9bf3-442f64a656b2","Type":"ContainerStarted","Data":"053e81fea5912a13f67d101a4eaff92e7b8359c9976b6dd7002ffff9f9bdcba9"}
Sep 05 06:28:00.220408 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:00.220385    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9sk9w"
Sep 05 06:28:00.221869 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:00.221812    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-76d584df7-sp8xc" event={"ID":"0957d224-5722-434b-875e-08cddf2a9179","Type":"ContainerStarted","Data":"357b50e7cd54f8da06a8d38797a6ce33f45c09c8e9edf17d0ea693a7d57dacf9"}
Sep 05 06:28:00.223478 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:00.223452    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"56fdcafb-d954-424b-b1e8-d6f54197e44a","Type":"ContainerStarted","Data":"19ff516653d173be9f17f99b6d0e8c62b84c85eff90476be462b4165fcb0dcff"}
Sep 05 06:28:00.226549 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:00.226524    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9sk9w"
Sep 05 06:28:00.239536 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:00.239469    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9sk9w" podStartSLOduration=1.843453191 podStartE2EDuration="3.239453108s" totalImagesPullingTime="1.395999917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:27:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:28:00.238649097 +0000 UTC m=+146.212403773" watchObservedRunningTime="2026-09-05 06:28:00.239453108 +0000 UTC m=+146.213207783"
Sep 05 06:28:00.276433 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:00.276375    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-76d584df7-sp8xc" podStartSLOduration=2.501582647 podStartE2EDuration="4.276357306s" totalImagesPullingTime="1.774774659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:27:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:28:00.275145938 +0000 UTC m=+146.248900636" watchObservedRunningTime="2026-09-05 06:28:00.276357306 +0000 UTC m=+146.250111998"
Sep 05 06:28:01.228962 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:01.228927    2567 generic.go:356] "Generic (PLEG): container finished" podID="56fdcafb-d954-424b-b1e8-d6f54197e44a" containerID="97f9e1d48fbc20978998773905ce41630f86a2dcfda49aa4896b10f2b07d75c7" exitCode=0
Sep 05 06:28:01.229482 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:01.229016    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"56fdcafb-d954-424b-b1e8-d6f54197e44a","Type":"ContainerDied","Data":"97f9e1d48fbc20978998773905ce41630f86a2dcfda49aa4896b10f2b07d75c7"}
Sep 05 06:28:04.711625 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:04.711587    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7ff756899b-tg2xn"
Sep 05 06:28:05.065326 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:05.065241    2567 patch_prober.go:28] interesting pod/image-registry-56b9678bf9-7cgmx container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 05 06:28:05.065326 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:05.065306    2567 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-56b9678bf9-7cgmx" podUID="e6e30ace-ad3e-48df-a76f-826f347a3a2b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 05 06:28:05.250870 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:05.250832    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"56fdcafb-d954-424b-b1e8-d6f54197e44a","Type":"ContainerStarted","Data":"69a6ee811a05af895083afd6a327ce69a9baafcebf0daace978a70b3ac8cc845"}
Sep 05 06:28:05.251053 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:05.250958    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"56fdcafb-d954-424b-b1e8-d6f54197e44a","Type":"ContainerStarted","Data":"d99961ca4c117c87443883855d7436c898b30d3332d4eae95ec65e12260c8191"}
Sep 05 06:28:07.155219 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:07.155182    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-56b9678bf9-7cgmx"
Sep 05 06:28:07.265516 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:07.265478    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"56fdcafb-d954-424b-b1e8-d6f54197e44a","Type":"ContainerStarted","Data":"d0c364dd4bec56edf1fce065aaaf1ed35671a61816134b5b25723be6c3d78be6"}
Sep 05 06:28:07.265671 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:07.265563    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"56fdcafb-d954-424b-b1e8-d6f54197e44a","Type":"ContainerStarted","Data":"67f1609c9f78ed3d105dffc526e72a45d5c957fffca1bdce52659d70ef67733f"}
Sep 05 06:28:07.265671 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:07.265612    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"56fdcafb-d954-424b-b1e8-d6f54197e44a","Type":"ContainerStarted","Data":"2fbfc96818262b5d063107a8dd9bd2c2edc110672555be3f9ee4bef3bea0fbb8"}
Sep 05 06:28:07.265671 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:07.265652    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"56fdcafb-d954-424b-b1e8-d6f54197e44a","Type":"ContainerStarted","Data":"b438f10f44e333f97395a17fb5bf616e088b6cdbec98c1dae561c86f610f2076"}
Sep 05 06:28:07.299918 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:07.299860    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.542969542 podStartE2EDuration="9.299836748s" totalImagesPullingTime="5.734211224s" totalInitContainerRuntime="22.655982ms" isStatefulPod=false podCreationTimestamp="2026-09-05 06:27:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:28:07.298784612 +0000 UTC m=+153.272539288" watchObservedRunningTime="2026-09-05 06:28:07.299836748 +0000 UTC m=+153.273591423"
Sep 05 06:28:08.989147 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:08.989111    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:28:09.726847 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:09.726804    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7ff756899b-tg2xn" podUID="b5cb46b5-67ef-465d-b925-0edfdd986903" containerName="registry" containerID="cri-o://19c686072395f375fb528bbd1ff1c4c11cf37d56fbf6f130f0a790f05aac7ba2" gracePeriod=30
Sep 05 06:28:09.965320 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:09.965290    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7ff756899b-tg2xn"
Sep 05 06:28:10.081505 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:10.081412    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b5cb46b5-67ef-465d-b925-0edfdd986903-registry-tls\") pod \"b5cb46b5-67ef-465d-b925-0edfdd986903\" (UID: \"b5cb46b5-67ef-465d-b925-0edfdd986903\") "
Sep 05 06:28:10.081505 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:10.081456    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b5cb46b5-67ef-465d-b925-0edfdd986903-registry-certificates\") pod \"b5cb46b5-67ef-465d-b925-0edfdd986903\" (UID: \"b5cb46b5-67ef-465d-b925-0edfdd986903\") "
Sep 05 06:28:10.081505 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:10.081495    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b5cb46b5-67ef-465d-b925-0edfdd986903-bound-sa-token\") pod \"b5cb46b5-67ef-465d-b925-0edfdd986903\" (UID: \"b5cb46b5-67ef-465d-b925-0edfdd986903\") "
Sep 05 06:28:10.082099 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:10.081515    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b5cb46b5-67ef-465d-b925-0edfdd986903-image-registry-private-configuration\") pod \"b5cb46b5-67ef-465d-b925-0edfdd986903\" (UID: \"b5cb46b5-67ef-465d-b925-0edfdd986903\") "
Sep 05 06:28:10.082099 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:10.081561    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b5cb46b5-67ef-465d-b925-0edfdd986903-installation-pull-secrets\") pod \"b5cb46b5-67ef-465d-b925-0edfdd986903\" (UID: \"b5cb46b5-67ef-465d-b925-0edfdd986903\") "
Sep 05 06:28:10.082099 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:10.081590    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b5cb46b5-67ef-465d-b925-0edfdd986903-trusted-ca\") pod \"b5cb46b5-67ef-465d-b925-0edfdd986903\" (UID: \"b5cb46b5-67ef-465d-b925-0edfdd986903\") "
Sep 05 06:28:10.082099 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:10.081620    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78xtr\" (UniqueName: \"kubernetes.io/projected/b5cb46b5-67ef-465d-b925-0edfdd986903-kube-api-access-78xtr\") pod \"b5cb46b5-67ef-465d-b925-0edfdd986903\" (UID: \"b5cb46b5-67ef-465d-b925-0edfdd986903\") "
Sep 05 06:28:10.082099 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:10.081678    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b5cb46b5-67ef-465d-b925-0edfdd986903-ca-trust-extracted\") pod \"b5cb46b5-67ef-465d-b925-0edfdd986903\" (UID: \"b5cb46b5-67ef-465d-b925-0edfdd986903\") "
Sep 05 06:28:10.082099 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:10.081991    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5cb46b5-67ef-465d-b925-0edfdd986903-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b5cb46b5-67ef-465d-b925-0edfdd986903" (UID: "b5cb46b5-67ef-465d-b925-0edfdd986903"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:28:10.082429 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:10.082390    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5cb46b5-67ef-465d-b925-0edfdd986903-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b5cb46b5-67ef-465d-b925-0edfdd986903" (UID: "b5cb46b5-67ef-465d-b925-0edfdd986903"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:28:10.084673 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:10.084640    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5cb46b5-67ef-465d-b925-0edfdd986903-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b5cb46b5-67ef-465d-b925-0edfdd986903" (UID: "b5cb46b5-67ef-465d-b925-0edfdd986903"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 05 06:28:10.084776 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:10.084677    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5cb46b5-67ef-465d-b925-0edfdd986903-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b5cb46b5-67ef-465d-b925-0edfdd986903" (UID: "b5cb46b5-67ef-465d-b925-0edfdd986903"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 05 06:28:10.084776 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:10.084706    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5cb46b5-67ef-465d-b925-0edfdd986903-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b5cb46b5-67ef-465d-b925-0edfdd986903" (UID: "b5cb46b5-67ef-465d-b925-0edfdd986903"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:28:10.084776 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:10.084761    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5cb46b5-67ef-465d-b925-0edfdd986903-kube-api-access-78xtr" (OuterVolumeSpecName: "kube-api-access-78xtr") pod "b5cb46b5-67ef-465d-b925-0edfdd986903" (UID: "b5cb46b5-67ef-465d-b925-0edfdd986903"). InnerVolumeSpecName "kube-api-access-78xtr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:28:10.084939 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:10.084834    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5cb46b5-67ef-465d-b925-0edfdd986903-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b5cb46b5-67ef-465d-b925-0edfdd986903" (UID: "b5cb46b5-67ef-465d-b925-0edfdd986903"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:28:10.091159 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:10.091127    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5cb46b5-67ef-465d-b925-0edfdd986903-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b5cb46b5-67ef-465d-b925-0edfdd986903" (UID: "b5cb46b5-67ef-465d-b925-0edfdd986903"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:28:10.182733 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:10.182693    2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b5cb46b5-67ef-465d-b925-0edfdd986903-bound-sa-token\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:28:10.182733 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:10.182723    2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b5cb46b5-67ef-465d-b925-0edfdd986903-image-registry-private-configuration\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:28:10.182733 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:10.182733    2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b5cb46b5-67ef-465d-b925-0edfdd986903-installation-pull-secrets\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:28:10.182733 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:10.182744    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b5cb46b5-67ef-465d-b925-0edfdd986903-trusted-ca\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:28:10.182985 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:10.182752    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78xtr\" (UniqueName: \"kubernetes.io/projected/b5cb46b5-67ef-465d-b925-0edfdd986903-kube-api-access-78xtr\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:28:10.182985 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:10.182760    2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b5cb46b5-67ef-465d-b925-0edfdd986903-ca-trust-extracted\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:28:10.182985 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:10.182769    2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b5cb46b5-67ef-465d-b925-0edfdd986903-registry-tls\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:28:10.182985 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:10.182777    2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b5cb46b5-67ef-465d-b925-0edfdd986903-registry-certificates\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:28:10.278219 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:10.278180    2567 generic.go:356] "Generic (PLEG): container finished" podID="b5cb46b5-67ef-465d-b925-0edfdd986903" containerID="19c686072395f375fb528bbd1ff1c4c11cf37d56fbf6f130f0a790f05aac7ba2" exitCode=0
Sep 05 06:28:10.278386 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:10.278230    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7ff756899b-tg2xn"
Sep 05 06:28:10.278386 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:10.278275    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ff756899b-tg2xn" event={"ID":"b5cb46b5-67ef-465d-b925-0edfdd986903","Type":"ContainerDied","Data":"19c686072395f375fb528bbd1ff1c4c11cf37d56fbf6f130f0a790f05aac7ba2"}
Sep 05 06:28:10.278386 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:10.278357    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ff756899b-tg2xn" event={"ID":"b5cb46b5-67ef-465d-b925-0edfdd986903","Type":"ContainerDied","Data":"bc97b2faf6321d2400dadfb2c9a703989694d5ea5ea2e8aca0a9231e1608577c"}
Sep 05 06:28:10.278386 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:10.278378    2567 scope.go:117] "RemoveContainer" containerID="19c686072395f375fb528bbd1ff1c4c11cf37d56fbf6f130f0a790f05aac7ba2"
Sep 05 06:28:10.287320 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:10.287301    2567 scope.go:117] "RemoveContainer" containerID="19c686072395f375fb528bbd1ff1c4c11cf37d56fbf6f130f0a790f05aac7ba2"
Sep 05 06:28:10.287664 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:28:10.287645    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19c686072395f375fb528bbd1ff1c4c11cf37d56fbf6f130f0a790f05aac7ba2\": container with ID starting with 19c686072395f375fb528bbd1ff1c4c11cf37d56fbf6f130f0a790f05aac7ba2 not found: ID does not exist" containerID="19c686072395f375fb528bbd1ff1c4c11cf37d56fbf6f130f0a790f05aac7ba2"
Sep 05 06:28:10.287719 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:10.287676    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19c686072395f375fb528bbd1ff1c4c11cf37d56fbf6f130f0a790f05aac7ba2"} err="failed to get container status \"19c686072395f375fb528bbd1ff1c4c11cf37d56fbf6f130f0a790f05aac7ba2\": rpc error: code = NotFound desc = could not find container \"19c686072395f375fb528bbd1ff1c4c11cf37d56fbf6f130f0a790f05aac7ba2\": container with ID starting with 19c686072395f375fb528bbd1ff1c4c11cf37d56fbf6f130f0a790f05aac7ba2 not found: ID does not exist"
Sep 05 06:28:10.299739 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:10.299708    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7ff756899b-tg2xn"]
Sep 05 06:28:10.304218 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:10.304184    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7ff756899b-tg2xn"]
Sep 05 06:28:10.579900 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:10.579863    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5cb46b5-67ef-465d-b925-0edfdd986903" path="/var/lib/kubelet/pods/b5cb46b5-67ef-465d-b925-0edfdd986903/volumes"
Sep 05 06:28:12.350170 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:28:12.350113    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2hbc9" podUID="60948d62-de5e-4153-88a9-35f7726ca11d"
Sep 05 06:28:13.289847 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:13.289813    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2hbc9"
Sep 05 06:28:17.157756 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:17.150355    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-76d584df7-sp8xc"
Sep 05 06:28:17.157756 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:17.150467    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-76d584df7-sp8xc"
Sep 05 06:28:17.252124 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:17.252075    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60948d62-de5e-4153-88a9-35f7726ca11d-metrics-tls\") pod \"dns-default-2hbc9\" (UID: \"60948d62-de5e-4153-88a9-35f7726ca11d\") " pod="openshift-dns/dns-default-2hbc9"
Sep 05 06:28:17.254932 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:17.254893    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60948d62-de5e-4153-88a9-35f7726ca11d-metrics-tls\") pod \"dns-default-2hbc9\" (UID: \"60948d62-de5e-4153-88a9-35f7726ca11d\") " pod="openshift-dns/dns-default-2hbc9"
Sep 05 06:28:17.493691 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:17.493660    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bxnqj\""
Sep 05 06:28:17.501349 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:17.501324    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2hbc9"
Sep 05 06:28:17.779727 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:17.779698    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2hbc9"]
Sep 05 06:28:17.782400 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:28:17.782365    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60948d62_de5e_4153_88a9_35f7726ca11d.slice/crio-74c9bfe31fe0e400b75a1dca5b4fbee69e3dba4336b6953081ce678085e36238 WatchSource:0}: Error finding container 74c9bfe31fe0e400b75a1dca5b4fbee69e3dba4336b6953081ce678085e36238: Status 404 returned error can't find the container with id 74c9bfe31fe0e400b75a1dca5b4fbee69e3dba4336b6953081ce678085e36238
Sep 05 06:28:18.310426 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:18.310383    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2hbc9" event={"ID":"60948d62-de5e-4153-88a9-35f7726ca11d","Type":"ContainerStarted","Data":"74c9bfe31fe0e400b75a1dca5b4fbee69e3dba4336b6953081ce678085e36238"}
Sep 05 06:28:20.324805 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:20.324770    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2hbc9" event={"ID":"60948d62-de5e-4153-88a9-35f7726ca11d","Type":"ContainerStarted","Data":"2b51c9a3b58d72b5864902ab1cf7113933be10867e12720435dd5c30f813ce25"}
Sep 05 06:28:20.325227 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:20.324865    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2hbc9" event={"ID":"60948d62-de5e-4153-88a9-35f7726ca11d","Type":"ContainerStarted","Data":"9e27fc49c3712a69dbf19e367145685f3cfe1601293b04e5b580ab6f01c461b5"}
Sep 05 06:28:20.325227 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:20.324890    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2hbc9"
Sep 05 06:28:20.359727 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:20.359655    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2hbc9" podStartSLOduration=129.83946718 podStartE2EDuration="2m11.359635282s" totalImagesPullingTime="1.520168102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:26:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:28:20.358942106 +0000 UTC m=+166.332696781" watchObservedRunningTime="2026-09-05 06:28:20.359635282 +0000 UTC m=+166.333389957"
Sep 05 06:28:25.343973 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:25.343936    2567 generic.go:356] "Generic (PLEG): container finished" podID="e0721b53-eb71-4fff-8b34-a59dbe3afeb0" containerID="e03cfbc459907dbec14df1238c9efaecfe178f9f0ed03bfb2ebff9eb04a6b4a3" exitCode=0
Sep 05 06:28:25.344381 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:25.344011    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-nm4mr" event={"ID":"e0721b53-eb71-4fff-8b34-a59dbe3afeb0","Type":"ContainerDied","Data":"e03cfbc459907dbec14df1238c9efaecfe178f9f0ed03bfb2ebff9eb04a6b4a3"}
Sep 05 06:28:25.344431 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:25.344416    2567 scope.go:117] "RemoveContainer" containerID="e03cfbc459907dbec14df1238c9efaecfe178f9f0ed03bfb2ebff9eb04a6b4a3"
Sep 05 06:28:26.350007 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:26.349971    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-nm4mr" event={"ID":"e0721b53-eb71-4fff-8b34-a59dbe3afeb0","Type":"ContainerStarted","Data":"51a23781e1cb88c56ec8808c373cf5deb8e28a0c54606714fc42737d7956cf04"}
Sep 05 06:28:29.565670 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:29.565628    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-76d584df7-sp8xc_0957d224-5722-434b-875e-08cddf2a9179/metrics-server/0.log"
Sep 05 06:28:29.765659 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:29.765619    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-9sk9w_40d15e42-0673-4995-9bf3-442f64a656b2/monitoring-plugin/0.log"
Sep 05 06:28:30.331776 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:30.331746    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2hbc9"
Sep 05 06:28:31.164467 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:31.164436    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zzm9b_f14b04b2-7405-41e1-9dc4-121f01eaa540/init-textfile/0.log"
Sep 05 06:28:31.366960 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:31.366920    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zzm9b_f14b04b2-7405-41e1-9dc4-121f01eaa540/node-exporter/0.log"
Sep 05 06:28:31.568708 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:31.568669    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zzm9b_f14b04b2-7405-41e1-9dc4-121f01eaa540/kube-rbac-proxy/0.log"
Sep 05 06:28:31.767847 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:31.767812    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-fl7v2_a6ccb90c-ddd5-4d93-97ea-39d417b1ba57/kube-rbac-proxy-main/0.log"
Sep 05 06:28:31.964435 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:31.964395    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-fl7v2_a6ccb90c-ddd5-4d93-97ea-39d417b1ba57/kube-rbac-proxy-self/0.log"
Sep 05 06:28:32.167086 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:32.167057    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-fl7v2_a6ccb90c-ddd5-4d93-97ea-39d417b1ba57/openshift-state-metrics/0.log"
Sep 05 06:28:32.365074 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:32.364933    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_56fdcafb-d954-424b-b1e8-d6f54197e44a/init-config-reloader/0.log"
Sep 05 06:28:32.571069 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:32.571016    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_56fdcafb-d954-424b-b1e8-d6f54197e44a/prometheus/0.log"
Sep 05 06:28:32.766238 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:32.766195    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_56fdcafb-d954-424b-b1e8-d6f54197e44a/config-reloader/0.log"
Sep 05 06:28:32.967537 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:32.967501    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_56fdcafb-d954-424b-b1e8-d6f54197e44a/thanos-sidecar/0.log"
Sep 05 06:28:33.164474 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:33.164354    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_56fdcafb-d954-424b-b1e8-d6f54197e44a/kube-rbac-proxy-web/0.log"
Sep 05 06:28:33.368610 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:33.368582    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_56fdcafb-d954-424b-b1e8-d6f54197e44a/kube-rbac-proxy/0.log"
Sep 05 06:28:33.564334 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:33.564309    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_56fdcafb-d954-424b-b1e8-d6f54197e44a/kube-rbac-proxy-thanos/0.log"
Sep 05 06:28:36.765282 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:36.765241    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5885f47846-fxgw4_2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4/router/0.log"
Sep 05 06:28:37.157497 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:37.157404    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-76d584df7-sp8xc"
Sep 05 06:28:37.161808 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:37.161778    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-76d584df7-sp8xc"
Sep 05 06:28:37.364796 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:37.364759    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qhxfc_eb9b64fc-5965-4eb1-95e0-df1dc72f4e2d/serve-healthcheck-canary/0.log"
Sep 05 06:28:37.572542 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:37.572508    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-7cdcfcf76c-79wkv_0245de71-4a5a-4b49-a7e2-b56c22c5c39e/cluster-samples-operator/0.log"
Sep 05 06:28:37.765216 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:37.765185    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-7cdcfcf76c-79wkv_0245de71-4a5a-4b49-a7e2-b56c22c5c39e/cluster-samples-operator-watch/0.log"
Sep 05 06:28:50.449227 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:50.449189    2567 generic.go:356] "Generic (PLEG): container finished" podID="a65ba1aa-6e50-451b-85ba-e38e380ecd68" containerID="efc9ba03d56e0b5395b4465088c794beb200a3e45331787f58a2a0355d9b6427" exitCode=0
Sep 05 06:28:50.449720 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:50.449263    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-9l7k2" event={"ID":"a65ba1aa-6e50-451b-85ba-e38e380ecd68","Type":"ContainerDied","Data":"efc9ba03d56e0b5395b4465088c794beb200a3e45331787f58a2a0355d9b6427"}
Sep 05 06:28:50.449720 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:50.449614    2567 scope.go:117] "RemoveContainer" containerID="efc9ba03d56e0b5395b4465088c794beb200a3e45331787f58a2a0355d9b6427"
Sep 05 06:28:51.455169 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:51.455136    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-9l7k2" event={"ID":"a65ba1aa-6e50-451b-85ba-e38e380ecd68","Type":"ContainerStarted","Data":"f0e8fbb58624a09f0370a02d85a21fff6789f1146a7ba7b5a618fe1a5c508687"}
Sep 05 06:28:58.989013 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:58.988966    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:28:59.006119 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:59.006084    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:28:59.504496 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:28:59.504470    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:17.124095 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.124051    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 05 06:29:17.124573 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.124434    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="56fdcafb-d954-424b-b1e8-d6f54197e44a" containerName="prometheus" containerID="cri-o://d99961ca4c117c87443883855d7436c898b30d3332d4eae95ec65e12260c8191" gracePeriod=600
Sep 05 06:29:17.124573 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.124484    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="56fdcafb-d954-424b-b1e8-d6f54197e44a" containerName="config-reloader" containerID="cri-o://69a6ee811a05af895083afd6a327ce69a9baafcebf0daace978a70b3ac8cc845" gracePeriod=600
Sep 05 06:29:17.124573 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.124521    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="56fdcafb-d954-424b-b1e8-d6f54197e44a" containerName="kube-rbac-proxy" containerID="cri-o://67f1609c9f78ed3d105dffc526e72a45d5c957fffca1bdce52659d70ef67733f" gracePeriod=600
Sep 05 06:29:17.124747 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.124473    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="56fdcafb-d954-424b-b1e8-d6f54197e44a" containerName="kube-rbac-proxy-thanos" containerID="cri-o://d0c364dd4bec56edf1fce065aaaf1ed35671a61816134b5b25723be6c3d78be6" gracePeriod=600
Sep 05 06:29:17.124747 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.124470    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="56fdcafb-d954-424b-b1e8-d6f54197e44a" containerName="thanos-sidecar" containerID="cri-o://b438f10f44e333f97395a17fb5bf616e088b6cdbec98c1dae561c86f610f2076" gracePeriod=600
Sep 05 06:29:17.124747 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.124470    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="56fdcafb-d954-424b-b1e8-d6f54197e44a" containerName="kube-rbac-proxy-web" containerID="cri-o://2fbfc96818262b5d063107a8dd9bd2c2edc110672555be3f9ee4bef3bea0fbb8" gracePeriod=600
Sep 05 06:29:17.559337 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.559304    2567 generic.go:356] "Generic (PLEG): container finished" podID="56fdcafb-d954-424b-b1e8-d6f54197e44a" containerID="d0c364dd4bec56edf1fce065aaaf1ed35671a61816134b5b25723be6c3d78be6" exitCode=0
Sep 05 06:29:17.559337 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.559333    2567 generic.go:356] "Generic (PLEG): container finished" podID="56fdcafb-d954-424b-b1e8-d6f54197e44a" containerID="67f1609c9f78ed3d105dffc526e72a45d5c957fffca1bdce52659d70ef67733f" exitCode=0
Sep 05 06:29:17.559337 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.559340    2567 generic.go:356] "Generic (PLEG): container finished" podID="56fdcafb-d954-424b-b1e8-d6f54197e44a" containerID="2fbfc96818262b5d063107a8dd9bd2c2edc110672555be3f9ee4bef3bea0fbb8" exitCode=0
Sep 05 06:29:17.559337 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.559345    2567 generic.go:356] "Generic (PLEG): container finished" podID="56fdcafb-d954-424b-b1e8-d6f54197e44a" containerID="b438f10f44e333f97395a17fb5bf616e088b6cdbec98c1dae561c86f610f2076" exitCode=0
Sep 05 06:29:17.559629 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.559338    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"56fdcafb-d954-424b-b1e8-d6f54197e44a","Type":"ContainerDied","Data":"d0c364dd4bec56edf1fce065aaaf1ed35671a61816134b5b25723be6c3d78be6"}
Sep 05 06:29:17.559629 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.559407    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"56fdcafb-d954-424b-b1e8-d6f54197e44a","Type":"ContainerDied","Data":"67f1609c9f78ed3d105dffc526e72a45d5c957fffca1bdce52659d70ef67733f"}
Sep 05 06:29:17.559629 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.559352    2567 generic.go:356] "Generic (PLEG): container finished" podID="56fdcafb-d954-424b-b1e8-d6f54197e44a" containerID="69a6ee811a05af895083afd6a327ce69a9baafcebf0daace978a70b3ac8cc845" exitCode=0
Sep 05 06:29:17.559629 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.559446    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"56fdcafb-d954-424b-b1e8-d6f54197e44a","Type":"ContainerDied","Data":"2fbfc96818262b5d063107a8dd9bd2c2edc110672555be3f9ee4bef3bea0fbb8"}
Sep 05 06:29:17.559629 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.559447    2567 generic.go:356] "Generic (PLEG): container finished" podID="56fdcafb-d954-424b-b1e8-d6f54197e44a" containerID="d99961ca4c117c87443883855d7436c898b30d3332d4eae95ec65e12260c8191" exitCode=0
Sep 05 06:29:17.559629 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.559487    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"56fdcafb-d954-424b-b1e8-d6f54197e44a","Type":"ContainerDied","Data":"b438f10f44e333f97395a17fb5bf616e088b6cdbec98c1dae561c86f610f2076"}
Sep 05 06:29:17.559629 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.559521    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"56fdcafb-d954-424b-b1e8-d6f54197e44a","Type":"ContainerDied","Data":"69a6ee811a05af895083afd6a327ce69a9baafcebf0daace978a70b3ac8cc845"}
Sep 05 06:29:17.559629 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.559555    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"56fdcafb-d954-424b-b1e8-d6f54197e44a","Type":"ContainerDied","Data":"d99961ca4c117c87443883855d7436c898b30d3332d4eae95ec65e12260c8191"}
Sep 05 06:29:17.565675 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.565653    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:17.657051 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.656936    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/56fdcafb-d954-424b-b1e8-d6f54197e44a-config-out\") pod \"56fdcafb-d954-424b-b1e8-d6f54197e44a\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") "
Sep 05 06:29:17.657051 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.656979    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-secret-grpc-tls\") pod \"56fdcafb-d954-424b-b1e8-d6f54197e44a\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") "
Sep 05 06:29:17.657051 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.657019    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-secret-kube-rbac-proxy\") pod \"56fdcafb-d954-424b-b1e8-d6f54197e44a\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") "
Sep 05 06:29:17.657328 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.657071    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-secret-metrics-client-certs\") pod \"56fdcafb-d954-424b-b1e8-d6f54197e44a\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") "
Sep 05 06:29:17.657328 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.657092    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-secret-prometheus-k8s-tls\") pod \"56fdcafb-d954-424b-b1e8-d6f54197e44a\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") "
Sep 05 06:29:17.657328 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.657127    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-prometheus-k8s-rulefiles-2\") pod \"56fdcafb-d954-424b-b1e8-d6f54197e44a\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") "
Sep 05 06:29:17.657328 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.657162    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"56fdcafb-d954-424b-b1e8-d6f54197e44a\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") "
Sep 05 06:29:17.657328 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.657195    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/56fdcafb-d954-424b-b1e8-d6f54197e44a-tls-assets\") pod \"56fdcafb-d954-424b-b1e8-d6f54197e44a\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") "
Sep 05 06:29:17.657328 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.657220    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/56fdcafb-d954-424b-b1e8-d6f54197e44a-prometheus-k8s-db\") pod \"56fdcafb-d954-424b-b1e8-d6f54197e44a\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") "
Sep 05 06:29:17.657328 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.657253    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-configmap-kubelet-serving-ca-bundle\") pod \"56fdcafb-d954-424b-b1e8-d6f54197e44a\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") "
Sep 05 06:29:17.657328 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.657283    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-prometheus-k8s-rulefiles-1\") pod \"56fdcafb-d954-424b-b1e8-d6f54197e44a\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") "
Sep 05 06:29:17.657328 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.657316    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-configmap-serving-certs-ca-bundle\") pod \"56fdcafb-d954-424b-b1e8-d6f54197e44a\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") "
Sep 05 06:29:17.657765 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.657366    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5t8w7\" (UniqueName: \"kubernetes.io/projected/56fdcafb-d954-424b-b1e8-d6f54197e44a-kube-api-access-5t8w7\") pod \"56fdcafb-d954-424b-b1e8-d6f54197e44a\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") "
Sep 05 06:29:17.657765 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.657393    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-prometheus-trusted-ca-bundle\") pod \"56fdcafb-d954-424b-b1e8-d6f54197e44a\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") "
Sep 05 06:29:17.657765 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.657423    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-configmap-metrics-client-ca\") pod \"56fdcafb-d954-424b-b1e8-d6f54197e44a\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") "
Sep 05 06:29:17.657765 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.657449    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-config\") pod \"56fdcafb-d954-424b-b1e8-d6f54197e44a\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") "
Sep 05 06:29:17.657765 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.657476    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"56fdcafb-d954-424b-b1e8-d6f54197e44a\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") "
Sep 05 06:29:17.657765 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.657507    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-prometheus-k8s-rulefiles-0\") pod \"56fdcafb-d954-424b-b1e8-d6f54197e44a\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") "
Sep 05 06:29:17.657765 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.657534    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-thanos-prometheus-http-client-file\") pod \"56fdcafb-d954-424b-b1e8-d6f54197e44a\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") "
Sep 05 06:29:17.657765 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.657562    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-web-config\") pod \"56fdcafb-d954-424b-b1e8-d6f54197e44a\" (UID: \"56fdcafb-d954-424b-b1e8-d6f54197e44a\") "
Sep 05 06:29:17.658187 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.657863    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "56fdcafb-d954-424b-b1e8-d6f54197e44a" (UID: "56fdcafb-d954-424b-b1e8-d6f54197e44a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:29:17.658872 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.658372    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "56fdcafb-d954-424b-b1e8-d6f54197e44a" (UID: "56fdcafb-d954-424b-b1e8-d6f54197e44a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:29:17.658872 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.658439    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "56fdcafb-d954-424b-b1e8-d6f54197e44a" (UID: "56fdcafb-d954-424b-b1e8-d6f54197e44a"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:29:17.658872 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.658629    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "56fdcafb-d954-424b-b1e8-d6f54197e44a" (UID: "56fdcafb-d954-424b-b1e8-d6f54197e44a"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:29:17.662039 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.659550    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56fdcafb-d954-424b-b1e8-d6f54197e44a-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "56fdcafb-d954-424b-b1e8-d6f54197e44a" (UID: "56fdcafb-d954-424b-b1e8-d6f54197e44a"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:29:17.662039 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.661222    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "56fdcafb-d954-424b-b1e8-d6f54197e44a" (UID: "56fdcafb-d954-424b-b1e8-d6f54197e44a"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 05 06:29:17.662039 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.661241    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "56fdcafb-d954-424b-b1e8-d6f54197e44a" (UID: "56fdcafb-d954-424b-b1e8-d6f54197e44a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:29:17.662039 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.661553    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "56fdcafb-d954-424b-b1e8-d6f54197e44a" (UID: "56fdcafb-d954-424b-b1e8-d6f54197e44a"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:29:17.662039 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.661617    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "56fdcafb-d954-424b-b1e8-d6f54197e44a" (UID: "56fdcafb-d954-424b-b1e8-d6f54197e44a"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:29:17.662039 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.661698    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "56fdcafb-d954-424b-b1e8-d6f54197e44a" (UID: "56fdcafb-d954-424b-b1e8-d6f54197e44a"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 05 06:29:17.662039 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.661955    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-config" (OuterVolumeSpecName: "config") pod "56fdcafb-d954-424b-b1e8-d6f54197e44a" (UID: "56fdcafb-d954-424b-b1e8-d6f54197e44a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 05 06:29:17.662039 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.662014    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56fdcafb-d954-424b-b1e8-d6f54197e44a-config-out" (OuterVolumeSpecName: "config-out") pod "56fdcafb-d954-424b-b1e8-d6f54197e44a" (UID: "56fdcafb-d954-424b-b1e8-d6f54197e44a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:29:17.662460 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.662157    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "56fdcafb-d954-424b-b1e8-d6f54197e44a" (UID: "56fdcafb-d954-424b-b1e8-d6f54197e44a"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 05 06:29:17.662460 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.662303    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "56fdcafb-d954-424b-b1e8-d6f54197e44a" (UID: "56fdcafb-d954-424b-b1e8-d6f54197e44a"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 05 06:29:17.662460 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.662405    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56fdcafb-d954-424b-b1e8-d6f54197e44a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "56fdcafb-d954-424b-b1e8-d6f54197e44a" (UID: "56fdcafb-d954-424b-b1e8-d6f54197e44a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:29:17.663362 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.663322    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "56fdcafb-d954-424b-b1e8-d6f54197e44a" (UID: "56fdcafb-d954-424b-b1e8-d6f54197e44a"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 05 06:29:17.663715 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.663689    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "56fdcafb-d954-424b-b1e8-d6f54197e44a" (UID: "56fdcafb-d954-424b-b1e8-d6f54197e44a"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 05 06:29:17.663832 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.663787    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56fdcafb-d954-424b-b1e8-d6f54197e44a-kube-api-access-5t8w7" (OuterVolumeSpecName: "kube-api-access-5t8w7") pod "56fdcafb-d954-424b-b1e8-d6f54197e44a" (UID: "56fdcafb-d954-424b-b1e8-d6f54197e44a"). InnerVolumeSpecName "kube-api-access-5t8w7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:29:17.664112 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.664086    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "56fdcafb-d954-424b-b1e8-d6f54197e44a" (UID: "56fdcafb-d954-424b-b1e8-d6f54197e44a"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 05 06:29:17.673081 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.673046    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-web-config" (OuterVolumeSpecName: "web-config") pod "56fdcafb-d954-424b-b1e8-d6f54197e44a" (UID: "56fdcafb-d954-424b-b1e8-d6f54197e44a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 05 06:29:17.759184 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.759152    2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/56fdcafb-d954-424b-b1e8-d6f54197e44a-config-out\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:29:17.759184 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.759180    2567 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-secret-grpc-tls\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:29:17.759184 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.759189    2567 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-secret-kube-rbac-proxy\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:29:17.759407 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.759199    2567 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-secret-metrics-client-certs\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:29:17.759407 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.759209    2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:29:17.759407 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.759231    2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:29:17.759407 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.759243    2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:29:17.759407 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.759252    2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/56fdcafb-d954-424b-b1e8-d6f54197e44a-tls-assets\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:29:17.759407 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.759260    2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/56fdcafb-d954-424b-b1e8-d6f54197e44a-prometheus-k8s-db\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:29:17.759407 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.759268    2567 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:29:17.759407 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.759277    2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:29:17.759407 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.759285    2567 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:29:17.759407 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.759294    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5t8w7\" (UniqueName: \"kubernetes.io/projected/56fdcafb-d954-424b-b1e8-d6f54197e44a-kube-api-access-5t8w7\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:29:17.759407 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.759301    2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:29:17.759407 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.759309    2567 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-configmap-metrics-client-ca\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:29:17.759407 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.759318    2567 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-config\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:29:17.759407 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.759326    2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:29:17.759407 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.759334    2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/56fdcafb-d954-424b-b1e8-d6f54197e44a-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:29:17.759407 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.759342    2567 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:29:17.759407 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:17.759350    2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/56fdcafb-d954-424b-b1e8-d6f54197e44a-web-config\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:29:18.566227 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.566194    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"56fdcafb-d954-424b-b1e8-d6f54197e44a","Type":"ContainerDied","Data":"19ff516653d173be9f17f99b6d0e8c62b84c85eff90476be462b4165fcb0dcff"}
Sep 05 06:29:18.566647 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.566269    2567 scope.go:117] "RemoveContainer" containerID="d0c364dd4bec56edf1fce065aaaf1ed35671a61816134b5b25723be6c3d78be6"
Sep 05 06:29:18.566647 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.566271    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.580725 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.580403    2567 scope.go:117] "RemoveContainer" containerID="67f1609c9f78ed3d105dffc526e72a45d5c957fffca1bdce52659d70ef67733f"
Sep 05 06:29:18.589076 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.589052    2567 scope.go:117] "RemoveContainer" containerID="2fbfc96818262b5d063107a8dd9bd2c2edc110672555be3f9ee4bef3bea0fbb8"
Sep 05 06:29:18.595779 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.595763    2567 scope.go:117] "RemoveContainer" containerID="b438f10f44e333f97395a17fb5bf616e088b6cdbec98c1dae561c86f610f2076"
Sep 05 06:29:18.598016 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.597994    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 05 06:29:18.603789 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.603760    2567 scope.go:117] "RemoveContainer" containerID="69a6ee811a05af895083afd6a327ce69a9baafcebf0daace978a70b3ac8cc845"
Sep 05 06:29:18.605379 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.605360    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 05 06:29:18.610430 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.610413    2567 scope.go:117] "RemoveContainer" containerID="d99961ca4c117c87443883855d7436c898b30d3332d4eae95ec65e12260c8191"
Sep 05 06:29:18.617490 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.617473    2567 scope.go:117] "RemoveContainer" containerID="97f9e1d48fbc20978998773905ce41630f86a2dcfda49aa4896b10f2b07d75c7"
Sep 05 06:29:18.633255 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.633235    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 05 06:29:18.633488 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.633476    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56fdcafb-d954-424b-b1e8-d6f54197e44a" containerName="init-config-reloader"
Sep 05 06:29:18.633535 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.633490    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="56fdcafb-d954-424b-b1e8-d6f54197e44a" containerName="init-config-reloader"
Sep 05 06:29:18.633535 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.633499    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56fdcafb-d954-424b-b1e8-d6f54197e44a" containerName="config-reloader"
Sep 05 06:29:18.633535 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.633505    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="56fdcafb-d954-424b-b1e8-d6f54197e44a" containerName="config-reloader"
Sep 05 06:29:18.633535 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.633510    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56fdcafb-d954-424b-b1e8-d6f54197e44a" containerName="kube-rbac-proxy"
Sep 05 06:29:18.633535 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.633515    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="56fdcafb-d954-424b-b1e8-d6f54197e44a" containerName="kube-rbac-proxy"
Sep 05 06:29:18.633535 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.633521    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56fdcafb-d954-424b-b1e8-d6f54197e44a" containerName="kube-rbac-proxy-thanos"
Sep 05 06:29:18.633535 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.633526    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="56fdcafb-d954-424b-b1e8-d6f54197e44a" containerName="kube-rbac-proxy-thanos"
Sep 05 06:29:18.633535 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.633533    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5cb46b5-67ef-465d-b925-0edfdd986903" containerName="registry"
Sep 05 06:29:18.633535 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.633538    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5cb46b5-67ef-465d-b925-0edfdd986903" containerName="registry"
Sep 05 06:29:18.633798 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.633551    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56fdcafb-d954-424b-b1e8-d6f54197e44a" containerName="kube-rbac-proxy-web"
Sep 05 06:29:18.633798 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.633555    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="56fdcafb-d954-424b-b1e8-d6f54197e44a" containerName="kube-rbac-proxy-web"
Sep 05 06:29:18.633798 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.633564    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56fdcafb-d954-424b-b1e8-d6f54197e44a" containerName="prometheus"
Sep 05 06:29:18.633798 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.633569    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="56fdcafb-d954-424b-b1e8-d6f54197e44a" containerName="prometheus"
Sep 05 06:29:18.633798 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.633577    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56fdcafb-d954-424b-b1e8-d6f54197e44a" containerName="thanos-sidecar"
Sep 05 06:29:18.633798 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.633581    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="56fdcafb-d954-424b-b1e8-d6f54197e44a" containerName="thanos-sidecar"
Sep 05 06:29:18.633798 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.633618    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="56fdcafb-d954-424b-b1e8-d6f54197e44a" containerName="kube-rbac-proxy-thanos"
Sep 05 06:29:18.633798 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.633625    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="56fdcafb-d954-424b-b1e8-d6f54197e44a" containerName="kube-rbac-proxy"
Sep 05 06:29:18.633798 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.633632    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="56fdcafb-d954-424b-b1e8-d6f54197e44a" containerName="prometheus"
Sep 05 06:29:18.633798 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.633645    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="56fdcafb-d954-424b-b1e8-d6f54197e44a" containerName="thanos-sidecar"
Sep 05 06:29:18.633798 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.633651    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="56fdcafb-d954-424b-b1e8-d6f54197e44a" containerName="kube-rbac-proxy-web"
Sep 05 06:29:18.633798 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.633657    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="56fdcafb-d954-424b-b1e8-d6f54197e44a" containerName="config-reloader"
Sep 05 06:29:18.633798 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.633663    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5cb46b5-67ef-465d-b925-0edfdd986903" containerName="registry"
Sep 05 06:29:18.638693 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.638678    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.641879 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.641860    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 05 06:29:18.641942 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.641924    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 05 06:29:18.641942 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.641933    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 05 06:29:18.642244 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.642230    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 05 06:29:18.642323 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.642270    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 05 06:29:18.642379 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.642337    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 05 06:29:18.642466 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.642450    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bhmh8a7j0jcst\""
Sep 05 06:29:18.642513 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.642450    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 05 06:29:18.642876 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.642860    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-n6qx9\""
Sep 05 06:29:18.643085 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.642875    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 05 06:29:18.643085 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.642860    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 05 06:29:18.643085 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.642895    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 05 06:29:18.643085 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.642898    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 05 06:29:18.643404 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.643389    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 05 06:29:18.645662 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.645634    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 05 06:29:18.647706 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.647687    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 05 06:29:18.654332 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.654313    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 05 06:29:18.768417 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.768384    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/487fa0fd-f22c-42a9-9fb2-396b113b8072-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.768581 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.768439    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/487fa0fd-f22c-42a9-9fb2-396b113b8072-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.768581 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.768502    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/487fa0fd-f22c-42a9-9fb2-396b113b8072-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.768581 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.768531    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/487fa0fd-f22c-42a9-9fb2-396b113b8072-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.768581 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.768550    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/487fa0fd-f22c-42a9-9fb2-396b113b8072-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.768581 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.768569    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/487fa0fd-f22c-42a9-9fb2-396b113b8072-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.768757 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.768584    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/487fa0fd-f22c-42a9-9fb2-396b113b8072-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.768757 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.768625    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/487fa0fd-f22c-42a9-9fb2-396b113b8072-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.768757 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.768658    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/487fa0fd-f22c-42a9-9fb2-396b113b8072-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.768757 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.768711    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/487fa0fd-f22c-42a9-9fb2-396b113b8072-config-out\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.768757 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.768728    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/487fa0fd-f22c-42a9-9fb2-396b113b8072-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.768757 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.768749    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfxrn\" (UniqueName: \"kubernetes.io/projected/487fa0fd-f22c-42a9-9fb2-396b113b8072-kube-api-access-zfxrn\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.769005 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.768786    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/487fa0fd-f22c-42a9-9fb2-396b113b8072-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.769005 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.768802    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/487fa0fd-f22c-42a9-9fb2-396b113b8072-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.769005 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.768825    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/487fa0fd-f22c-42a9-9fb2-396b113b8072-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.769005 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.768849    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/487fa0fd-f22c-42a9-9fb2-396b113b8072-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.769005 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.768871    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/487fa0fd-f22c-42a9-9fb2-396b113b8072-config\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.769005 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.768884    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/487fa0fd-f22c-42a9-9fb2-396b113b8072-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.769005 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.768916    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/487fa0fd-f22c-42a9-9fb2-396b113b8072-web-config\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.769005 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.768948    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/487fa0fd-f22c-42a9-9fb2-396b113b8072-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.869347 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.869280    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/487fa0fd-f22c-42a9-9fb2-396b113b8072-web-config\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.869347 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.869316    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/487fa0fd-f22c-42a9-9fb2-396b113b8072-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.869347 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.869336    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/487fa0fd-f22c-42a9-9fb2-396b113b8072-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.869543 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.869361    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/487fa0fd-f22c-42a9-9fb2-396b113b8072-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.869543 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.869377    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/487fa0fd-f22c-42a9-9fb2-396b113b8072-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.869543 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.869397    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/487fa0fd-f22c-42a9-9fb2-396b113b8072-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.869543 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.869418    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/487fa0fd-f22c-42a9-9fb2-396b113b8072-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.869543 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.869443    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/487fa0fd-f22c-42a9-9fb2-396b113b8072-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.869543 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.869468    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/487fa0fd-f22c-42a9-9fb2-396b113b8072-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.869543 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.869495    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/487fa0fd-f22c-42a9-9fb2-396b113b8072-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.869543 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.869521    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/487fa0fd-f22c-42a9-9fb2-396b113b8072-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.869931 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.869550    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/487fa0fd-f22c-42a9-9fb2-396b113b8072-config-out\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.869931 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.869572    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/487fa0fd-f22c-42a9-9fb2-396b113b8072-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.869931 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.869595    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfxrn\" (UniqueName: \"kubernetes.io/projected/487fa0fd-f22c-42a9-9fb2-396b113b8072-kube-api-access-zfxrn\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.869931 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.869623    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/487fa0fd-f22c-42a9-9fb2-396b113b8072-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.869931 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.869653    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/487fa0fd-f22c-42a9-9fb2-396b113b8072-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.869931 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.869681    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/487fa0fd-f22c-42a9-9fb2-396b113b8072-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.869931 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.869710    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/487fa0fd-f22c-42a9-9fb2-396b113b8072-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.869931 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.869748    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/487fa0fd-f22c-42a9-9fb2-396b113b8072-config\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.869931 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.869771    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/487fa0fd-f22c-42a9-9fb2-396b113b8072-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.870556 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.870208    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/487fa0fd-f22c-42a9-9fb2-396b113b8072-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.870556 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.870340    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/487fa0fd-f22c-42a9-9fb2-396b113b8072-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.870556 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.870409    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/487fa0fd-f22c-42a9-9fb2-396b113b8072-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.870730 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.870694    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/487fa0fd-f22c-42a9-9fb2-396b113b8072-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.871218 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.871194    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/487fa0fd-f22c-42a9-9fb2-396b113b8072-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.871325 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.871273    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/487fa0fd-f22c-42a9-9fb2-396b113b8072-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.871995 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.871972    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/487fa0fd-f22c-42a9-9fb2-396b113b8072-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.872821 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.872652    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/487fa0fd-f22c-42a9-9fb2-396b113b8072-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.872821 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.872726    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/487fa0fd-f22c-42a9-9fb2-396b113b8072-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.872821 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.872755    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/487fa0fd-f22c-42a9-9fb2-396b113b8072-web-config\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.873240 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.873212    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/487fa0fd-f22c-42a9-9fb2-396b113b8072-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.874191 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.874091    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/487fa0fd-f22c-42a9-9fb2-396b113b8072-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.874191 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.874116    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/487fa0fd-f22c-42a9-9fb2-396b113b8072-config-out\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.875264 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.875234    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/487fa0fd-f22c-42a9-9fb2-396b113b8072-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.875354 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.875236    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/487fa0fd-f22c-42a9-9fb2-396b113b8072-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.875705 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.875686    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/487fa0fd-f22c-42a9-9fb2-396b113b8072-config\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.875806 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.875793    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/487fa0fd-f22c-42a9-9fb2-396b113b8072-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.875905 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.875884    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/487fa0fd-f22c-42a9-9fb2-396b113b8072-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.875940 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.875884    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/487fa0fd-f22c-42a9-9fb2-396b113b8072-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.880111 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.880093    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfxrn\" (UniqueName: \"kubernetes.io/projected/487fa0fd-f22c-42a9-9fb2-396b113b8072-kube-api-access-zfxrn\") pod \"prometheus-k8s-0\" (UID: \"487fa0fd-f22c-42a9-9fb2-396b113b8072\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:18.947940 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:18.947900    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:29:19.230639 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:19.230600    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 05 06:29:19.234839 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:29:19.234810    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod487fa0fd_f22c_42a9_9fb2_396b113b8072.slice/crio-7cef1cebf3c68dced54adf4fa3b595e9f86ded9e9aa8909428f8954e4793d6d0 WatchSource:0}: Error finding container 7cef1cebf3c68dced54adf4fa3b595e9f86ded9e9aa8909428f8954e4793d6d0: Status 404 returned error can't find the container with id 7cef1cebf3c68dced54adf4fa3b595e9f86ded9e9aa8909428f8954e4793d6d0
Sep 05 06:29:19.572477 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:19.572389    2567 generic.go:356] "Generic (PLEG): container finished" podID="487fa0fd-f22c-42a9-9fb2-396b113b8072" containerID="32b25a080e7907bc7275a6e7128bbcad6e5b195e785e7e4047058ac1ad636f44" exitCode=0
Sep 05 06:29:19.572807 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:19.572473    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"487fa0fd-f22c-42a9-9fb2-396b113b8072","Type":"ContainerDied","Data":"32b25a080e7907bc7275a6e7128bbcad6e5b195e785e7e4047058ac1ad636f44"}
Sep 05 06:29:19.572807 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:19.572545    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"487fa0fd-f22c-42a9-9fb2-396b113b8072","Type":"ContainerStarted","Data":"7cef1cebf3c68dced54adf4fa3b595e9f86ded9e9aa8909428f8954e4793d6d0"}
Sep 05 06:29:20.579784 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:20.579747    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56fdcafb-d954-424b-b1e8-d6f54197e44a" path="/var/lib/kubelet/pods/56fdcafb-d954-424b-b1e8-d6f54197e44a/volumes"
Sep 05 06:29:20.580374 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:20.580355    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"487fa0fd-f22c-42a9-9fb2-396b113b8072","Type":"ContainerStarted","Data":"30bb753f5c6ae7222cb4898c8fb774bd9dbd12cb2dac8888ccac68c2c487471b"}
Sep 05 06:29:20.580431 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:20.580417    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"487fa0fd-f22c-42a9-9fb2-396b113b8072","Type":"ContainerStarted","Data":"dfe4cab5bdf0a12cf16221b3f2be33a0be7dee01091e82fc53a52eec1a59437e"}
Sep 05 06:29:20.580467 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:20.580454    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"487fa0fd-f22c-42a9-9fb2-396b113b8072","Type":"ContainerStarted","Data":"06e552dae9795d5ead80080ab9790144c11851b97ae1c2d24a50eb1751a8d17a"}
Sep 05 06:29:20.580499 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:20.580483    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"487fa0fd-f22c-42a9-9fb2-396b113b8072","Type":"ContainerStarted","Data":"c63fba20cc6489a9208e4c98616a4c8bb14cc33897585eae2ebe7f6451222138"}
Sep 05 06:29:20.580539 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:20.580507    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"487fa0fd-f22c-42a9-9fb2-396b113b8072","Type":"ContainerStarted","Data":"9574e7b6a48e69719746fe655287f0e9b42cc739afd2ffe45f9914841b90617c"}
Sep 05 06:29:20.580539 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:20.580531    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"487fa0fd-f22c-42a9-9fb2-396b113b8072","Type":"ContainerStarted","Data":"537c367981b84b64ae11df9f9516b81bf010a042107e983e05feba6a0ce4598b"}
Sep 05 06:29:20.620948 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:20.620890    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.602127002 podStartE2EDuration="2.620872371s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.745369ms" isStatefulPod=false podCreationTimestamp="2026-09-05 06:29:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:29:20.61505593 +0000 UTC m=+226.588810603" watchObservedRunningTime="2026-09-05 06:29:20.620872371 +0000 UTC m=+226.594627108"
Sep 05 06:29:23.948956 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:29:23.948915    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:30:18.948889 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:30:18.948848    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:30:18.965452 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:30:18.965420    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:30:19.821964 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:30:19.821938    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 05 06:30:34.453356 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:30:34.453318    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bb4_7f8a8f16-2422-4c01-a619-1f17fe10cd4c/ovn-acl-logging/0.log"
Sep 05 06:30:34.453356 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:30:34.453358    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bb4_7f8a8f16-2422-4c01-a619-1f17fe10cd4c/ovn-acl-logging/0.log"
Sep 05 06:30:34.461403 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:30:34.461379    2567 kubelet.go:1648] "Image garbage collection succeeded"
Sep 05 06:33:00.850013 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:00.849921    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-665f9d595b-84wff"]
Sep 05 06:33:00.853490 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:00.853468    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-84wff"
Sep 05 06:33:00.857488 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:00.857458    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 05 06:33:00.857633 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:00.857612    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 05 06:33:00.858568 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:00.858551    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 05 06:33:00.858704 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:00.858687    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xvm2f\""
Sep 05 06:33:00.858761 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:00.858687    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 05 06:33:00.871051 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:00.871002    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-665f9d595b-84wff"]
Sep 05 06:33:00.927441 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:00.927402    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/63bba13c-e48d-4752-8b3e-4f5a38784df9-manifests\") pod \"opendatahub-operator-controller-manager-665f9d595b-84wff\" (UID: \"63bba13c-e48d-4752-8b3e-4f5a38784df9\") " pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-84wff"
Sep 05 06:33:00.927651 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:00.927453    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/63bba13c-e48d-4752-8b3e-4f5a38784df9-webhook-cert\") pod \"opendatahub-operator-controller-manager-665f9d595b-84wff\" (UID: \"63bba13c-e48d-4752-8b3e-4f5a38784df9\") " pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-84wff"
Sep 05 06:33:00.927651 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:00.927558    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2w9k\" (UniqueName: \"kubernetes.io/projected/63bba13c-e48d-4752-8b3e-4f5a38784df9-kube-api-access-m2w9k\") pod \"opendatahub-operator-controller-manager-665f9d595b-84wff\" (UID: \"63bba13c-e48d-4752-8b3e-4f5a38784df9\") " pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-84wff"
Sep 05 06:33:00.927651 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:00.927598    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/63bba13c-e48d-4752-8b3e-4f5a38784df9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-665f9d595b-84wff\" (UID: \"63bba13c-e48d-4752-8b3e-4f5a38784df9\") " pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-84wff"
Sep 05 06:33:00.927651 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:00.927628    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63bba13c-e48d-4752-8b3e-4f5a38784df9-tmp\") pod \"opendatahub-operator-controller-manager-665f9d595b-84wff\" (UID: \"63bba13c-e48d-4752-8b3e-4f5a38784df9\") " pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-84wff"
Sep 05 06:33:01.028325 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:01.028269    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63bba13c-e48d-4752-8b3e-4f5a38784df9-tmp\") pod \"opendatahub-operator-controller-manager-665f9d595b-84wff\" (UID: \"63bba13c-e48d-4752-8b3e-4f5a38784df9\") " pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-84wff"
Sep 05 06:33:01.028523 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:01.028386    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/63bba13c-e48d-4752-8b3e-4f5a38784df9-manifests\") pod \"opendatahub-operator-controller-manager-665f9d595b-84wff\" (UID: \"63bba13c-e48d-4752-8b3e-4f5a38784df9\") " pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-84wff"
Sep 05 06:33:01.028523 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:01.028408    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/63bba13c-e48d-4752-8b3e-4f5a38784df9-webhook-cert\") pod \"opendatahub-operator-controller-manager-665f9d595b-84wff\" (UID: \"63bba13c-e48d-4752-8b3e-4f5a38784df9\") " pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-84wff"
Sep 05 06:33:01.028523 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:01.028434    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2w9k\" (UniqueName: \"kubernetes.io/projected/63bba13c-e48d-4752-8b3e-4f5a38784df9-kube-api-access-m2w9k\") pod \"opendatahub-operator-controller-manager-665f9d595b-84wff\" (UID: \"63bba13c-e48d-4752-8b3e-4f5a38784df9\") " pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-84wff"
Sep 05 06:33:01.028523 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:01.028459    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/63bba13c-e48d-4752-8b3e-4f5a38784df9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-665f9d595b-84wff\" (UID: \"63bba13c-e48d-4752-8b3e-4f5a38784df9\") " pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-84wff"
Sep 05 06:33:01.028812 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:01.028785    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/63bba13c-e48d-4752-8b3e-4f5a38784df9-manifests\") pod \"opendatahub-operator-controller-manager-665f9d595b-84wff\" (UID: \"63bba13c-e48d-4752-8b3e-4f5a38784df9\") " pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-84wff"
Sep 05 06:33:01.030736 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:01.030705    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63bba13c-e48d-4752-8b3e-4f5a38784df9-tmp\") pod \"opendatahub-operator-controller-manager-665f9d595b-84wff\" (UID: \"63bba13c-e48d-4752-8b3e-4f5a38784df9\") " pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-84wff"
Sep 05 06:33:01.030945 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:01.030925    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/63bba13c-e48d-4752-8b3e-4f5a38784df9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-665f9d595b-84wff\" (UID: \"63bba13c-e48d-4752-8b3e-4f5a38784df9\") " pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-84wff"
Sep 05 06:33:01.031008 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:01.030992    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/63bba13c-e48d-4752-8b3e-4f5a38784df9-webhook-cert\") pod \"opendatahub-operator-controller-manager-665f9d595b-84wff\" (UID: \"63bba13c-e48d-4752-8b3e-4f5a38784df9\") " pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-84wff"
Sep 05 06:33:01.039391 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:01.039362    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2w9k\" (UniqueName: \"kubernetes.io/projected/63bba13c-e48d-4752-8b3e-4f5a38784df9-kube-api-access-m2w9k\") pod \"opendatahub-operator-controller-manager-665f9d595b-84wff\" (UID: \"63bba13c-e48d-4752-8b3e-4f5a38784df9\") " pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-84wff"
Sep 05 06:33:01.163635 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:01.163532    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-84wff"
Sep 05 06:33:01.441895 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:01.441809    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-665f9d595b-84wff"]
Sep 05 06:33:01.445163 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:33:01.445133    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63bba13c_e48d_4752_8b3e_4f5a38784df9.slice/crio-4eaef4ddc38a6b950f4b689c600134459b4154604b55749ae5cc8d5ad389e839 WatchSource:0}: Error finding container 4eaef4ddc38a6b950f4b689c600134459b4154604b55749ae5cc8d5ad389e839: Status 404 returned error can't find the container with id 4eaef4ddc38a6b950f4b689c600134459b4154604b55749ae5cc8d5ad389e839
Sep 05 06:33:01.446942 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:01.446922    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 05 06:33:02.421412 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:02.421376    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-84wff" event={"ID":"63bba13c-e48d-4752-8b3e-4f5a38784df9","Type":"ContainerStarted","Data":"4eaef4ddc38a6b950f4b689c600134459b4154604b55749ae5cc8d5ad389e839"}
Sep 05 06:33:04.431983 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:04.431953    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-84wff" event={"ID":"63bba13c-e48d-4752-8b3e-4f5a38784df9","Type":"ContainerStarted","Data":"7c945ebbaf5b54bd279ab64bbb7550a4f68142b34dd86f3475820eb92a32b917"}
Sep 05 06:33:05.547512 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:33:05.547464    2567 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63bba13c_e48d_4752_8b3e_4f5a38784df9.slice/crio-7c945ebbaf5b54bd279ab64bbb7550a4f68142b34dd86f3475820eb92a32b917.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63bba13c_e48d_4752_8b3e_4f5a38784df9.slice/crio-conmon-7c945ebbaf5b54bd279ab64bbb7550a4f68142b34dd86f3475820eb92a32b917.scope\": RecentStats: unable to find data in memory cache]"
Sep 05 06:33:06.442572 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:06.442531    2567 generic.go:356] "Generic (PLEG): container finished" podID="63bba13c-e48d-4752-8b3e-4f5a38784df9" containerID="7c945ebbaf5b54bd279ab64bbb7550a4f68142b34dd86f3475820eb92a32b917" exitCode=0
Sep 05 06:33:06.442887 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:06.442666    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-84wff" event={"ID":"63bba13c-e48d-4752-8b3e-4f5a38784df9","Type":"ContainerDied","Data":"7c945ebbaf5b54bd279ab64bbb7550a4f68142b34dd86f3475820eb92a32b917"}
Sep 05 06:33:07.448745 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:07.448704    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-84wff" event={"ID":"63bba13c-e48d-4752-8b3e-4f5a38784df9","Type":"ContainerStarted","Data":"9dce0e78a79add5a4a7c7ecf2f7b4046875ce10d3d258c77311d68856c255127"}
Sep 05 06:33:07.449156 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:07.448778    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-84wff"
Sep 05 06:33:07.476594 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:07.476539    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-84wff" podStartSLOduration=3.157487446 podStartE2EDuration="7.476522645s" totalImagesPullingTime="3.223190282s" totalInitContainerRuntime="1.095844917s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:33:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:33:07.474707253 +0000 UTC m=+453.448461928" watchObservedRunningTime="2026-09-05 06:33:07.476522645 +0000 UTC m=+453.450277359"
Sep 05 06:33:18.455183 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:18.455148    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-665f9d595b-84wff"
Sep 05 06:33:20.759951 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:20.759916    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6ff6468b6c-8k468"]
Sep 05 06:33:20.769981 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:20.769948    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6ff6468b6c-8k468"
Sep 05 06:33:20.772910 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:20.772878    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 05 06:33:20.773116 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:20.773066    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 05 06:33:20.774061 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:20.774019    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-prkgj\""
Sep 05 06:33:20.782791 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:20.782765    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6ff6468b6c-8k468"]
Sep 05 06:33:20.907665 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:20.907624    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ddccbaf7-3774-407d-abe9-694d2db3a112-tls-certs\") pod \"kube-auth-proxy-6ff6468b6c-8k468\" (UID: \"ddccbaf7-3774-407d-abe9-694d2db3a112\") " pod="openshift-ingress/kube-auth-proxy-6ff6468b6c-8k468"
Sep 05 06:33:20.907849 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:20.907753    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jshvw\" (UniqueName: \"kubernetes.io/projected/ddccbaf7-3774-407d-abe9-694d2db3a112-kube-api-access-jshvw\") pod \"kube-auth-proxy-6ff6468b6c-8k468\" (UID: \"ddccbaf7-3774-407d-abe9-694d2db3a112\") " pod="openshift-ingress/kube-auth-proxy-6ff6468b6c-8k468"
Sep 05 06:33:20.907849 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:20.907817    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ddccbaf7-3774-407d-abe9-694d2db3a112-tmp\") pod \"kube-auth-proxy-6ff6468b6c-8k468\" (UID: \"ddccbaf7-3774-407d-abe9-694d2db3a112\") " pod="openshift-ingress/kube-auth-proxy-6ff6468b6c-8k468"
Sep 05 06:33:21.009150 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:21.009108    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jshvw\" (UniqueName: \"kubernetes.io/projected/ddccbaf7-3774-407d-abe9-694d2db3a112-kube-api-access-jshvw\") pod \"kube-auth-proxy-6ff6468b6c-8k468\" (UID: \"ddccbaf7-3774-407d-abe9-694d2db3a112\") " pod="openshift-ingress/kube-auth-proxy-6ff6468b6c-8k468"
Sep 05 06:33:21.009150 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:21.009157    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ddccbaf7-3774-407d-abe9-694d2db3a112-tmp\") pod \"kube-auth-proxy-6ff6468b6c-8k468\" (UID: \"ddccbaf7-3774-407d-abe9-694d2db3a112\") " pod="openshift-ingress/kube-auth-proxy-6ff6468b6c-8k468"
Sep 05 06:33:21.009383 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:21.009179    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ddccbaf7-3774-407d-abe9-694d2db3a112-tls-certs\") pod \"kube-auth-proxy-6ff6468b6c-8k468\" (UID: \"ddccbaf7-3774-407d-abe9-694d2db3a112\") " pod="openshift-ingress/kube-auth-proxy-6ff6468b6c-8k468"
Sep 05 06:33:21.011778 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:21.011703    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ddccbaf7-3774-407d-abe9-694d2db3a112-tmp\") pod \"kube-auth-proxy-6ff6468b6c-8k468\" (UID: \"ddccbaf7-3774-407d-abe9-694d2db3a112\") " pod="openshift-ingress/kube-auth-proxy-6ff6468b6c-8k468"
Sep 05 06:33:21.011977 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:21.011957    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ddccbaf7-3774-407d-abe9-694d2db3a112-tls-certs\") pod \"kube-auth-proxy-6ff6468b6c-8k468\" (UID: \"ddccbaf7-3774-407d-abe9-694d2db3a112\") " pod="openshift-ingress/kube-auth-proxy-6ff6468b6c-8k468"
Sep 05 06:33:21.024850 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:21.024817    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jshvw\" (UniqueName: \"kubernetes.io/projected/ddccbaf7-3774-407d-abe9-694d2db3a112-kube-api-access-jshvw\") pod \"kube-auth-proxy-6ff6468b6c-8k468\" (UID: \"ddccbaf7-3774-407d-abe9-694d2db3a112\") " pod="openshift-ingress/kube-auth-proxy-6ff6468b6c-8k468"
Sep 05 06:33:21.079581 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:21.079542    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6ff6468b6c-8k468"
Sep 05 06:33:21.361323 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:21.361227    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6ff6468b6c-8k468"]
Sep 05 06:33:21.364752 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:33:21.364719    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddccbaf7_3774_407d_abe9_694d2db3a112.slice/crio-b0484d15252283c517e3c313777419a10dc169ae0f6d26c6179af65936031ab8 WatchSource:0}: Error finding container b0484d15252283c517e3c313777419a10dc169ae0f6d26c6179af65936031ab8: Status 404 returned error can't find the container with id b0484d15252283c517e3c313777419a10dc169ae0f6d26c6179af65936031ab8
Sep 05 06:33:21.504642 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:21.504607    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6ff6468b6c-8k468" event={"ID":"ddccbaf7-3774-407d-abe9-694d2db3a112","Type":"ContainerStarted","Data":"b0484d15252283c517e3c313777419a10dc169ae0f6d26c6179af65936031ab8"}
Sep 05 06:33:24.522724 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:24.522688    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6ff6468b6c-8k468" event={"ID":"ddccbaf7-3774-407d-abe9-694d2db3a112","Type":"ContainerStarted","Data":"13870e0c252da2c75509557f3234db06cee450a5ac58d4d5969c5e2627701746"}
Sep 05 06:33:24.544259 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:24.544204    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6ff6468b6c-8k468" podStartSLOduration=1.836592349 podStartE2EDuration="4.544183583s" totalImagesPullingTime="2.707591234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:33:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:33:24.543418455 +0000 UTC m=+470.517173130" watchObservedRunningTime="2026-09-05 06:33:24.544183583 +0000 UTC m=+470.517938262"
Sep 05 06:33:27.529311 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:27.529275    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz"]
Sep 05 06:33:27.532671 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:27.532650    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz"
Sep 05 06:33:27.559697 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:27.559670    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 05 06:33:27.560765 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:27.560746    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-7xm2z\""
Sep 05 06:33:27.581512 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:27.581481    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz"]
Sep 05 06:33:27.669315 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:27.669274    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71a7ecb0-e5cf-4b09-9511-0afd1c132cbe-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz\" (UID: \"71a7ecb0-e5cf-4b09-9511-0afd1c132cbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz"
Sep 05 06:33:27.669315 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:27.669312    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5xvj\" (UniqueName: \"kubernetes.io/projected/71a7ecb0-e5cf-4b09-9511-0afd1c132cbe-kube-api-access-k5xvj\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz\" (UID: \"71a7ecb0-e5cf-4b09-9511-0afd1c132cbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz"
Sep 05 06:33:27.669544 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:27.669335    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71a7ecb0-e5cf-4b09-9511-0afd1c132cbe-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz\" (UID: \"71a7ecb0-e5cf-4b09-9511-0afd1c132cbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz"
Sep 05 06:33:27.669544 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:27.669410    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71a7ecb0-e5cf-4b09-9511-0afd1c132cbe-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz\" (UID: \"71a7ecb0-e5cf-4b09-9511-0afd1c132cbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz"
Sep 05 06:33:27.669544 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:27.669469    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71a7ecb0-e5cf-4b09-9511-0afd1c132cbe-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz\" (UID: \"71a7ecb0-e5cf-4b09-9511-0afd1c132cbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz"
Sep 05 06:33:27.669544 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:27.669488    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71a7ecb0-e5cf-4b09-9511-0afd1c132cbe-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz\" (UID: \"71a7ecb0-e5cf-4b09-9511-0afd1c132cbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz"
Sep 05 06:33:27.669544 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:27.669509    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71a7ecb0-e5cf-4b09-9511-0afd1c132cbe-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz\" (UID: \"71a7ecb0-e5cf-4b09-9511-0afd1c132cbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz"
Sep 05 06:33:27.669544 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:27.669526    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71a7ecb0-e5cf-4b09-9511-0afd1c132cbe-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz\" (UID: \"71a7ecb0-e5cf-4b09-9511-0afd1c132cbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz"
Sep 05 06:33:27.669787 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:27.669615    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71a7ecb0-e5cf-4b09-9511-0afd1c132cbe-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz\" (UID: \"71a7ecb0-e5cf-4b09-9511-0afd1c132cbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz"
Sep 05 06:33:27.770977 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:27.770932    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71a7ecb0-e5cf-4b09-9511-0afd1c132cbe-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz\" (UID: \"71a7ecb0-e5cf-4b09-9511-0afd1c132cbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz"
Sep 05 06:33:27.770977 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:27.770973    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71a7ecb0-e5cf-4b09-9511-0afd1c132cbe-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz\" (UID: \"71a7ecb0-e5cf-4b09-9511-0afd1c132cbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz"
Sep 05 06:33:27.771260 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:27.770994    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71a7ecb0-e5cf-4b09-9511-0afd1c132cbe-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz\" (UID: \"71a7ecb0-e5cf-4b09-9511-0afd1c132cbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz"
Sep 05 06:33:27.771260 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:27.771154    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71a7ecb0-e5cf-4b09-9511-0afd1c132cbe-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz\" (UID: \"71a7ecb0-e5cf-4b09-9511-0afd1c132cbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz"
Sep 05 06:33:27.771260 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:27.771189    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5xvj\" (UniqueName: \"kubernetes.io/projected/71a7ecb0-e5cf-4b09-9511-0afd1c132cbe-kube-api-access-k5xvj\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz\" (UID: \"71a7ecb0-e5cf-4b09-9511-0afd1c132cbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz"
Sep 05 06:33:27.771260 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:27.771222    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71a7ecb0-e5cf-4b09-9511-0afd1c132cbe-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz\" (UID: \"71a7ecb0-e5cf-4b09-9511-0afd1c132cbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz"
Sep 05 06:33:27.771473 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:27.771272    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71a7ecb0-e5cf-4b09-9511-0afd1c132cbe-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz\" (UID: \"71a7ecb0-e5cf-4b09-9511-0afd1c132cbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz"
Sep 05 06:33:27.771473 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:27.771356    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71a7ecb0-e5cf-4b09-9511-0afd1c132cbe-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz\" (UID: \"71a7ecb0-e5cf-4b09-9511-0afd1c132cbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz"
Sep 05 06:33:27.771473 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:27.771388    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71a7ecb0-e5cf-4b09-9511-0afd1c132cbe-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz\" (UID: \"71a7ecb0-e5cf-4b09-9511-0afd1c132cbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz"
Sep 05 06:33:27.771473 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:27.771408    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71a7ecb0-e5cf-4b09-9511-0afd1c132cbe-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz\" (UID: \"71a7ecb0-e5cf-4b09-9511-0afd1c132cbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz"
Sep 05 06:33:27.771624 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:27.771479    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71a7ecb0-e5cf-4b09-9511-0afd1c132cbe-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz\" (UID: \"71a7ecb0-e5cf-4b09-9511-0afd1c132cbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz"
Sep 05 06:33:27.771624 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:27.771571    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71a7ecb0-e5cf-4b09-9511-0afd1c132cbe-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz\" (UID: \"71a7ecb0-e5cf-4b09-9511-0afd1c132cbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz"
Sep 05 06:33:27.771725 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:27.771706    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71a7ecb0-e5cf-4b09-9511-0afd1c132cbe-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz\" (UID: \"71a7ecb0-e5cf-4b09-9511-0afd1c132cbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz"
Sep 05 06:33:27.772201 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:27.772185    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71a7ecb0-e5cf-4b09-9511-0afd1c132cbe-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz\" (UID: \"71a7ecb0-e5cf-4b09-9511-0afd1c132cbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz"
Sep 05 06:33:27.773914 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:27.773888    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71a7ecb0-e5cf-4b09-9511-0afd1c132cbe-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz\" (UID: \"71a7ecb0-e5cf-4b09-9511-0afd1c132cbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz"
Sep 05 06:33:27.774019 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:27.773994    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71a7ecb0-e5cf-4b09-9511-0afd1c132cbe-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz\" (UID: \"71a7ecb0-e5cf-4b09-9511-0afd1c132cbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz"
Sep 05 06:33:27.782108 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:27.782050    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5xvj\" (UniqueName: \"kubernetes.io/projected/71a7ecb0-e5cf-4b09-9511-0afd1c132cbe-kube-api-access-k5xvj\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz\" (UID: \"71a7ecb0-e5cf-4b09-9511-0afd1c132cbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz"
Sep 05 06:33:27.787816 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:27.787792    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71a7ecb0-e5cf-4b09-9511-0afd1c132cbe-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz\" (UID: \"71a7ecb0-e5cf-4b09-9511-0afd1c132cbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz"
Sep 05 06:33:27.843140 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:27.843102    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz"
Sep 05 06:33:28.128641 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:28.128614    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz"]
Sep 05 06:33:28.130434 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:33:28.130412    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71a7ecb0_e5cf_4b09_9511_0afd1c132cbe.slice/crio-c66d296a58677c7228b96882c77ba969184e85396cccc2f2fea0b911088fb68d WatchSource:0}: Error finding container c66d296a58677c7228b96882c77ba969184e85396cccc2f2fea0b911088fb68d: Status 404 returned error can't find the container with id c66d296a58677c7228b96882c77ba969184e85396cccc2f2fea0b911088fb68d
Sep 05 06:33:28.541519 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:28.541487    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz" event={"ID":"71a7ecb0-e5cf-4b09-9511-0afd1c132cbe","Type":"ContainerStarted","Data":"c66d296a58677c7228b96882c77ba969184e85396cccc2f2fea0b911088fb68d"}
Sep 05 06:33:30.770379 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:30.770335    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:33:30.770727 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:30.770420    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:33:30.770727 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:30.770455    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:33:31.557073 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:31.557017    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz" event={"ID":"71a7ecb0-e5cf-4b09-9511-0afd1c132cbe","Type":"ContainerStarted","Data":"5ec7d0af94cd5a51ef804a8d2ae36b870f0fe6db310398aadddb547cdcd7813b"}
Sep 05 06:33:31.581128 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:31.581072    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz" podStartSLOduration=1.943571355 podStartE2EDuration="4.581055525s" totalImagesPullingTime="2.63748417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:33:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:33:31.580085203 +0000 UTC m=+477.553839879" watchObservedRunningTime="2026-09-05 06:33:31.581055525 +0000 UTC m=+477.554810237"
Sep 05 06:33:31.843357 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:31.843266    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz"
Sep 05 06:33:31.848287 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:31.848262    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz"
Sep 05 06:33:31.944330 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:31.944293    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qzlvk"]
Sep 05 06:33:31.947543 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:31.947524    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-qzlvk"
Sep 05 06:33:31.950186 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:31.950165    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 05 06:33:31.958072 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:31.958016    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qzlvk"]
Sep 05 06:33:32.112615 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:32.112513    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/591433e0-9a8b-472a-9d1b-fa09be16c023-tls-certs\") pod \"model-serving-api-54d89bd5fc-qzlvk\" (UID: \"591433e0-9a8b-472a-9d1b-fa09be16c023\") " pod="opendatahub/model-serving-api-54d89bd5fc-qzlvk"
Sep 05 06:33:32.112615 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:32.112574    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kskbt\" (UniqueName: \"kubernetes.io/projected/591433e0-9a8b-472a-9d1b-fa09be16c023-kube-api-access-kskbt\") pod \"model-serving-api-54d89bd5fc-qzlvk\" (UID: \"591433e0-9a8b-472a-9d1b-fa09be16c023\") " pod="opendatahub/model-serving-api-54d89bd5fc-qzlvk"
Sep 05 06:33:32.213846 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:32.213806    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/591433e0-9a8b-472a-9d1b-fa09be16c023-tls-certs\") pod \"model-serving-api-54d89bd5fc-qzlvk\" (UID: \"591433e0-9a8b-472a-9d1b-fa09be16c023\") " pod="opendatahub/model-serving-api-54d89bd5fc-qzlvk"
Sep 05 06:33:32.213846 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:32.213856    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kskbt\" (UniqueName: \"kubernetes.io/projected/591433e0-9a8b-472a-9d1b-fa09be16c023-kube-api-access-kskbt\") pod \"model-serving-api-54d89bd5fc-qzlvk\" (UID: \"591433e0-9a8b-472a-9d1b-fa09be16c023\") " pod="opendatahub/model-serving-api-54d89bd5fc-qzlvk"
Sep 05 06:33:32.216549 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:32.216512    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/591433e0-9a8b-472a-9d1b-fa09be16c023-tls-certs\") pod \"model-serving-api-54d89bd5fc-qzlvk\" (UID: \"591433e0-9a8b-472a-9d1b-fa09be16c023\") " pod="opendatahub/model-serving-api-54d89bd5fc-qzlvk"
Sep 05 06:33:32.223625 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:32.223591    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kskbt\" (UniqueName: \"kubernetes.io/projected/591433e0-9a8b-472a-9d1b-fa09be16c023-kube-api-access-kskbt\") pod \"model-serving-api-54d89bd5fc-qzlvk\" (UID: \"591433e0-9a8b-472a-9d1b-fa09be16c023\") " pod="opendatahub/model-serving-api-54d89bd5fc-qzlvk"
Sep 05 06:33:32.258409 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:32.258371    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-qzlvk"
Sep 05 06:33:32.531535 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:32.531509    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qzlvk"]
Sep 05 06:33:32.533861 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:33:32.533833    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod591433e0_9a8b_472a_9d1b_fa09be16c023.slice/crio-737482841ea5488858a27e646f6352558fb7ad090d0b3f03c2c58f1d650cba01 WatchSource:0}: Error finding container 737482841ea5488858a27e646f6352558fb7ad090d0b3f03c2c58f1d650cba01: Status 404 returned error can't find the container with id 737482841ea5488858a27e646f6352558fb7ad090d0b3f03c2c58f1d650cba01
Sep 05 06:33:32.562919 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:32.562882    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-qzlvk" event={"ID":"591433e0-9a8b-472a-9d1b-fa09be16c023","Type":"ContainerStarted","Data":"737482841ea5488858a27e646f6352558fb7ad090d0b3f03c2c58f1d650cba01"}
Sep 05 06:33:32.563215 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:32.563202    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz"
Sep 05 06:33:32.564325 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:32.564306    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz"
Sep 05 06:33:34.579517 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:34.579430    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-qzlvk" event={"ID":"591433e0-9a8b-472a-9d1b-fa09be16c023","Type":"ContainerStarted","Data":"ff1768ac685da77780ae6a447648c18ad41bede290dcbc5cbf19b06451a65739"}
Sep 05 06:33:34.579517 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:34.579489    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-qzlvk"
Sep 05 06:33:34.594318 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:34.594267    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-qzlvk" podStartSLOduration=1.901599537 podStartE2EDuration="3.59425029s" totalImagesPullingTime="1.692650753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:33:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:33:34.593874628 +0000 UTC m=+480.567629303" watchObservedRunningTime="2026-09-05 06:33:34.59425029 +0000 UTC m=+480.568004964"
Sep 05 06:33:38.513729 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:38.513686    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-688d76797b-np4pr"]
Sep 05 06:33:38.518575 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:38.518551    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-688d76797b-np4pr"
Sep 05 06:33:38.522780 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:38.522754    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 05 06:33:38.523859 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:38.523834    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-kdznw\""
Sep 05 06:33:38.523859 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:38.523859    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 05 06:33:38.524161 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:38.524145    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 05 06:33:38.524230 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:38.524186    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 05 06:33:38.524283 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:38.524246    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 05 06:33:38.538275 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:38.538237    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-688d76797b-np4pr"]
Sep 05 06:33:38.673537 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:38.673496    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1c88d6af-8b4a-416b-9f44-a8e31947965e-metrics-cert\") pod \"lws-controller-manager-688d76797b-np4pr\" (UID: \"1c88d6af-8b4a-416b-9f44-a8e31947965e\") " pod="openshift-lws-operator/lws-controller-manager-688d76797b-np4pr"
Sep 05 06:33:38.673734 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:38.673552    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c88d6af-8b4a-416b-9f44-a8e31947965e-cert\") pod \"lws-controller-manager-688d76797b-np4pr\" (UID: \"1c88d6af-8b4a-416b-9f44-a8e31947965e\") " pod="openshift-lws-operator/lws-controller-manager-688d76797b-np4pr"
Sep 05 06:33:38.673734 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:38.673576    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1c88d6af-8b4a-416b-9f44-a8e31947965e-manager-config\") pod \"lws-controller-manager-688d76797b-np4pr\" (UID: \"1c88d6af-8b4a-416b-9f44-a8e31947965e\") " pod="openshift-lws-operator/lws-controller-manager-688d76797b-np4pr"
Sep 05 06:33:38.673734 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:38.673601    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtvn6\" (UniqueName: \"kubernetes.io/projected/1c88d6af-8b4a-416b-9f44-a8e31947965e-kube-api-access-vtvn6\") pod \"lws-controller-manager-688d76797b-np4pr\" (UID: \"1c88d6af-8b4a-416b-9f44-a8e31947965e\") " pod="openshift-lws-operator/lws-controller-manager-688d76797b-np4pr"
Sep 05 06:33:38.774672 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:38.774589    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1c88d6af-8b4a-416b-9f44-a8e31947965e-metrics-cert\") pod \"lws-controller-manager-688d76797b-np4pr\" (UID: \"1c88d6af-8b4a-416b-9f44-a8e31947965e\") " pod="openshift-lws-operator/lws-controller-manager-688d76797b-np4pr"
Sep 05 06:33:38.774672 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:38.774643    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c88d6af-8b4a-416b-9f44-a8e31947965e-cert\") pod \"lws-controller-manager-688d76797b-np4pr\" (UID: \"1c88d6af-8b4a-416b-9f44-a8e31947965e\") " pod="openshift-lws-operator/lws-controller-manager-688d76797b-np4pr"
Sep 05 06:33:38.774830 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:38.774752    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1c88d6af-8b4a-416b-9f44-a8e31947965e-manager-config\") pod \"lws-controller-manager-688d76797b-np4pr\" (UID: \"1c88d6af-8b4a-416b-9f44-a8e31947965e\") " pod="openshift-lws-operator/lws-controller-manager-688d76797b-np4pr"
Sep 05 06:33:38.774830 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:38.774786    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtvn6\" (UniqueName: \"kubernetes.io/projected/1c88d6af-8b4a-416b-9f44-a8e31947965e-kube-api-access-vtvn6\") pod \"lws-controller-manager-688d76797b-np4pr\" (UID: \"1c88d6af-8b4a-416b-9f44-a8e31947965e\") " pod="openshift-lws-operator/lws-controller-manager-688d76797b-np4pr"
Sep 05 06:33:38.775470 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:38.775444    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1c88d6af-8b4a-416b-9f44-a8e31947965e-manager-config\") pod \"lws-controller-manager-688d76797b-np4pr\" (UID: \"1c88d6af-8b4a-416b-9f44-a8e31947965e\") " pod="openshift-lws-operator/lws-controller-manager-688d76797b-np4pr"
Sep 05 06:33:38.777458 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:38.777426    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1c88d6af-8b4a-416b-9f44-a8e31947965e-metrics-cert\") pod \"lws-controller-manager-688d76797b-np4pr\" (UID: \"1c88d6af-8b4a-416b-9f44-a8e31947965e\") " pod="openshift-lws-operator/lws-controller-manager-688d76797b-np4pr"
Sep 05 06:33:38.777582 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:38.777524    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c88d6af-8b4a-416b-9f44-a8e31947965e-cert\") pod \"lws-controller-manager-688d76797b-np4pr\" (UID: \"1c88d6af-8b4a-416b-9f44-a8e31947965e\") " pod="openshift-lws-operator/lws-controller-manager-688d76797b-np4pr"
Sep 05 06:33:38.784396 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:38.784370    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtvn6\" (UniqueName: \"kubernetes.io/projected/1c88d6af-8b4a-416b-9f44-a8e31947965e-kube-api-access-vtvn6\") pod \"lws-controller-manager-688d76797b-np4pr\" (UID: \"1c88d6af-8b4a-416b-9f44-a8e31947965e\") " pod="openshift-lws-operator/lws-controller-manager-688d76797b-np4pr"
Sep 05 06:33:38.828737 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:38.828700    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-688d76797b-np4pr"
Sep 05 06:33:39.114683 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:39.114652    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-688d76797b-np4pr"]
Sep 05 06:33:39.116350 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:33:39.116324    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c88d6af_8b4a_416b_9f44_a8e31947965e.slice/crio-e062f67f4280b871227ca0e38409d02c1ef77b01f66deb1203008a920c395fb1 WatchSource:0}: Error finding container e062f67f4280b871227ca0e38409d02c1ef77b01f66deb1203008a920c395fb1: Status 404 returned error can't find the container with id e062f67f4280b871227ca0e38409d02c1ef77b01f66deb1203008a920c395fb1
Sep 05 06:33:39.596730 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:39.596695    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-688d76797b-np4pr" event={"ID":"1c88d6af-8b4a-416b-9f44-a8e31947965e","Type":"ContainerStarted","Data":"e062f67f4280b871227ca0e38409d02c1ef77b01f66deb1203008a920c395fb1"}
Sep 05 06:33:41.606925 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:41.606888    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-688d76797b-np4pr" event={"ID":"1c88d6af-8b4a-416b-9f44-a8e31947965e","Type":"ContainerStarted","Data":"09f8d3c2bffc29e2fb94fc683c501c2dfe248ed3aa092fab171ca070347ca4fc"}
Sep 05 06:33:41.607371 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:41.606998    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-688d76797b-np4pr"
Sep 05 06:33:41.629894 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:41.629836    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-688d76797b-np4pr" podStartSLOduration=1.354946581 podStartE2EDuration="3.629817052s" totalImagesPullingTime="2.274870471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:33:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:33:41.628505207 +0000 UTC m=+487.602259884" watchObservedRunningTime="2026-09-05 06:33:41.629817052 +0000 UTC m=+487.603571794"
Sep 05 06:33:45.583947 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:45.583915    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-qzlvk"
Sep 05 06:33:52.613889 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:33:52.613857    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-688d76797b-np4pr"
Sep 05 06:35:34.485569 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:34.485539    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bb4_7f8a8f16-2422-4c01-a619-1f17fe10cd4c/ovn-acl-logging/0.log"
Sep 05 06:35:34.486130 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:34.486114    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bb4_7f8a8f16-2422-4c01-a619-1f17fe10cd4c/ovn-acl-logging/0.log"
Sep 05 06:35:45.767337 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:45.767306    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"]
Sep 05 06:35:45.770736 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:45.770712    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"
Sep 05 06:35:45.773340 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:45.773317    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-4mfbw\""
Sep 05 06:35:45.782944 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:45.782921    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"]
Sep 05 06:35:45.888254 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:45.888217    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ce163ec-61e7-445e-96a7-8a90054949e8-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6v9xh\" (UID: \"5ce163ec-61e7-445e-96a7-8a90054949e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"
Sep 05 06:35:45.888425 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:45.888273    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ce163ec-61e7-445e-96a7-8a90054949e8-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6v9xh\" (UID: \"5ce163ec-61e7-445e-96a7-8a90054949e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"
Sep 05 06:35:45.888425 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:45.888336    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ce163ec-61e7-445e-96a7-8a90054949e8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6v9xh\" (UID: \"5ce163ec-61e7-445e-96a7-8a90054949e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"
Sep 05 06:35:45.888425 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:45.888386    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-587pv\" (UniqueName: \"kubernetes.io/projected/5ce163ec-61e7-445e-96a7-8a90054949e8-kube-api-access-587pv\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6v9xh\" (UID: \"5ce163ec-61e7-445e-96a7-8a90054949e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"
Sep 05 06:35:45.888425 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:45.888421    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ce163ec-61e7-445e-96a7-8a90054949e8-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6v9xh\" (UID: \"5ce163ec-61e7-445e-96a7-8a90054949e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"
Sep 05 06:35:45.888563 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:45.888444    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ce163ec-61e7-445e-96a7-8a90054949e8-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6v9xh\" (UID: \"5ce163ec-61e7-445e-96a7-8a90054949e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"
Sep 05 06:35:45.888563 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:45.888467    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ce163ec-61e7-445e-96a7-8a90054949e8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6v9xh\" (UID: \"5ce163ec-61e7-445e-96a7-8a90054949e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"
Sep 05 06:35:45.888563 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:45.888527    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ce163ec-61e7-445e-96a7-8a90054949e8-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6v9xh\" (UID: \"5ce163ec-61e7-445e-96a7-8a90054949e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"
Sep 05 06:35:45.888658 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:45.888562    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ce163ec-61e7-445e-96a7-8a90054949e8-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6v9xh\" (UID: \"5ce163ec-61e7-445e-96a7-8a90054949e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"
Sep 05 06:35:45.989450 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:45.989413    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ce163ec-61e7-445e-96a7-8a90054949e8-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6v9xh\" (UID: \"5ce163ec-61e7-445e-96a7-8a90054949e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"
Sep 05 06:35:45.989620 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:45.989469    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ce163ec-61e7-445e-96a7-8a90054949e8-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6v9xh\" (UID: \"5ce163ec-61e7-445e-96a7-8a90054949e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"
Sep 05 06:35:45.989620 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:45.989496    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ce163ec-61e7-445e-96a7-8a90054949e8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6v9xh\" (UID: \"5ce163ec-61e7-445e-96a7-8a90054949e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"
Sep 05 06:35:45.989620 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:45.989534    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-587pv\" (UniqueName: \"kubernetes.io/projected/5ce163ec-61e7-445e-96a7-8a90054949e8-kube-api-access-587pv\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6v9xh\" (UID: \"5ce163ec-61e7-445e-96a7-8a90054949e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"
Sep 05 06:35:45.989789 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:45.989734    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ce163ec-61e7-445e-96a7-8a90054949e8-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6v9xh\" (UID: \"5ce163ec-61e7-445e-96a7-8a90054949e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"
Sep 05 06:35:45.989789 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:45.989777    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ce163ec-61e7-445e-96a7-8a90054949e8-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6v9xh\" (UID: \"5ce163ec-61e7-445e-96a7-8a90054949e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"
Sep 05 06:35:45.989889 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:45.989831    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ce163ec-61e7-445e-96a7-8a90054949e8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6v9xh\" (UID: \"5ce163ec-61e7-445e-96a7-8a90054949e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"
Sep 05 06:35:45.989939 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:45.989906    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ce163ec-61e7-445e-96a7-8a90054949e8-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6v9xh\" (UID: \"5ce163ec-61e7-445e-96a7-8a90054949e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"
Sep 05 06:35:45.989992 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:45.989964    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ce163ec-61e7-445e-96a7-8a90054949e8-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6v9xh\" (UID: \"5ce163ec-61e7-445e-96a7-8a90054949e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"
Sep 05 06:35:45.990074 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:45.990042    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ce163ec-61e7-445e-96a7-8a90054949e8-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6v9xh\" (UID: \"5ce163ec-61e7-445e-96a7-8a90054949e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"
Sep 05 06:35:45.990138 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:45.990095    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ce163ec-61e7-445e-96a7-8a90054949e8-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6v9xh\" (UID: \"5ce163ec-61e7-445e-96a7-8a90054949e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"
Sep 05 06:35:45.990208 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:45.990181    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ce163ec-61e7-445e-96a7-8a90054949e8-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6v9xh\" (UID: \"5ce163ec-61e7-445e-96a7-8a90054949e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"
Sep 05 06:35:45.990397 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:45.990379    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ce163ec-61e7-445e-96a7-8a90054949e8-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6v9xh\" (UID: \"5ce163ec-61e7-445e-96a7-8a90054949e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"
Sep 05 06:35:45.990565 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:45.990547    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ce163ec-61e7-445e-96a7-8a90054949e8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6v9xh\" (UID: \"5ce163ec-61e7-445e-96a7-8a90054949e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"
Sep 05 06:35:45.992550 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:45.992533    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ce163ec-61e7-445e-96a7-8a90054949e8-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6v9xh\" (UID: \"5ce163ec-61e7-445e-96a7-8a90054949e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"
Sep 05 06:35:45.992749 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:45.992731    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ce163ec-61e7-445e-96a7-8a90054949e8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6v9xh\" (UID: \"5ce163ec-61e7-445e-96a7-8a90054949e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"
Sep 05 06:35:45.998598 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:45.998577    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ce163ec-61e7-445e-96a7-8a90054949e8-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6v9xh\" (UID: \"5ce163ec-61e7-445e-96a7-8a90054949e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"
Sep 05 06:35:45.999378 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:45.999345    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-587pv\" (UniqueName: \"kubernetes.io/projected/5ce163ec-61e7-445e-96a7-8a90054949e8-kube-api-access-587pv\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6v9xh\" (UID: \"5ce163ec-61e7-445e-96a7-8a90054949e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"
Sep 05 06:35:46.081226 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:46.081128    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"
Sep 05 06:35:46.356235 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:46.356153    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"]
Sep 05 06:35:46.359919 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:35:46.359891    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ce163ec_61e7_445e_96a7_8a90054949e8.slice/crio-1248485247d86c7c41d5eae7f0b103153d5a074195adcca6bfa8821cee625f90 WatchSource:0}: Error finding container 1248485247d86c7c41d5eae7f0b103153d5a074195adcca6bfa8821cee625f90: Status 404 returned error can't find the container with id 1248485247d86c7c41d5eae7f0b103153d5a074195adcca6bfa8821cee625f90
Sep 05 06:35:46.362064 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:46.362012    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:35:46.362172 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:46.362097    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:35:46.362172 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:46.362126    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:35:47.152178 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:47.152136    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh" event={"ID":"5ce163ec-61e7-445e-96a7-8a90054949e8","Type":"ContainerStarted","Data":"2e56c4eeb87e226f29b9ecca4f2f1c35e325d15509d0a0709fb4e425b4cd96f8"}
Sep 05 06:35:47.152626 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:47.152196    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh" event={"ID":"5ce163ec-61e7-445e-96a7-8a90054949e8","Type":"ContainerStarted","Data":"1248485247d86c7c41d5eae7f0b103153d5a074195adcca6bfa8821cee625f90"}
Sep 05 06:35:47.176324 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:47.176265    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh" podStartSLOduration=2.176246261 podStartE2EDuration="2.176246261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:35:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:35:47.174282329 +0000 UTC m=+613.148037011" watchObservedRunningTime="2026-09-05 06:35:47.176246261 +0000 UTC m=+613.150000938"
Sep 05 06:35:48.081492 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:48.081455    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"
Sep 05 06:35:48.086293 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:48.086270    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"
Sep 05 06:35:48.157421 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:48.157366    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"
Sep 05 06:35:48.158395 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:35:48.158373    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"
Sep 05 06:36:02.272304 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:02.272218    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-wp8d8"]
Sep 05 06:36:02.275508 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:02.275489    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-wp8d8"
Sep 05 06:36:02.278344 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:02.278327    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-fgrcs\""
Sep 05 06:36:02.279437 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:02.279421    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 05 06:36:02.279495 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:02.279446    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 05 06:36:02.283378 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:02.283282    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-wp8d8"]
Sep 05 06:36:02.446643 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:02.446603    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8wd8\" (UniqueName: \"kubernetes.io/projected/39c64785-fc82-4dd9-8a7b-677fac075000-kube-api-access-q8wd8\") pod \"authorino-b54df94b4-wp8d8\" (UID: \"39c64785-fc82-4dd9-8a7b-677fac075000\") " pod="kuadrant-system/authorino-b54df94b4-wp8d8"
Sep 05 06:36:02.547640 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:02.547535    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8wd8\" (UniqueName: \"kubernetes.io/projected/39c64785-fc82-4dd9-8a7b-677fac075000-kube-api-access-q8wd8\") pod \"authorino-b54df94b4-wp8d8\" (UID: \"39c64785-fc82-4dd9-8a7b-677fac075000\") " pod="kuadrant-system/authorino-b54df94b4-wp8d8"
Sep 05 06:36:02.556599 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:02.556571    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8wd8\" (UniqueName: \"kubernetes.io/projected/39c64785-fc82-4dd9-8a7b-677fac075000-kube-api-access-q8wd8\") pod \"authorino-b54df94b4-wp8d8\" (UID: \"39c64785-fc82-4dd9-8a7b-677fac075000\") " pod="kuadrant-system/authorino-b54df94b4-wp8d8"
Sep 05 06:36:02.598960 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:02.598922    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-wp8d8"
Sep 05 06:36:02.872603 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:02.872577    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-wp8d8"]
Sep 05 06:36:02.874489 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:36:02.874457    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39c64785_fc82_4dd9_8a7b_677fac075000.slice/crio-7e6ac28f5871036ac96c204c87199ca974383dcec0fefe791bfed578f3647410 WatchSource:0}: Error finding container 7e6ac28f5871036ac96c204c87199ca974383dcec0fefe791bfed578f3647410: Status 404 returned error can't find the container with id 7e6ac28f5871036ac96c204c87199ca974383dcec0fefe791bfed578f3647410
Sep 05 06:36:03.228955 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:03.228913    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-wp8d8" event={"ID":"39c64785-fc82-4dd9-8a7b-677fac075000","Type":"ContainerStarted","Data":"7e6ac28f5871036ac96c204c87199ca974383dcec0fefe791bfed578f3647410"}
Sep 05 06:36:05.576120 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:05.576078    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-wp8d8"]
Sep 05 06:36:06.245381 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:06.245349    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-wp8d8" event={"ID":"39c64785-fc82-4dd9-8a7b-677fac075000","Type":"ContainerStarted","Data":"76dfccef50ffa486fca8c255ed6f01784f8f28e546e48b82e9ae7dacfb8dc379"}
Sep 05 06:36:06.262750 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:06.262695    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-wp8d8" podStartSLOduration=1.759123174 podStartE2EDuration="4.262675898s" totalImagesPullingTime="2.503552724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:36:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:36:06.260823191 +0000 UTC m=+632.234577866" watchObservedRunningTime="2026-09-05 06:36:06.262675898 +0000 UTC m=+632.236430611"
Sep 05 06:36:07.249739 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:07.249691    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-wp8d8" podUID="39c64785-fc82-4dd9-8a7b-677fac075000" containerName="authorino" containerID="cri-o://76dfccef50ffa486fca8c255ed6f01784f8f28e546e48b82e9ae7dacfb8dc379" gracePeriod=30
Sep 05 06:36:07.489516 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:07.489489    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-wp8d8"
Sep 05 06:36:07.600487 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:07.600397    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8wd8\" (UniqueName: \"kubernetes.io/projected/39c64785-fc82-4dd9-8a7b-677fac075000-kube-api-access-q8wd8\") pod \"39c64785-fc82-4dd9-8a7b-677fac075000\" (UID: \"39c64785-fc82-4dd9-8a7b-677fac075000\") "
Sep 05 06:36:07.602721 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:07.602698    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39c64785-fc82-4dd9-8a7b-677fac075000-kube-api-access-q8wd8" (OuterVolumeSpecName: "kube-api-access-q8wd8") pod "39c64785-fc82-4dd9-8a7b-677fac075000" (UID: "39c64785-fc82-4dd9-8a7b-677fac075000"). InnerVolumeSpecName "kube-api-access-q8wd8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:36:07.701446 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:07.701403    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8wd8\" (UniqueName: \"kubernetes.io/projected/39c64785-fc82-4dd9-8a7b-677fac075000-kube-api-access-q8wd8\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:36:08.255326 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:08.255295    2567 generic.go:356] "Generic (PLEG): container finished" podID="39c64785-fc82-4dd9-8a7b-677fac075000" containerID="76dfccef50ffa486fca8c255ed6f01784f8f28e546e48b82e9ae7dacfb8dc379" exitCode=0
Sep 05 06:36:08.255326 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:08.255326    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-wp8d8"
Sep 05 06:36:08.255815 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:08.255347    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-wp8d8" event={"ID":"39c64785-fc82-4dd9-8a7b-677fac075000","Type":"ContainerDied","Data":"76dfccef50ffa486fca8c255ed6f01784f8f28e546e48b82e9ae7dacfb8dc379"}
Sep 05 06:36:08.255815 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:08.255380    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-wp8d8" event={"ID":"39c64785-fc82-4dd9-8a7b-677fac075000","Type":"ContainerDied","Data":"7e6ac28f5871036ac96c204c87199ca974383dcec0fefe791bfed578f3647410"}
Sep 05 06:36:08.255815 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:08.255397    2567 scope.go:117] "RemoveContainer" containerID="76dfccef50ffa486fca8c255ed6f01784f8f28e546e48b82e9ae7dacfb8dc379"
Sep 05 06:36:08.264148 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:08.264131    2567 scope.go:117] "RemoveContainer" containerID="76dfccef50ffa486fca8c255ed6f01784f8f28e546e48b82e9ae7dacfb8dc379"
Sep 05 06:36:08.264428 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:36:08.264408    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76dfccef50ffa486fca8c255ed6f01784f8f28e546e48b82e9ae7dacfb8dc379\": container with ID starting with 76dfccef50ffa486fca8c255ed6f01784f8f28e546e48b82e9ae7dacfb8dc379 not found: ID does not exist" containerID="76dfccef50ffa486fca8c255ed6f01784f8f28e546e48b82e9ae7dacfb8dc379"
Sep 05 06:36:08.264488 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:08.264437    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76dfccef50ffa486fca8c255ed6f01784f8f28e546e48b82e9ae7dacfb8dc379"} err="failed to get container status \"76dfccef50ffa486fca8c255ed6f01784f8f28e546e48b82e9ae7dacfb8dc379\": rpc error: code = NotFound desc = could not find container \"76dfccef50ffa486fca8c255ed6f01784f8f28e546e48b82e9ae7dacfb8dc379\": container with ID starting with 76dfccef50ffa486fca8c255ed6f01784f8f28e546e48b82e9ae7dacfb8dc379 not found: ID does not exist"
Sep 05 06:36:08.277455 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:08.277430    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-wp8d8"]
Sep 05 06:36:08.285054 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:08.285012    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-wp8d8"]
Sep 05 06:36:08.580583 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:08.580501    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39c64785-fc82-4dd9-8a7b-677fac075000" path="/var/lib/kubelet/pods/39c64785-fc82-4dd9-8a7b-677fac075000/volumes"
Sep 05 06:36:32.809626 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:32.809595    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-s9xz8"]
Sep 05 06:36:32.812172 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:32.810012    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39c64785-fc82-4dd9-8a7b-677fac075000" containerName="authorino"
Sep 05 06:36:32.812172 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:32.810044    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="39c64785-fc82-4dd9-8a7b-677fac075000" containerName="authorino"
Sep 05 06:36:32.812172 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:32.810099    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="39c64785-fc82-4dd9-8a7b-677fac075000" containerName="authorino"
Sep 05 06:36:32.813012 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:32.812991    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-s9xz8"
Sep 05 06:36:32.815757 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:32.815651    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 05 06:36:32.815757 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:32.815739    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 05 06:36:32.816752 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:32.816736    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-fgrcs\""
Sep 05 06:36:32.820535 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:32.820508    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-s9xz8"]
Sep 05 06:36:32.926383 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:32.926352    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f4zq\" (UniqueName: \"kubernetes.io/projected/a2b508e8-1707-483d-9ddd-fd0bfede953c-kube-api-access-8f4zq\") pod \"authorino-5dc7ccb5f-s9xz8\" (UID: \"a2b508e8-1707-483d-9ddd-fd0bfede953c\") " pod="kuadrant-system/authorino-5dc7ccb5f-s9xz8"
Sep 05 06:36:33.027149 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:33.027103    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f4zq\" (UniqueName: \"kubernetes.io/projected/a2b508e8-1707-483d-9ddd-fd0bfede953c-kube-api-access-8f4zq\") pod \"authorino-5dc7ccb5f-s9xz8\" (UID: \"a2b508e8-1707-483d-9ddd-fd0bfede953c\") " pod="kuadrant-system/authorino-5dc7ccb5f-s9xz8"
Sep 05 06:36:33.035747 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:33.035717    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f4zq\" (UniqueName: \"kubernetes.io/projected/a2b508e8-1707-483d-9ddd-fd0bfede953c-kube-api-access-8f4zq\") pod \"authorino-5dc7ccb5f-s9xz8\" (UID: \"a2b508e8-1707-483d-9ddd-fd0bfede953c\") " pod="kuadrant-system/authorino-5dc7ccb5f-s9xz8"
Sep 05 06:36:33.061668 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:33.061601    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-s9xz8"]
Sep 05 06:36:33.061886 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:33.061874    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-s9xz8"
Sep 05 06:36:33.238711 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:33.238679    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-69fd7d6787-kf4j8"]
Sep 05 06:36:33.242096 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:33.242080    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69fd7d6787-kf4j8"
Sep 05 06:36:33.244806 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:33.244782    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 05 06:36:33.249897 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:33.249778    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-69fd7d6787-kf4j8"]
Sep 05 06:36:33.329675 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:33.329505    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klrrf\" (UniqueName: \"kubernetes.io/projected/d03e2abf-1d59-4386-8df5-ae1bb7c6865f-kube-api-access-klrrf\") pod \"authorino-69fd7d6787-kf4j8\" (UID: \"d03e2abf-1d59-4386-8df5-ae1bb7c6865f\") " pod="kuadrant-system/authorino-69fd7d6787-kf4j8"
Sep 05 06:36:33.329855 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:33.329766    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d03e2abf-1d59-4386-8df5-ae1bb7c6865f-tls-cert\") pod \"authorino-69fd7d6787-kf4j8\" (UID: \"d03e2abf-1d59-4386-8df5-ae1bb7c6865f\") " pod="kuadrant-system/authorino-69fd7d6787-kf4j8"
Sep 05 06:36:33.331605 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:33.331588    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-s9xz8"]
Sep 05 06:36:33.333753 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:36:33.333731    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda2b508e8_1707_483d_9ddd_fd0bfede953c.slice/crio-1a4051dd627ab9ea2179368b2b1792d698cf6528942adbd5ed5129fd4eb20908 WatchSource:0}: Error finding container 1a4051dd627ab9ea2179368b2b1792d698cf6528942adbd5ed5129fd4eb20908: Status 404 returned error can't find the container with id 1a4051dd627ab9ea2179368b2b1792d698cf6528942adbd5ed5129fd4eb20908
Sep 05 06:36:33.368979 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:33.368950    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-s9xz8" event={"ID":"a2b508e8-1707-483d-9ddd-fd0bfede953c","Type":"ContainerStarted","Data":"1a4051dd627ab9ea2179368b2b1792d698cf6528942adbd5ed5129fd4eb20908"}
Sep 05 06:36:33.430894 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:33.430859    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klrrf\" (UniqueName: \"kubernetes.io/projected/d03e2abf-1d59-4386-8df5-ae1bb7c6865f-kube-api-access-klrrf\") pod \"authorino-69fd7d6787-kf4j8\" (UID: \"d03e2abf-1d59-4386-8df5-ae1bb7c6865f\") " pod="kuadrant-system/authorino-69fd7d6787-kf4j8"
Sep 05 06:36:33.431068 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:33.430912    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d03e2abf-1d59-4386-8df5-ae1bb7c6865f-tls-cert\") pod \"authorino-69fd7d6787-kf4j8\" (UID: \"d03e2abf-1d59-4386-8df5-ae1bb7c6865f\") " pod="kuadrant-system/authorino-69fd7d6787-kf4j8"
Sep 05 06:36:33.433453 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:33.433436    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d03e2abf-1d59-4386-8df5-ae1bb7c6865f-tls-cert\") pod \"authorino-69fd7d6787-kf4j8\" (UID: \"d03e2abf-1d59-4386-8df5-ae1bb7c6865f\") " pod="kuadrant-system/authorino-69fd7d6787-kf4j8"
Sep 05 06:36:33.440916 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:33.440894    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klrrf\" (UniqueName: \"kubernetes.io/projected/d03e2abf-1d59-4386-8df5-ae1bb7c6865f-kube-api-access-klrrf\") pod \"authorino-69fd7d6787-kf4j8\" (UID: \"d03e2abf-1d59-4386-8df5-ae1bb7c6865f\") " pod="kuadrant-system/authorino-69fd7d6787-kf4j8"
Sep 05 06:36:33.552841 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:33.552804    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69fd7d6787-kf4j8"
Sep 05 06:36:33.828636 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:33.828575    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-69fd7d6787-kf4j8"]
Sep 05 06:36:33.830806 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:36:33.830778    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd03e2abf_1d59_4386_8df5_ae1bb7c6865f.slice/crio-5a01a8b2620fbc599599a9eab1917a7e2cd152a773f8ce61dca2f988e19e4b81 WatchSource:0}: Error finding container 5a01a8b2620fbc599599a9eab1917a7e2cd152a773f8ce61dca2f988e19e4b81: Status 404 returned error can't find the container with id 5a01a8b2620fbc599599a9eab1917a7e2cd152a773f8ce61dca2f988e19e4b81
Sep 05 06:36:34.375549 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:34.375449    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69fd7d6787-kf4j8" event={"ID":"d03e2abf-1d59-4386-8df5-ae1bb7c6865f","Type":"ContainerStarted","Data":"5a01a8b2620fbc599599a9eab1917a7e2cd152a773f8ce61dca2f988e19e4b81"}
Sep 05 06:36:34.376839 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:34.376813    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-s9xz8" event={"ID":"a2b508e8-1707-483d-9ddd-fd0bfede953c","Type":"ContainerStarted","Data":"3e16083d5e0edcce2ba2226d6597fdc75d3a65e7760a9f074ff2d2c9a530dae6"}
Sep 05 06:36:34.376962 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:34.376912    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5dc7ccb5f-s9xz8" podUID="a2b508e8-1707-483d-9ddd-fd0bfede953c" containerName="authorino" containerID="cri-o://3e16083d5e0edcce2ba2226d6597fdc75d3a65e7760a9f074ff2d2c9a530dae6" gracePeriod=30
Sep 05 06:36:34.393806 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:34.393766    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5dc7ccb5f-s9xz8" podStartSLOduration=1.726831641 podStartE2EDuration="2.393750824s" totalImagesPullingTime="666.919183ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:36:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:36:34.392503365 +0000 UTC m=+660.366258042" watchObservedRunningTime="2026-09-05 06:36:34.393750824 +0000 UTC m=+660.367505499"
Sep 05 06:36:34.629240 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:34.629174    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-s9xz8"
Sep 05 06:36:34.743073 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:34.743020    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8f4zq\" (UniqueName: \"kubernetes.io/projected/a2b508e8-1707-483d-9ddd-fd0bfede953c-kube-api-access-8f4zq\") pod \"a2b508e8-1707-483d-9ddd-fd0bfede953c\" (UID: \"a2b508e8-1707-483d-9ddd-fd0bfede953c\") "
Sep 05 06:36:34.745304 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:34.745277    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2b508e8-1707-483d-9ddd-fd0bfede953c-kube-api-access-8f4zq" (OuterVolumeSpecName: "kube-api-access-8f4zq") pod "a2b508e8-1707-483d-9ddd-fd0bfede953c" (UID: "a2b508e8-1707-483d-9ddd-fd0bfede953c"). InnerVolumeSpecName "kube-api-access-8f4zq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:36:34.844329 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:34.844288    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8f4zq\" (UniqueName: \"kubernetes.io/projected/a2b508e8-1707-483d-9ddd-fd0bfede953c-kube-api-access-8f4zq\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:36:35.382614 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:35.382576    2567 generic.go:356] "Generic (PLEG): container finished" podID="a2b508e8-1707-483d-9ddd-fd0bfede953c" containerID="3e16083d5e0edcce2ba2226d6597fdc75d3a65e7760a9f074ff2d2c9a530dae6" exitCode=0
Sep 05 06:36:35.382824 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:35.382627    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-s9xz8"
Sep 05 06:36:35.382824 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:35.382664    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-s9xz8" event={"ID":"a2b508e8-1707-483d-9ddd-fd0bfede953c","Type":"ContainerDied","Data":"3e16083d5e0edcce2ba2226d6597fdc75d3a65e7760a9f074ff2d2c9a530dae6"}
Sep 05 06:36:35.382824 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:35.382708    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-s9xz8" event={"ID":"a2b508e8-1707-483d-9ddd-fd0bfede953c","Type":"ContainerDied","Data":"1a4051dd627ab9ea2179368b2b1792d698cf6528942adbd5ed5129fd4eb20908"}
Sep 05 06:36:35.382824 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:35.382726    2567 scope.go:117] "RemoveContainer" containerID="3e16083d5e0edcce2ba2226d6597fdc75d3a65e7760a9f074ff2d2c9a530dae6"
Sep 05 06:36:35.391524 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:35.391505    2567 scope.go:117] "RemoveContainer" containerID="3e16083d5e0edcce2ba2226d6597fdc75d3a65e7760a9f074ff2d2c9a530dae6"
Sep 05 06:36:35.391820 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:36:35.391800    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e16083d5e0edcce2ba2226d6597fdc75d3a65e7760a9f074ff2d2c9a530dae6\": container with ID starting with 3e16083d5e0edcce2ba2226d6597fdc75d3a65e7760a9f074ff2d2c9a530dae6 not found: ID does not exist" containerID="3e16083d5e0edcce2ba2226d6597fdc75d3a65e7760a9f074ff2d2c9a530dae6"
Sep 05 06:36:35.391886 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:35.391832    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e16083d5e0edcce2ba2226d6597fdc75d3a65e7760a9f074ff2d2c9a530dae6"} err="failed to get container status \"3e16083d5e0edcce2ba2226d6597fdc75d3a65e7760a9f074ff2d2c9a530dae6\": rpc error: code = NotFound desc = could not find container \"3e16083d5e0edcce2ba2226d6597fdc75d3a65e7760a9f074ff2d2c9a530dae6\": container with ID starting with 3e16083d5e0edcce2ba2226d6597fdc75d3a65e7760a9f074ff2d2c9a530dae6 not found: ID does not exist"
Sep 05 06:36:35.404641 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:35.404610    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-s9xz8"]
Sep 05 06:36:35.408965 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:35.408941    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-s9xz8"]
Sep 05 06:36:36.580883 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:36.580848    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2b508e8-1707-483d-9ddd-fd0bfede953c" path="/var/lib/kubelet/pods/a2b508e8-1707-483d-9ddd-fd0bfede953c/volumes"
Sep 05 06:36:45.431980 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:45.431942    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69fd7d6787-kf4j8" event={"ID":"d03e2abf-1d59-4386-8df5-ae1bb7c6865f","Type":"ContainerStarted","Data":"cabd4a8428eb36444c9a312511ad0f9c0b4adf76f9463d9d09f59748ff585e4f"}
Sep 05 06:36:45.449931 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:36:45.449810    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-69fd7d6787-kf4j8" podStartSLOduration=1.082589355 podStartE2EDuration="12.449795234s" totalImagesPullingTime="11.367205879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:36:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:36:45.447888676 +0000 UTC m=+671.421643352" watchObservedRunningTime="2026-09-05 06:36:45.449795234 +0000 UTC m=+671.423549908"
Sep 05 06:37:36.687725 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:37:36.687684    2567 generic.go:356] "Generic (PLEG): container finished" podID="5ce163ec-61e7-445e-96a7-8a90054949e8" containerID="2e56c4eeb87e226f29b9ecca4f2f1c35e325d15509d0a0709fb4e425b4cd96f8" exitCode=0
Sep 05 06:37:36.688320 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:37:36.687758    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh" event={"ID":"5ce163ec-61e7-445e-96a7-8a90054949e8","Type":"ContainerDied","Data":"2e56c4eeb87e226f29b9ecca4f2f1c35e325d15509d0a0709fb4e425b4cd96f8"}
Sep 05 06:37:36.688320 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:37:36.688200    2567 scope.go:117] "RemoveContainer" containerID="2e56c4eeb87e226f29b9ecca4f2f1c35e325d15509d0a0709fb4e425b4cd96f8"
Sep 05 06:37:36.689297 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:37:36.689268    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:37:36.689361 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:37:36.689339    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:37:36.689396 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:37:36.689374    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:37:37.693704 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:37:37.693662    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh" event={"ID":"5ce163ec-61e7-445e-96a7-8a90054949e8","Type":"ContainerStarted","Data":"f53b96b10bcba2402ffb432adc823125d3548e967bd5afe7e659e80bf7f71102"}
Sep 05 06:37:38.081854 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:37:38.081795    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"
Sep 05 06:37:38.082145 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:37:38.082117    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-6v9xh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Sep 05 06:37:38.082202 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:37:38.082175    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh" podUID="5ce163ec-61e7-445e-96a7-8a90054949e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Sep 05 06:37:39.082079 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:37:39.082004    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-6v9xh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Sep 05 06:37:39.082484 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:37:39.082119    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh" podUID="5ce163ec-61e7-445e-96a7-8a90054949e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Sep 05 06:37:40.081739 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:37:40.081697    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-6v9xh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Sep 05 06:37:40.081939 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:37:40.081774    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh" podUID="5ce163ec-61e7-445e-96a7-8a90054949e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Sep 05 06:37:41.082326 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:37:41.082281    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-6v9xh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Sep 05 06:37:41.082728 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:37:41.082344    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh" podUID="5ce163ec-61e7-445e-96a7-8a90054949e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Sep 05 06:37:42.081573 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:37:42.081528    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-6v9xh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Sep 05 06:37:42.081765 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:37:42.081587    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh" podUID="5ce163ec-61e7-445e-96a7-8a90054949e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Sep 05 06:37:43.085046 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:37:43.084996    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"
Sep 05 06:37:43.085530 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:37:43.085456    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"
Sep 05 06:37:43.086280 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:37:43.086262    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh"
Sep 05 06:38:11.857234 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:11.857187    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5g5rf"]
Sep 05 06:38:11.857825 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:11.857549    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2b508e8-1707-483d-9ddd-fd0bfede953c" containerName="authorino"
Sep 05 06:38:11.857825 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:11.857562    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2b508e8-1707-483d-9ddd-fd0bfede953c" containerName="authorino"
Sep 05 06:38:11.857825 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:11.857629    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2b508e8-1707-483d-9ddd-fd0bfede953c" containerName="authorino"
Sep 05 06:38:11.860602 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:11.860578    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5g5rf"
Sep 05 06:38:11.866106 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:11.866069    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 05 06:38:11.866106 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:11.866098    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wkllk\""
Sep 05 06:38:11.866326 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:11.866068    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 05 06:38:11.866326 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:11.866104    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 05 06:38:11.871423 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:11.871398    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5g5rf"]
Sep 05 06:38:12.043132 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:12.043097    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd8f9bc7-ef8b-409e-a929-3249dadbb73d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5g5rf\" (UID: \"dd8f9bc7-ef8b-409e-a929-3249dadbb73d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5g5rf"
Sep 05 06:38:12.043323 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:12.043137    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd8f9bc7-ef8b-409e-a929-3249dadbb73d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5g5rf\" (UID: \"dd8f9bc7-ef8b-409e-a929-3249dadbb73d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5g5rf"
Sep 05 06:38:12.043323 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:12.043162    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd8f9bc7-ef8b-409e-a929-3249dadbb73d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5g5rf\" (UID: \"dd8f9bc7-ef8b-409e-a929-3249dadbb73d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5g5rf"
Sep 05 06:38:12.043323 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:12.043261    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd8f9bc7-ef8b-409e-a929-3249dadbb73d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5g5rf\" (UID: \"dd8f9bc7-ef8b-409e-a929-3249dadbb73d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5g5rf"
Sep 05 06:38:12.043323 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:12.043291    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nrpf\" (UniqueName: \"kubernetes.io/projected/dd8f9bc7-ef8b-409e-a929-3249dadbb73d-kube-api-access-7nrpf\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5g5rf\" (UID: \"dd8f9bc7-ef8b-409e-a929-3249dadbb73d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5g5rf"
Sep 05 06:38:12.043323 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:12.043320    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd8f9bc7-ef8b-409e-a929-3249dadbb73d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5g5rf\" (UID: \"dd8f9bc7-ef8b-409e-a929-3249dadbb73d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5g5rf"
Sep 05 06:38:12.144234 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:12.144141    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd8f9bc7-ef8b-409e-a929-3249dadbb73d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5g5rf\" (UID: \"dd8f9bc7-ef8b-409e-a929-3249dadbb73d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5g5rf"
Sep 05 06:38:12.144234 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:12.144182    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd8f9bc7-ef8b-409e-a929-3249dadbb73d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5g5rf\" (UID: \"dd8f9bc7-ef8b-409e-a929-3249dadbb73d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5g5rf"
Sep 05 06:38:12.144234 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:12.144208    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd8f9bc7-ef8b-409e-a929-3249dadbb73d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5g5rf\" (UID: \"dd8f9bc7-ef8b-409e-a929-3249dadbb73d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5g5rf"
Sep 05 06:38:12.144234 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:12.144225    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nrpf\" (UniqueName: \"kubernetes.io/projected/dd8f9bc7-ef8b-409e-a929-3249dadbb73d-kube-api-access-7nrpf\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5g5rf\" (UID: \"dd8f9bc7-ef8b-409e-a929-3249dadbb73d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5g5rf"
Sep 05 06:38:12.144572 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:12.144246    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd8f9bc7-ef8b-409e-a929-3249dadbb73d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5g5rf\" (UID: \"dd8f9bc7-ef8b-409e-a929-3249dadbb73d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5g5rf"
Sep 05 06:38:12.144572 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:12.144343    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd8f9bc7-ef8b-409e-a929-3249dadbb73d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5g5rf\" (UID: \"dd8f9bc7-ef8b-409e-a929-3249dadbb73d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5g5rf"
Sep 05 06:38:12.144676 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:12.144604    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd8f9bc7-ef8b-409e-a929-3249dadbb73d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5g5rf\" (UID: \"dd8f9bc7-ef8b-409e-a929-3249dadbb73d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5g5rf"
Sep 05 06:38:12.144720 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:12.144696    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd8f9bc7-ef8b-409e-a929-3249dadbb73d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5g5rf\" (UID: \"dd8f9bc7-ef8b-409e-a929-3249dadbb73d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5g5rf"
Sep 05 06:38:12.144756 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:12.144724    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd8f9bc7-ef8b-409e-a929-3249dadbb73d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5g5rf\" (UID: \"dd8f9bc7-ef8b-409e-a929-3249dadbb73d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5g5rf"
Sep 05 06:38:12.146660 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:12.146634    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd8f9bc7-ef8b-409e-a929-3249dadbb73d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5g5rf\" (UID: \"dd8f9bc7-ef8b-409e-a929-3249dadbb73d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5g5rf"
Sep 05 06:38:12.146822 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:12.146803    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd8f9bc7-ef8b-409e-a929-3249dadbb73d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5g5rf\" (UID: \"dd8f9bc7-ef8b-409e-a929-3249dadbb73d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5g5rf"
Sep 05 06:38:12.155251 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:12.155226    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nrpf\" (UniqueName: \"kubernetes.io/projected/dd8f9bc7-ef8b-409e-a929-3249dadbb73d-kube-api-access-7nrpf\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5g5rf\" (UID: \"dd8f9bc7-ef8b-409e-a929-3249dadbb73d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5g5rf"
Sep 05 06:38:12.174116 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:12.174082    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5g5rf"
Sep 05 06:38:12.447480 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:12.447452    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5g5rf"]
Sep 05 06:38:12.449417 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:38:12.449392    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd8f9bc7_ef8b_409e_a929_3249dadbb73d.slice/crio-2ea1751e43345f0bc7d379f3e1963ddd670843ab695d8f1c00e92e6db0d3bdcc WatchSource:0}: Error finding container 2ea1751e43345f0bc7d379f3e1963ddd670843ab695d8f1c00e92e6db0d3bdcc: Status 404 returned error can't find the container with id 2ea1751e43345f0bc7d379f3e1963ddd670843ab695d8f1c00e92e6db0d3bdcc
Sep 05 06:38:12.450771 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:12.450754    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 05 06:38:12.873418 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:12.873324    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5g5rf" event={"ID":"dd8f9bc7-ef8b-409e-a929-3249dadbb73d","Type":"ContainerStarted","Data":"2ea1751e43345f0bc7d379f3e1963ddd670843ab695d8f1c00e92e6db0d3bdcc"}
Sep 05 06:38:13.879941 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:13.879898    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5g5rf" event={"ID":"dd8f9bc7-ef8b-409e-a929-3249dadbb73d","Type":"ContainerStarted","Data":"5ca672624067eee0b772efafd1a79710644267694ed83eca70e5052da9c40db7"}
Sep 05 06:38:13.905923 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:13.905866    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5g5rf" podStartSLOduration=1.9155587010000001 podStartE2EDuration="2.905849862s" totalImagesPullingTime="990.291161ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:38:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:38:13.903370063 +0000 UTC m=+759.877124753" watchObservedRunningTime="2026-09-05 06:38:13.905849862 +0000 UTC m=+759.879604528"
Sep 05 06:38:21.656206 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:21.656171    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8"]
Sep 05 06:38:21.659615 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:21.659596    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8"
Sep 05 06:38:21.662476 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:21.662447    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 05 06:38:21.673064 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:21.672992    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8"]
Sep 05 06:38:21.728555 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:21.728515    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a67fbf2a-2103-4d3a-b35c-99f3ba655a1d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8\" (UID: \"a67fbf2a-2103-4d3a-b35c-99f3ba655a1d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8"
Sep 05 06:38:21.728555 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:21.728557    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a67fbf2a-2103-4d3a-b35c-99f3ba655a1d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8\" (UID: \"a67fbf2a-2103-4d3a-b35c-99f3ba655a1d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8"
Sep 05 06:38:21.728780 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:21.728609    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a67fbf2a-2103-4d3a-b35c-99f3ba655a1d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8\" (UID: \"a67fbf2a-2103-4d3a-b35c-99f3ba655a1d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8"
Sep 05 06:38:21.728780 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:21.728626    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a67fbf2a-2103-4d3a-b35c-99f3ba655a1d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8\" (UID: \"a67fbf2a-2103-4d3a-b35c-99f3ba655a1d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8"
Sep 05 06:38:21.728780 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:21.728660    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdhmj\" (UniqueName: \"kubernetes.io/projected/a67fbf2a-2103-4d3a-b35c-99f3ba655a1d-kube-api-access-hdhmj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8\" (UID: \"a67fbf2a-2103-4d3a-b35c-99f3ba655a1d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8"
Sep 05 06:38:21.728780 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:21.728712    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a67fbf2a-2103-4d3a-b35c-99f3ba655a1d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8\" (UID: \"a67fbf2a-2103-4d3a-b35c-99f3ba655a1d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8"
Sep 05 06:38:21.829251 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:21.829210    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdhmj\" (UniqueName: \"kubernetes.io/projected/a67fbf2a-2103-4d3a-b35c-99f3ba655a1d-kube-api-access-hdhmj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8\" (UID: \"a67fbf2a-2103-4d3a-b35c-99f3ba655a1d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8"
Sep 05 06:38:21.829251 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:21.829255    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a67fbf2a-2103-4d3a-b35c-99f3ba655a1d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8\" (UID: \"a67fbf2a-2103-4d3a-b35c-99f3ba655a1d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8"
Sep 05 06:38:21.829456 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:21.829327    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a67fbf2a-2103-4d3a-b35c-99f3ba655a1d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8\" (UID: \"a67fbf2a-2103-4d3a-b35c-99f3ba655a1d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8"
Sep 05 06:38:21.829456 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:21.829354    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a67fbf2a-2103-4d3a-b35c-99f3ba655a1d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8\" (UID: \"a67fbf2a-2103-4d3a-b35c-99f3ba655a1d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8"
Sep 05 06:38:21.829456 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:21.829401    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a67fbf2a-2103-4d3a-b35c-99f3ba655a1d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8\" (UID: \"a67fbf2a-2103-4d3a-b35c-99f3ba655a1d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8"
Sep 05 06:38:21.829456 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:21.829426    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a67fbf2a-2103-4d3a-b35c-99f3ba655a1d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8\" (UID: \"a67fbf2a-2103-4d3a-b35c-99f3ba655a1d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8"
Sep 05 06:38:21.829854 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:21.829820    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a67fbf2a-2103-4d3a-b35c-99f3ba655a1d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8\" (UID: \"a67fbf2a-2103-4d3a-b35c-99f3ba655a1d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8"
Sep 05 06:38:21.829996 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:21.829879    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a67fbf2a-2103-4d3a-b35c-99f3ba655a1d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8\" (UID: \"a67fbf2a-2103-4d3a-b35c-99f3ba655a1d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8"
Sep 05 06:38:21.829996 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:21.829897    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a67fbf2a-2103-4d3a-b35c-99f3ba655a1d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8\" (UID: \"a67fbf2a-2103-4d3a-b35c-99f3ba655a1d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8"
Sep 05 06:38:21.831836 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:21.831813    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a67fbf2a-2103-4d3a-b35c-99f3ba655a1d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8\" (UID: \"a67fbf2a-2103-4d3a-b35c-99f3ba655a1d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8"
Sep 05 06:38:21.832006 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:21.831990    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a67fbf2a-2103-4d3a-b35c-99f3ba655a1d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8\" (UID: \"a67fbf2a-2103-4d3a-b35c-99f3ba655a1d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8"
Sep 05 06:38:21.839715 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:21.839696    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdhmj\" (UniqueName: \"kubernetes.io/projected/a67fbf2a-2103-4d3a-b35c-99f3ba655a1d-kube-api-access-hdhmj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8\" (UID: \"a67fbf2a-2103-4d3a-b35c-99f3ba655a1d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8"
Sep 05 06:38:21.969938 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:21.969907    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8"
Sep 05 06:38:22.175154 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:22.175114    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5g5rf"
Sep 05 06:38:22.175313 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:22.175261    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5g5rf"
Sep 05 06:38:22.187783 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:22.187760    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5g5rf"
Sep 05 06:38:22.242240 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:22.242215    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8"]
Sep 05 06:38:22.244374 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:38:22.244340    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda67fbf2a_2103_4d3a_b35c_99f3ba655a1d.slice/crio-c3555ca7d2de9b43a337e6d96cd3d9b61dc9868b7df1b18ab87e22eb3e1a822f WatchSource:0}: Error finding container c3555ca7d2de9b43a337e6d96cd3d9b61dc9868b7df1b18ab87e22eb3e1a822f: Status 404 returned error can't find the container with id c3555ca7d2de9b43a337e6d96cd3d9b61dc9868b7df1b18ab87e22eb3e1a822f
Sep 05 06:38:22.923859 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:22.923825    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8" event={"ID":"a67fbf2a-2103-4d3a-b35c-99f3ba655a1d","Type":"ContainerStarted","Data":"ea11b217e5150d4701c47d674bc627d416b045178728adec3fa3454681487976"}
Sep 05 06:38:22.924361 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:22.923882    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8" event={"ID":"a67fbf2a-2103-4d3a-b35c-99f3ba655a1d","Type":"ContainerStarted","Data":"c3555ca7d2de9b43a337e6d96cd3d9b61dc9868b7df1b18ab87e22eb3e1a822f"}
Sep 05 06:38:22.935180 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:22.935152    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5g5rf"
Sep 05 06:38:22.943734 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:22.943687    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8" podStartSLOduration=1.770367733 podStartE2EDuration="1.943672921s" totalImagesPullingTime="173.305188ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:38:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:38:22.942016856 +0000 UTC m=+768.915771523" watchObservedRunningTime="2026-09-05 06:38:22.943672921 +0000 UTC m=+768.917427596"
Sep 05 06:38:31.970556 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:31.970526    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8"
Sep 05 06:38:31.970970 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:31.970593    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8"
Sep 05 06:38:31.983034 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:31.983007    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8"
Sep 05 06:38:32.984365 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:38:32.984330    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8"
Sep 05 06:39:54.318678 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:39:54.318642    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f79bbd6d6-bc7xr"]
Sep 05 06:39:54.321955 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:39:54.321938    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f79bbd6d6-bc7xr"
Sep 05 06:39:54.332395 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:39:54.332369    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f79bbd6d6-bc7xr"]
Sep 05 06:39:54.405622 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:39:54.405582    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/14ff11ad-015c-49e2-967b-8218bd73c4dd-tls-cert\") pod \"authorino-6f79bbd6d6-bc7xr\" (UID: \"14ff11ad-015c-49e2-967b-8218bd73c4dd\") " pod="kuadrant-system/authorino-6f79bbd6d6-bc7xr"
Sep 05 06:39:54.405819 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:39:54.405646    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skktl\" (UniqueName: \"kubernetes.io/projected/14ff11ad-015c-49e2-967b-8218bd73c4dd-kube-api-access-skktl\") pod \"authorino-6f79bbd6d6-bc7xr\" (UID: \"14ff11ad-015c-49e2-967b-8218bd73c4dd\") " pod="kuadrant-system/authorino-6f79bbd6d6-bc7xr"
Sep 05 06:39:54.506264 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:39:54.506234    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skktl\" (UniqueName: \"kubernetes.io/projected/14ff11ad-015c-49e2-967b-8218bd73c4dd-kube-api-access-skktl\") pod \"authorino-6f79bbd6d6-bc7xr\" (UID: \"14ff11ad-015c-49e2-967b-8218bd73c4dd\") " pod="kuadrant-system/authorino-6f79bbd6d6-bc7xr"
Sep 05 06:39:54.506454 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:39:54.506306    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/14ff11ad-015c-49e2-967b-8218bd73c4dd-tls-cert\") pod \"authorino-6f79bbd6d6-bc7xr\" (UID: \"14ff11ad-015c-49e2-967b-8218bd73c4dd\") " pod="kuadrant-system/authorino-6f79bbd6d6-bc7xr"
Sep 05 06:39:54.508791 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:39:54.508765    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/14ff11ad-015c-49e2-967b-8218bd73c4dd-tls-cert\") pod \"authorino-6f79bbd6d6-bc7xr\" (UID: \"14ff11ad-015c-49e2-967b-8218bd73c4dd\") " pod="kuadrant-system/authorino-6f79bbd6d6-bc7xr"
Sep 05 06:39:54.516149 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:39:54.516129    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skktl\" (UniqueName: \"kubernetes.io/projected/14ff11ad-015c-49e2-967b-8218bd73c4dd-kube-api-access-skktl\") pod \"authorino-6f79bbd6d6-bc7xr\" (UID: \"14ff11ad-015c-49e2-967b-8218bd73c4dd\") " pod="kuadrant-system/authorino-6f79bbd6d6-bc7xr"
Sep 05 06:39:54.631200 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:39:54.631100    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f79bbd6d6-bc7xr"
Sep 05 06:39:54.900711 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:39:54.900607    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f79bbd6d6-bc7xr"]
Sep 05 06:39:54.903169 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:39:54.903136    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14ff11ad_015c_49e2_967b_8218bd73c4dd.slice/crio-adb4ba0d35d3ebf0b26ed02f50bd6173ee993558addb90559f8676714eaca693 WatchSource:0}: Error finding container adb4ba0d35d3ebf0b26ed02f50bd6173ee993558addb90559f8676714eaca693: Status 404 returned error can't find the container with id adb4ba0d35d3ebf0b26ed02f50bd6173ee993558addb90559f8676714eaca693
Sep 05 06:39:55.364760 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:39:55.364727    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f79bbd6d6-bc7xr" event={"ID":"14ff11ad-015c-49e2-967b-8218bd73c4dd","Type":"ContainerStarted","Data":"adb4ba0d35d3ebf0b26ed02f50bd6173ee993558addb90559f8676714eaca693"}
Sep 05 06:39:56.372501 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:39:56.372461    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f79bbd6d6-bc7xr" event={"ID":"14ff11ad-015c-49e2-967b-8218bd73c4dd","Type":"ContainerStarted","Data":"c513bde791a517f124786508a16ddc2e563099cb06a5c584921d60f5f6e2dac8"}
Sep 05 06:39:56.392756 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:39:56.392695    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6f79bbd6d6-bc7xr" podStartSLOduration=1.833466137 podStartE2EDuration="2.392667024s" totalImagesPullingTime="559.200887ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:39:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:39:56.392083007 +0000 UTC m=+862.365837683" watchObservedRunningTime="2026-09-05 06:39:56.392667024 +0000 UTC m=+862.366421701"
Sep 05 06:39:56.427560 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:39:56.427527    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-69fd7d6787-kf4j8"]
Sep 05 06:39:56.427743 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:39:56.427707    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-69fd7d6787-kf4j8" podUID="d03e2abf-1d59-4386-8df5-ae1bb7c6865f" containerName="authorino" containerID="cri-o://cabd4a8428eb36444c9a312511ad0f9c0b4adf76f9463d9d09f59748ff585e4f" gracePeriod=30
Sep 05 06:39:56.685606 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:39:56.685579    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69fd7d6787-kf4j8"
Sep 05 06:39:56.832153 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:39:56.832121    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d03e2abf-1d59-4386-8df5-ae1bb7c6865f-tls-cert\") pod \"d03e2abf-1d59-4386-8df5-ae1bb7c6865f\" (UID: \"d03e2abf-1d59-4386-8df5-ae1bb7c6865f\") "
Sep 05 06:39:56.832319 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:39:56.832164    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klrrf\" (UniqueName: \"kubernetes.io/projected/d03e2abf-1d59-4386-8df5-ae1bb7c6865f-kube-api-access-klrrf\") pod \"d03e2abf-1d59-4386-8df5-ae1bb7c6865f\" (UID: \"d03e2abf-1d59-4386-8df5-ae1bb7c6865f\") "
Sep 05 06:39:56.834377 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:39:56.834348    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d03e2abf-1d59-4386-8df5-ae1bb7c6865f-kube-api-access-klrrf" (OuterVolumeSpecName: "kube-api-access-klrrf") pod "d03e2abf-1d59-4386-8df5-ae1bb7c6865f" (UID: "d03e2abf-1d59-4386-8df5-ae1bb7c6865f"). InnerVolumeSpecName "kube-api-access-klrrf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:39:56.843997 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:39:56.843963    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d03e2abf-1d59-4386-8df5-ae1bb7c6865f-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "d03e2abf-1d59-4386-8df5-ae1bb7c6865f" (UID: "d03e2abf-1d59-4386-8df5-ae1bb7c6865f"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 05 06:39:56.933595 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:39:56.933510    2567 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d03e2abf-1d59-4386-8df5-ae1bb7c6865f-tls-cert\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:39:56.933595 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:39:56.933542    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klrrf\" (UniqueName: \"kubernetes.io/projected/d03e2abf-1d59-4386-8df5-ae1bb7c6865f-kube-api-access-klrrf\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:39:57.378512 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:39:57.378477    2567 generic.go:356] "Generic (PLEG): container finished" podID="d03e2abf-1d59-4386-8df5-ae1bb7c6865f" containerID="cabd4a8428eb36444c9a312511ad0f9c0b4adf76f9463d9d09f59748ff585e4f" exitCode=0
Sep 05 06:39:57.378962 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:39:57.378520    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69fd7d6787-kf4j8"
Sep 05 06:39:57.378962 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:39:57.378558    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69fd7d6787-kf4j8" event={"ID":"d03e2abf-1d59-4386-8df5-ae1bb7c6865f","Type":"ContainerDied","Data":"cabd4a8428eb36444c9a312511ad0f9c0b4adf76f9463d9d09f59748ff585e4f"}
Sep 05 06:39:57.378962 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:39:57.378599    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69fd7d6787-kf4j8" event={"ID":"d03e2abf-1d59-4386-8df5-ae1bb7c6865f","Type":"ContainerDied","Data":"5a01a8b2620fbc599599a9eab1917a7e2cd152a773f8ce61dca2f988e19e4b81"}
Sep 05 06:39:57.378962 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:39:57.378620    2567 scope.go:117] "RemoveContainer" containerID="cabd4a8428eb36444c9a312511ad0f9c0b4adf76f9463d9d09f59748ff585e4f"
Sep 05 06:39:57.395280 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:39:57.395258    2567 scope.go:117] "RemoveContainer" containerID="cabd4a8428eb36444c9a312511ad0f9c0b4adf76f9463d9d09f59748ff585e4f"
Sep 05 06:39:57.395611 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:39:57.395586    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cabd4a8428eb36444c9a312511ad0f9c0b4adf76f9463d9d09f59748ff585e4f\": container with ID starting with cabd4a8428eb36444c9a312511ad0f9c0b4adf76f9463d9d09f59748ff585e4f not found: ID does not exist" containerID="cabd4a8428eb36444c9a312511ad0f9c0b4adf76f9463d9d09f59748ff585e4f"
Sep 05 06:39:57.395700 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:39:57.395620    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cabd4a8428eb36444c9a312511ad0f9c0b4adf76f9463d9d09f59748ff585e4f"} err="failed to get container status \"cabd4a8428eb36444c9a312511ad0f9c0b4adf76f9463d9d09f59748ff585e4f\": rpc error: code = NotFound desc = could not find container \"cabd4a8428eb36444c9a312511ad0f9c0b4adf76f9463d9d09f59748ff585e4f\": container with ID starting with cabd4a8428eb36444c9a312511ad0f9c0b4adf76f9463d9d09f59748ff585e4f not found: ID does not exist"
Sep 05 06:39:57.407462 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:39:57.407435    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-69fd7d6787-kf4j8"]
Sep 05 06:39:57.411885 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:39:57.411861    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-69fd7d6787-kf4j8"]
Sep 05 06:39:58.582661 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:39:58.582626    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d03e2abf-1d59-4386-8df5-ae1bb7c6865f" path="/var/lib/kubelet/pods/d03e2abf-1d59-4386-8df5-ae1bb7c6865f/volumes"
Sep 05 06:40:15.075678 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.075642    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"]
Sep 05 06:40:15.076114 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.076099    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d03e2abf-1d59-4386-8df5-ae1bb7c6865f" containerName="authorino"
Sep 05 06:40:15.076170 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.076116    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d03e2abf-1d59-4386-8df5-ae1bb7c6865f" containerName="authorino"
Sep 05 06:40:15.076204 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.076183    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d03e2abf-1d59-4386-8df5-ae1bb7c6865f" containerName="authorino"
Sep 05 06:40:15.079473 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.079449    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:40:15.083197 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.083169    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-6efc3a-openshift-default-dockercfg-qzql7\""
Sep 05 06:40:15.098292 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.098257    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5034f8c0-a2dc-42cd-8691-d4dd18f38604-workload-socket\") pod \"e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm\" (UID: \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\") " pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:40:15.098504 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.098300    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5034f8c0-a2dc-42cd-8691-d4dd18f38604-credential-socket\") pod \"e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm\" (UID: \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\") " pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:40:15.098504 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.098326    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5034f8c0-a2dc-42cd-8691-d4dd18f38604-istio-data\") pod \"e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm\" (UID: \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\") " pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:40:15.098504 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.098351    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5034f8c0-a2dc-42cd-8691-d4dd18f38604-workload-certs\") pod \"e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm\" (UID: \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\") " pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:40:15.098504 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.098367    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5034f8c0-a2dc-42cd-8691-d4dd18f38604-istiod-ca-cert\") pod \"e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm\" (UID: \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\") " pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:40:15.098504 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.098382    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5034f8c0-a2dc-42cd-8691-d4dd18f38604-istio-token\") pod \"e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm\" (UID: \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\") " pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:40:15.098504 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.098407    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw5lv\" (UniqueName: \"kubernetes.io/projected/5034f8c0-a2dc-42cd-8691-d4dd18f38604-kube-api-access-rw5lv\") pod \"e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm\" (UID: \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\") " pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:40:15.098504 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.098486    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5034f8c0-a2dc-42cd-8691-d4dd18f38604-istio-podinfo\") pod \"e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm\" (UID: \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\") " pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:40:15.098852 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.098531    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5034f8c0-a2dc-42cd-8691-d4dd18f38604-istio-envoy\") pod \"e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm\" (UID: \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\") " pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:40:15.099983 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.099960    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"]
Sep 05 06:40:15.199003 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.198968    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5034f8c0-a2dc-42cd-8691-d4dd18f38604-istio-podinfo\") pod \"e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm\" (UID: \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\") " pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:40:15.199003 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.199010    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5034f8c0-a2dc-42cd-8691-d4dd18f38604-istio-envoy\") pod \"e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm\" (UID: \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\") " pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:40:15.199301 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.199088    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5034f8c0-a2dc-42cd-8691-d4dd18f38604-workload-socket\") pod \"e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm\" (UID: \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\") " pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:40:15.199301 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.199103    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5034f8c0-a2dc-42cd-8691-d4dd18f38604-credential-socket\") pod \"e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm\" (UID: \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\") " pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:40:15.199301 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.199119    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5034f8c0-a2dc-42cd-8691-d4dd18f38604-istio-data\") pod \"e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm\" (UID: \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\") " pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:40:15.199301 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.199138    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5034f8c0-a2dc-42cd-8691-d4dd18f38604-workload-certs\") pod \"e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm\" (UID: \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\") " pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:40:15.199301 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.199163    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5034f8c0-a2dc-42cd-8691-d4dd18f38604-istiod-ca-cert\") pod \"e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm\" (UID: \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\") " pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:40:15.199301 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.199186    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5034f8c0-a2dc-42cd-8691-d4dd18f38604-istio-token\") pod \"e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm\" (UID: \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\") " pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:40:15.199301 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.199209    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw5lv\" (UniqueName: \"kubernetes.io/projected/5034f8c0-a2dc-42cd-8691-d4dd18f38604-kube-api-access-rw5lv\") pod \"e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm\" (UID: \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\") " pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:40:15.199701 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.199648    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5034f8c0-a2dc-42cd-8691-d4dd18f38604-credential-socket\") pod \"e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm\" (UID: \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\") " pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:40:15.199701 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.199675    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5034f8c0-a2dc-42cd-8691-d4dd18f38604-istio-data\") pod \"e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm\" (UID: \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\") " pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:40:15.199830 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.199807    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5034f8c0-a2dc-42cd-8691-d4dd18f38604-workload-certs\") pod \"e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm\" (UID: \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\") " pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:40:15.199883 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.199845    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5034f8c0-a2dc-42cd-8691-d4dd18f38604-workload-socket\") pod \"e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm\" (UID: \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\") " pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:40:15.200669 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.200644    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5034f8c0-a2dc-42cd-8691-d4dd18f38604-istiod-ca-cert\") pod \"e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm\" (UID: \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\") " pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:40:15.201766 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.201733    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5034f8c0-a2dc-42cd-8691-d4dd18f38604-istio-envoy\") pod \"e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm\" (UID: \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\") " pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:40:15.202276 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.202257    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5034f8c0-a2dc-42cd-8691-d4dd18f38604-istio-podinfo\") pod \"e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm\" (UID: \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\") " pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:40:15.210283 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.210253    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw5lv\" (UniqueName: \"kubernetes.io/projected/5034f8c0-a2dc-42cd-8691-d4dd18f38604-kube-api-access-rw5lv\") pod \"e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm\" (UID: \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\") " pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:40:15.218949 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.218912    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5034f8c0-a2dc-42cd-8691-d4dd18f38604-istio-token\") pod \"e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm\" (UID: \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\") " pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:40:15.390265 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.390173    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:40:15.675338 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.675314    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"]
Sep 05 06:40:15.677584 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:40:15.677549    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5034f8c0_a2dc_42cd_8691_d4dd18f38604.slice/crio-1fc298a6f4b2c4a26116fe053e0eb50661f0f617f47a0e97b5b76067116c789b WatchSource:0}: Error finding container 1fc298a6f4b2c4a26116fe053e0eb50661f0f617f47a0e97b5b76067116c789b: Status 404 returned error can't find the container with id 1fc298a6f4b2c4a26116fe053e0eb50661f0f617f47a0e97b5b76067116c789b
Sep 05 06:40:15.679894 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.679861    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:40:15.679953 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.679927    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:40:15.679992 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:15.679957    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:40:16.477514 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:16.477474    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm" event={"ID":"5034f8c0-a2dc-42cd-8691-d4dd18f38604","Type":"ContainerStarted","Data":"2c03b632010b53004b419e1ae6fce49e99a5daac8fb0ccc21fdcc938d6634d6e"}
Sep 05 06:40:16.477961 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:16.477542    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm" event={"ID":"5034f8c0-a2dc-42cd-8691-d4dd18f38604","Type":"ContainerStarted","Data":"1fc298a6f4b2c4a26116fe053e0eb50661f0f617f47a0e97b5b76067116c789b"}
Sep 05 06:40:16.501501 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:16.501455    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm" podStartSLOduration=1.5014381540000001 podStartE2EDuration="1.501438154s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:40:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:40:16.499495291 +0000 UTC m=+882.473249968" watchObservedRunningTime="2026-09-05 06:40:16.501438154 +0000 UTC m=+882.475192828"
Sep 05 06:40:16.787589 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:16.787487    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8092-139855881662256"]
Sep 05 06:40:16.795138 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:16.795095    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8092-139855881662256"
Sep 05 06:40:16.798376 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:16.798167    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jntms\""
Sep 05 06:40:16.799447 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:16.799420    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8092-139855881662256"]
Sep 05 06:40:16.811406 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:16.811381    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22cdp\" (UniqueName: \"kubernetes.io/projected/2d347fa3-7db2-48e2-8028-faef17697bd2-kube-api-access-22cdp\") pod \"test-curl-8092-139855881662256\" (UID: \"2d347fa3-7db2-48e2-8028-faef17697bd2\") " pod="opendatahub/test-curl-8092-139855881662256"
Sep 05 06:40:16.911924 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:16.911881    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22cdp\" (UniqueName: \"kubernetes.io/projected/2d347fa3-7db2-48e2-8028-faef17697bd2-kube-api-access-22cdp\") pod \"test-curl-8092-139855881662256\" (UID: \"2d347fa3-7db2-48e2-8028-faef17697bd2\") " pod="opendatahub/test-curl-8092-139855881662256"
Sep 05 06:40:16.921468 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:16.921438    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22cdp\" (UniqueName: \"kubernetes.io/projected/2d347fa3-7db2-48e2-8028-faef17697bd2-kube-api-access-22cdp\") pod \"test-curl-8092-139855881662256\" (UID: \"2d347fa3-7db2-48e2-8028-faef17697bd2\") " pod="opendatahub/test-curl-8092-139855881662256"
Sep 05 06:40:17.106502 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:17.106409    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8092-139855881662256"
Sep 05 06:40:17.383804 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:17.383773    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8092-139855881662256"]
Sep 05 06:40:17.386619 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:40:17.386592    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d347fa3_7db2_48e2_8028_faef17697bd2.slice/crio-4cf1b173a1810269b01563b7b64dff7ba8c0bdab3852a7d50b583111168fb07d WatchSource:0}: Error finding container 4cf1b173a1810269b01563b7b64dff7ba8c0bdab3852a7d50b583111168fb07d: Status 404 returned error can't find the container with id 4cf1b173a1810269b01563b7b64dff7ba8c0bdab3852a7d50b583111168fb07d
Sep 05 06:40:17.390990 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:17.390963    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:40:17.398794 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:17.398762    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:40:17.484866 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:17.484831    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8092-139855881662256" event={"ID":"2d347fa3-7db2-48e2-8028-faef17697bd2","Type":"ContainerStarted","Data":"4cf1b173a1810269b01563b7b64dff7ba8c0bdab3852a7d50b583111168fb07d"}
Sep 05 06:40:17.485367 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:17.485139    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:40:17.486370 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:17.486341    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:40:19.498702 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:19.498672    2567 generic.go:356] "Generic (PLEG): container finished" podID="2d347fa3-7db2-48e2-8028-faef17697bd2" containerID="406afe0bf66b12a6eabb10d4eb8b4eaaf1f4d505d2ea34f2e04be0b9b3b2d81b" exitCode=0
Sep 05 06:40:19.499089 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:19.498727    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8092-139855881662256" event={"ID":"2d347fa3-7db2-48e2-8028-faef17697bd2","Type":"ContainerDied","Data":"406afe0bf66b12a6eabb10d4eb8b4eaaf1f4d505d2ea34f2e04be0b9b3b2d81b"}
Sep 05 06:40:20.654506 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:20.654481    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8092-139855881662256"
Sep 05 06:40:20.700554 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:20.700519    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-8092-139855881662256_2d347fa3-7db2-48e2-8028-faef17697bd2/test-curl-8092-139855881662256/0.log"
Sep 05 06:40:20.728508 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:20.728468    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8092-139855881662256"]
Sep 05 06:40:20.734571 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:20.734541    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8092-139855881662256"]
Sep 05 06:40:20.749764 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:20.749734    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22cdp\" (UniqueName: \"kubernetes.io/projected/2d347fa3-7db2-48e2-8028-faef17697bd2-kube-api-access-22cdp\") pod \"2d347fa3-7db2-48e2-8028-faef17697bd2\" (UID: \"2d347fa3-7db2-48e2-8028-faef17697bd2\") "
Sep 05 06:40:20.752159 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:20.752133    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d347fa3-7db2-48e2-8028-faef17697bd2-kube-api-access-22cdp" (OuterVolumeSpecName: "kube-api-access-22cdp") pod "2d347fa3-7db2-48e2-8028-faef17697bd2" (UID: "2d347fa3-7db2-48e2-8028-faef17697bd2"). InnerVolumeSpecName "kube-api-access-22cdp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:40:20.851015 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:20.850974    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22cdp\" (UniqueName: \"kubernetes.io/projected/2d347fa3-7db2-48e2-8028-faef17697bd2-kube-api-access-22cdp\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:40:20.873158 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:20.873122    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8092-139855881662256"]
Sep 05 06:40:20.873479 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:20.873465    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d347fa3-7db2-48e2-8028-faef17697bd2" containerName="test-curl-8092-139855881662256"
Sep 05 06:40:20.873520 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:20.873480    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d347fa3-7db2-48e2-8028-faef17697bd2" containerName="test-curl-8092-139855881662256"
Sep 05 06:40:20.873574 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:20.873565    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d347fa3-7db2-48e2-8028-faef17697bd2" containerName="test-curl-8092-139855881662256"
Sep 05 06:40:20.876531 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:20.876516    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8092-139855881662256"
Sep 05 06:40:20.888343 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:20.888314    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8092-139855881662256"]
Sep 05 06:40:20.952191 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:20.952157    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2h5c\" (UniqueName: \"kubernetes.io/projected/a0f08544-0714-4ed5-85c0-e0988742e2e8-kube-api-access-k2h5c\") pod \"test-curl-8092-139855881662256\" (UID: \"a0f08544-0714-4ed5-85c0-e0988742e2e8\") " pod="opendatahub/test-curl-8092-139855881662256"
Sep 05 06:40:21.053383 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:21.053271    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2h5c\" (UniqueName: \"kubernetes.io/projected/a0f08544-0714-4ed5-85c0-e0988742e2e8-kube-api-access-k2h5c\") pod \"test-curl-8092-139855881662256\" (UID: \"a0f08544-0714-4ed5-85c0-e0988742e2e8\") " pod="opendatahub/test-curl-8092-139855881662256"
Sep 05 06:40:21.065394 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:21.065358    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2h5c\" (UniqueName: \"kubernetes.io/projected/a0f08544-0714-4ed5-85c0-e0988742e2e8-kube-api-access-k2h5c\") pod \"test-curl-8092-139855881662256\" (UID: \"a0f08544-0714-4ed5-85c0-e0988742e2e8\") " pod="opendatahub/test-curl-8092-139855881662256"
Sep 05 06:40:21.185712 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:21.185669    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8092-139855881662256"
Sep 05 06:40:21.457086 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:21.457064    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8092-139855881662256"]
Sep 05 06:40:21.458778 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:40:21.458748    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda0f08544_0714_4ed5_85c0_e0988742e2e8.slice/crio-d58edfce4c10eacc72d6a82b1edcf890111d29571c6894022c95f56cb09a0baf WatchSource:0}: Error finding container d58edfce4c10eacc72d6a82b1edcf890111d29571c6894022c95f56cb09a0baf: Status 404 returned error can't find the container with id d58edfce4c10eacc72d6a82b1edcf890111d29571c6894022c95f56cb09a0baf
Sep 05 06:40:21.509535 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:21.509512    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8092-139855881662256"
Sep 05 06:40:21.509693 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:21.509567    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4cf1b173a1810269b01563b7b64dff7ba8c0bdab3852a7d50b583111168fb07d"
Sep 05 06:40:21.510776 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:21.510748    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8092-139855881662256" event={"ID":"a0f08544-0714-4ed5-85c0-e0988742e2e8","Type":"ContainerStarted","Data":"d58edfce4c10eacc72d6a82b1edcf890111d29571c6894022c95f56cb09a0baf"}
Sep 05 06:40:21.520953 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:21.520926    2567 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-8092-139855881662256" oldPodUID="2d347fa3-7db2-48e2-8028-faef17697bd2" podUID="a0f08544-0714-4ed5-85c0-e0988742e2e8"
Sep 05 06:40:22.518692 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:22.518657    2567 generic.go:356] "Generic (PLEG): container finished" podID="a0f08544-0714-4ed5-85c0-e0988742e2e8" containerID="2d5d6758ff97d09afc9591320dadaa9759be96c1ddc397c0be5f6fc08577590f" exitCode=0
Sep 05 06:40:22.519149 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:22.518736    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8092-139855881662256" event={"ID":"a0f08544-0714-4ed5-85c0-e0988742e2e8","Type":"ContainerDied","Data":"2d5d6758ff97d09afc9591320dadaa9759be96c1ddc397c0be5f6fc08577590f"}
Sep 05 06:40:22.581043 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:22.580995    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d347fa3-7db2-48e2-8028-faef17697bd2" path="/var/lib/kubelet/pods/2d347fa3-7db2-48e2-8028-faef17697bd2/volumes"
Sep 05 06:40:23.658140 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.658113    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8092-139855881662256"
Sep 05 06:40:23.681116 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.681079    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-8092-139855881662256_a0f08544-0714-4ed5-85c0-e0988742e2e8/test-curl-8092-139855881662256/0.log"
Sep 05 06:40:23.686352 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.686329    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2h5c\" (UniqueName: \"kubernetes.io/projected/a0f08544-0714-4ed5-85c0-e0988742e2e8-kube-api-access-k2h5c\") pod \"a0f08544-0714-4ed5-85c0-e0988742e2e8\" (UID: \"a0f08544-0714-4ed5-85c0-e0988742e2e8\") "
Sep 05 06:40:23.688658 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.688629    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0f08544-0714-4ed5-85c0-e0988742e2e8-kube-api-access-k2h5c" (OuterVolumeSpecName: "kube-api-access-k2h5c") pod "a0f08544-0714-4ed5-85c0-e0988742e2e8" (UID: "a0f08544-0714-4ed5-85c0-e0988742e2e8"). InnerVolumeSpecName "kube-api-access-k2h5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:40:23.711138 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.711112    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8092-139855881662256"]
Sep 05 06:40:23.715541 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.715518    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8092-139855881662256"]
Sep 05 06:40:23.787866 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.787778    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2h5c\" (UniqueName: \"kubernetes.io/projected/a0f08544-0714-4ed5-85c0-e0988742e2e8-kube-api-access-k2h5c\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:40:23.797723 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.797694    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"]
Sep 05 06:40:23.798088 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.798073    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0f08544-0714-4ed5-85c0-e0988742e2e8" containerName="test-curl-8092-139855881662256"
Sep 05 06:40:23.798132 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.798089    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0f08544-0714-4ed5-85c0-e0988742e2e8" containerName="test-curl-8092-139855881662256"
Sep 05 06:40:23.798175 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.798166    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0f08544-0714-4ed5-85c0-e0988742e2e8" containerName="test-curl-8092-139855881662256"
Sep 05 06:40:23.800958 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.800942    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:40:23.804956 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.804920    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-faf2bf41-openshift-default-dockercfg-sxnql\""
Sep 05 06:40:23.822557 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.822522    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"]
Sep 05 06:40:23.888734 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.888701    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0461ed26-2327-429b-803a-9a6a946ed9a7-istio-token\") pod \"e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2\" (UID: \"0461ed26-2327-429b-803a-9a6a946ed9a7\") " pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:40:23.888734 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.888748    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp2wf\" (UniqueName: \"kubernetes.io/projected/0461ed26-2327-429b-803a-9a6a946ed9a7-kube-api-access-fp2wf\") pod \"e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2\" (UID: \"0461ed26-2327-429b-803a-9a6a946ed9a7\") " pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:40:23.889085 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.888847    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0461ed26-2327-429b-803a-9a6a946ed9a7-workload-certs\") pod \"e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2\" (UID: \"0461ed26-2327-429b-803a-9a6a946ed9a7\") " pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:40:23.889085 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.888884    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0461ed26-2327-429b-803a-9a6a946ed9a7-credential-socket\") pod \"e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2\" (UID: \"0461ed26-2327-429b-803a-9a6a946ed9a7\") " pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:40:23.889085 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.888921    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0461ed26-2327-429b-803a-9a6a946ed9a7-istio-data\") pod \"e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2\" (UID: \"0461ed26-2327-429b-803a-9a6a946ed9a7\") " pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:40:23.889085 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.888947    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0461ed26-2327-429b-803a-9a6a946ed9a7-istio-podinfo\") pod \"e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2\" (UID: \"0461ed26-2327-429b-803a-9a6a946ed9a7\") " pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:40:23.889085 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.888992    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0461ed26-2327-429b-803a-9a6a946ed9a7-workload-socket\") pod \"e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2\" (UID: \"0461ed26-2327-429b-803a-9a6a946ed9a7\") " pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:40:23.889334 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.889094    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0461ed26-2327-429b-803a-9a6a946ed9a7-istio-envoy\") pod \"e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2\" (UID: \"0461ed26-2327-429b-803a-9a6a946ed9a7\") " pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:40:23.889334 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.889138    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0461ed26-2327-429b-803a-9a6a946ed9a7-istiod-ca-cert\") pod \"e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2\" (UID: \"0461ed26-2327-429b-803a-9a6a946ed9a7\") " pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:40:23.990556 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.990511    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0461ed26-2327-429b-803a-9a6a946ed9a7-istio-token\") pod \"e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2\" (UID: \"0461ed26-2327-429b-803a-9a6a946ed9a7\") " pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:40:23.990757 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.990565    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fp2wf\" (UniqueName: \"kubernetes.io/projected/0461ed26-2327-429b-803a-9a6a946ed9a7-kube-api-access-fp2wf\") pod \"e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2\" (UID: \"0461ed26-2327-429b-803a-9a6a946ed9a7\") " pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:40:23.990757 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.990610    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0461ed26-2327-429b-803a-9a6a946ed9a7-workload-certs\") pod \"e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2\" (UID: \"0461ed26-2327-429b-803a-9a6a946ed9a7\") " pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:40:23.990757 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.990632    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0461ed26-2327-429b-803a-9a6a946ed9a7-credential-socket\") pod \"e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2\" (UID: \"0461ed26-2327-429b-803a-9a6a946ed9a7\") " pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:40:23.990757 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.990661    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0461ed26-2327-429b-803a-9a6a946ed9a7-istio-data\") pod \"e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2\" (UID: \"0461ed26-2327-429b-803a-9a6a946ed9a7\") " pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:40:23.990757 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.990686    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0461ed26-2327-429b-803a-9a6a946ed9a7-istio-podinfo\") pod \"e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2\" (UID: \"0461ed26-2327-429b-803a-9a6a946ed9a7\") " pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:40:23.991013 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.990796    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0461ed26-2327-429b-803a-9a6a946ed9a7-workload-socket\") pod \"e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2\" (UID: \"0461ed26-2327-429b-803a-9a6a946ed9a7\") " pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:40:23.991013 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.990861    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0461ed26-2327-429b-803a-9a6a946ed9a7-istio-envoy\") pod \"e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2\" (UID: \"0461ed26-2327-429b-803a-9a6a946ed9a7\") " pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:40:23.991013 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.990918    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0461ed26-2327-429b-803a-9a6a946ed9a7-istiod-ca-cert\") pod \"e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2\" (UID: \"0461ed26-2327-429b-803a-9a6a946ed9a7\") " pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:40:23.991188 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.991133    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0461ed26-2327-429b-803a-9a6a946ed9a7-workload-certs\") pod \"e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2\" (UID: \"0461ed26-2327-429b-803a-9a6a946ed9a7\") " pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:40:23.991248 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.991196    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0461ed26-2327-429b-803a-9a6a946ed9a7-istio-data\") pod \"e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2\" (UID: \"0461ed26-2327-429b-803a-9a6a946ed9a7\") " pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:40:23.991248 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.991232    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0461ed26-2327-429b-803a-9a6a946ed9a7-credential-socket\") pod \"e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2\" (UID: \"0461ed26-2327-429b-803a-9a6a946ed9a7\") " pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:40:23.991357 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.991337    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0461ed26-2327-429b-803a-9a6a946ed9a7-workload-socket\") pod \"e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2\" (UID: \"0461ed26-2327-429b-803a-9a6a946ed9a7\") " pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:40:23.991623 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.991605    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0461ed26-2327-429b-803a-9a6a946ed9a7-istiod-ca-cert\") pod \"e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2\" (UID: \"0461ed26-2327-429b-803a-9a6a946ed9a7\") " pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:40:23.993169 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.993148    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0461ed26-2327-429b-803a-9a6a946ed9a7-istio-envoy\") pod \"e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2\" (UID: \"0461ed26-2327-429b-803a-9a6a946ed9a7\") " pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:40:23.993290 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:23.993260    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0461ed26-2327-429b-803a-9a6a946ed9a7-istio-podinfo\") pod \"e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2\" (UID: \"0461ed26-2327-429b-803a-9a6a946ed9a7\") " pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:40:24.002468 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.002451    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0461ed26-2327-429b-803a-9a6a946ed9a7-istio-token\") pod \"e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2\" (UID: \"0461ed26-2327-429b-803a-9a6a946ed9a7\") " pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:40:24.003289 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.003264    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp2wf\" (UniqueName: \"kubernetes.io/projected/0461ed26-2327-429b-803a-9a6a946ed9a7-kube-api-access-fp2wf\") pod \"e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2\" (UID: \"0461ed26-2327-429b-803a-9a6a946ed9a7\") " pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:40:24.111736 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.111642    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:40:24.394809 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.394771    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"]
Sep 05 06:40:24.396320 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:40:24.396290    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0461ed26_2327_429b_803a_9a6a946ed9a7.slice/crio-e47cb232d3ae0cdd96e4c2ed5668136abbddf4ced6a8e1f74210c8466545b8c3 WatchSource:0}: Error finding container e47cb232d3ae0cdd96e4c2ed5668136abbddf4ced6a8e1f74210c8466545b8c3: Status 404 returned error can't find the container with id e47cb232d3ae0cdd96e4c2ed5668136abbddf4ced6a8e1f74210c8466545b8c3
Sep 05 06:40:24.398636 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.398600    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:40:24.398714 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.398669    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:40:24.398714 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.398695    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:40:24.534162 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.534112    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2" event={"ID":"0461ed26-2327-429b-803a-9a6a946ed9a7","Type":"ContainerStarted","Data":"546d9d82582ff141a7e7dcb846257c88857f598a8cea57a6ae18b6ea88114c9a"}
Sep 05 06:40:24.534323 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.534173    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2" event={"ID":"0461ed26-2327-429b-803a-9a6a946ed9a7","Type":"ContainerStarted","Data":"e47cb232d3ae0cdd96e4c2ed5668136abbddf4ced6a8e1f74210c8466545b8c3"}
Sep 05 06:40:24.535830 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.535808    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d58edfce4c10eacc72d6a82b1edcf890111d29571c6894022c95f56cb09a0baf"
Sep 05 06:40:24.535934 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.535840    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8092-139855881662256"
Sep 05 06:40:24.561641 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:40:24.561595    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8092-139855881662256\" is forbidden: User \"system:node:ip-10-0-141-49.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-49.ec2.internal' and this object" podUID="a0f08544-0714-4ed5-85c0-e0988742e2e8" pod="opendatahub/test-curl-8092-139855881662256"
Sep 05 06:40:24.580899 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:40:24.580859    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8092-139855881662256\" is forbidden: User \"system:node:ip-10-0-141-49.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-49.ec2.internal' and this object" podUID="a0f08544-0714-4ed5-85c0-e0988742e2e8" pod="opendatahub/test-curl-8092-139855881662256"
Sep 05 06:40:24.583734 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.583694    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0f08544-0714-4ed5-85c0-e0988742e2e8" path="/var/lib/kubelet/pods/a0f08544-0714-4ed5-85c0-e0988742e2e8/volumes"
Sep 05 06:40:24.605282 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.605230    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2" podStartSLOduration=1.605210278 podStartE2EDuration="1.605210278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:40:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:40:24.558990955 +0000 UTC m=+890.532745631" watchObservedRunningTime="2026-09-05 06:40:24.605210278 +0000 UTC m=+890.578964953"
Sep 05 06:40:24.605672 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.605653    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"]
Sep 05 06:40:24.609206 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.609184    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:40:24.612329 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.612307    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-e04a57-openshift-default-dockercfg-4wzh8\""
Sep 05 06:40:24.624463 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.624391    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"]
Sep 05 06:40:24.699179 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.699134    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-istio-podinfo\") pod \"e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf\" (UID: \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\") " pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:40:24.699643 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.699185    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-istio-token\") pod \"e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf\" (UID: \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\") " pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:40:24.699643 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.699214    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-credential-socket\") pod \"e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf\" (UID: \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\") " pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:40:24.699643 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.699244    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8ftb\" (UniqueName: \"kubernetes.io/projected/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-kube-api-access-k8ftb\") pod \"e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf\" (UID: \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\") " pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:40:24.699643 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.699301    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-workload-socket\") pod \"e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf\" (UID: \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\") " pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:40:24.699643 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.699326    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-istio-data\") pod \"e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf\" (UID: \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\") " pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:40:24.699643 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.699368    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-workload-certs\") pod \"e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf\" (UID: \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\") " pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:40:24.699643 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.699397    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-istio-envoy\") pod \"e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf\" (UID: \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\") " pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:40:24.699643 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.699462    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-istiod-ca-cert\") pod \"e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf\" (UID: \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\") " pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:40:24.800802 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.800762    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-istiod-ca-cert\") pod \"e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf\" (UID: \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\") " pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:40:24.800986 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.800840    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-istio-podinfo\") pod \"e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf\" (UID: \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\") " pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:40:24.800986 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.800862    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-istio-token\") pod \"e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf\" (UID: \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\") " pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:40:24.800986 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.800880    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-credential-socket\") pod \"e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf\" (UID: \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\") " pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:40:24.800986 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.800899    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8ftb\" (UniqueName: \"kubernetes.io/projected/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-kube-api-access-k8ftb\") pod \"e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf\" (UID: \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\") " pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:40:24.800986 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.800971    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-workload-socket\") pod \"e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf\" (UID: \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\") " pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:40:24.801305 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.800995    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-istio-data\") pod \"e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf\" (UID: \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\") " pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:40:24.801305 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.801258    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-workload-certs\") pod \"e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf\" (UID: \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\") " pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:40:24.801305 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.801290    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-istio-envoy\") pod \"e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf\" (UID: \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\") " pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:40:24.801463 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.801401    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-credential-socket\") pod \"e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf\" (UID: \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\") " pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:40:24.801646 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.801600    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-istio-data\") pod \"e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf\" (UID: \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\") " pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:40:24.801646 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.801624    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-workload-certs\") pod \"e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf\" (UID: \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\") " pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:40:24.801887 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.801714    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-workload-socket\") pod \"e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf\" (UID: \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\") " pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:40:24.802241 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.802215    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-istiod-ca-cert\") pod \"e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf\" (UID: \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\") " pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:40:24.804164 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.804112    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-istio-podinfo\") pod \"e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf\" (UID: \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\") " pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:40:24.804164 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.804128    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-istio-envoy\") pod \"e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf\" (UID: \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\") " pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:40:24.811181 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.811119    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8ftb\" (UniqueName: \"kubernetes.io/projected/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-kube-api-access-k8ftb\") pod \"e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf\" (UID: \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\") " pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:40:24.811181 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.811125    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-istio-token\") pod \"e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf\" (UID: \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\") " pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:40:24.924284 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:24.924184    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:40:25.112162 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:25.112115    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:40:25.117293 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:25.117268    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:40:25.206784 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:25.206760    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"]
Sep 05 06:40:25.208328 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:40:25.208303    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeef506fe_5b3a_4ef9_9b40_62ad9082fe08.slice/crio-d33764498563c6676d81552d1af605e1587b38cd5bcb1d80abccd5ba85a33b1b WatchSource:0}: Error finding container d33764498563c6676d81552d1af605e1587b38cd5bcb1d80abccd5ba85a33b1b: Status 404 returned error can't find the container with id d33764498563c6676d81552d1af605e1587b38cd5bcb1d80abccd5ba85a33b1b
Sep 05 06:40:25.210893 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:25.210854    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:40:25.211001 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:25.210945    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:40:25.211001 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:25.210993    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:40:25.548592 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:25.548487    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb"]
Sep 05 06:40:25.557424 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:25.557383    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf" event={"ID":"eef506fe-5b3a-4ef9-9b40-62ad9082fe08","Type":"ContainerStarted","Data":"2bd7b9122afff638b37bd704364a35024f551943be7745a21a969caafc827976"}
Sep 05 06:40:25.557616 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:25.557449    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:40:25.557616 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:25.557477    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf" event={"ID":"eef506fe-5b3a-4ef9-9b40-62ad9082fe08","Type":"ContainerStarted","Data":"d33764498563c6676d81552d1af605e1587b38cd5bcb1d80abccd5ba85a33b1b"}
Sep 05 06:40:25.557616 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:25.557523    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb"
Sep 05 06:40:25.560665 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:25.560631    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-a-5cc5e81b-kserve-self-signed-certs\""
Sep 05 06:40:25.561417 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:25.561389    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:40:25.566564 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:25.566537    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb"]
Sep 05 06:40:25.606321 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:25.580355    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf" podStartSLOduration=1.580334336 podStartE2EDuration="1.580334336s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:40:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:40:25.57338979 +0000 UTC m=+891.547144466" watchObservedRunningTime="2026-09-05 06:40:25.580334336 +0000 UTC m=+891.554089013"
Sep 05 06:40:25.611101 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:25.608822    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0b339a0-cbc3-4c0a-834d-b3a385d7b1db-model-cache\") pod \"e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb\" (UID: \"d0b339a0-cbc3-4c0a-834d-b3a385d7b1db\") " pod="llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb"
Sep 05 06:40:25.611101 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:25.608919    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0b339a0-cbc3-4c0a-834d-b3a385d7b1db-home\") pod \"e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb\" (UID: \"d0b339a0-cbc3-4c0a-834d-b3a385d7b1db\") " pod="llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb"
Sep 05 06:40:25.611101 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:25.608946    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0b339a0-cbc3-4c0a-834d-b3a385d7b1db-dshm\") pod \"e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb\" (UID: \"d0b339a0-cbc3-4c0a-834d-b3a385d7b1db\") " pod="llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb"
Sep 05 06:40:25.611101 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:25.609012    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0b339a0-cbc3-4c0a-834d-b3a385d7b1db-tls-certs\") pod \"e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb\" (UID: \"d0b339a0-cbc3-4c0a-834d-b3a385d7b1db\") " pod="llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb"
Sep 05 06:40:25.611101 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:25.609102    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2nt4\" (UniqueName: \"kubernetes.io/projected/d0b339a0-cbc3-4c0a-834d-b3a385d7b1db-kube-api-access-k2nt4\") pod \"e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb\" (UID: \"d0b339a0-cbc3-4c0a-834d-b3a385d7b1db\") " pod="llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb"
Sep 05 06:40:25.611101 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:25.609170    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0b339a0-cbc3-4c0a-834d-b3a385d7b1db-tmp-dir\") pod \"e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb\" (UID: \"d0b339a0-cbc3-4c0a-834d-b3a385d7b1db\") " pod="llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb"
Sep 05 06:40:25.710666 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:25.710610    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0b339a0-cbc3-4c0a-834d-b3a385d7b1db-model-cache\") pod \"e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb\" (UID: \"d0b339a0-cbc3-4c0a-834d-b3a385d7b1db\") " pod="llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb"
Sep 05 06:40:25.711179 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:25.710695    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0b339a0-cbc3-4c0a-834d-b3a385d7b1db-home\") pod \"e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb\" (UID: \"d0b339a0-cbc3-4c0a-834d-b3a385d7b1db\") " pod="llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb"
Sep 05 06:40:25.711179 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:25.710724    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0b339a0-cbc3-4c0a-834d-b3a385d7b1db-dshm\") pod \"e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb\" (UID: \"d0b339a0-cbc3-4c0a-834d-b3a385d7b1db\") " pod="llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb"
Sep 05 06:40:25.711179 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:25.710776    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0b339a0-cbc3-4c0a-834d-b3a385d7b1db-tls-certs\") pod \"e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb\" (UID: \"d0b339a0-cbc3-4c0a-834d-b3a385d7b1db\") " pod="llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb"
Sep 05 06:40:25.711179 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:25.710828    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2nt4\" (UniqueName: \"kubernetes.io/projected/d0b339a0-cbc3-4c0a-834d-b3a385d7b1db-kube-api-access-k2nt4\") pod \"e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb\" (UID: \"d0b339a0-cbc3-4c0a-834d-b3a385d7b1db\") " pod="llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb"
Sep 05 06:40:25.711179 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:25.710874    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0b339a0-cbc3-4c0a-834d-b3a385d7b1db-tmp-dir\") pod \"e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb\" (UID: \"d0b339a0-cbc3-4c0a-834d-b3a385d7b1db\") " pod="llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb"
Sep 05 06:40:25.711447 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:25.711370    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0b339a0-cbc3-4c0a-834d-b3a385d7b1db-tmp-dir\") pod \"e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb\" (UID: \"d0b339a0-cbc3-4c0a-834d-b3a385d7b1db\") " pod="llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb"
Sep 05 06:40:25.711897 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:25.711863    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0b339a0-cbc3-4c0a-834d-b3a385d7b1db-home\") pod \"e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb\" (UID: \"d0b339a0-cbc3-4c0a-834d-b3a385d7b1db\") " pod="llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb"
Sep 05 06:40:25.712244 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:25.712174    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0b339a0-cbc3-4c0a-834d-b3a385d7b1db-model-cache\") pod \"e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb\" (UID: \"d0b339a0-cbc3-4c0a-834d-b3a385d7b1db\") " pod="llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb"
Sep 05 06:40:25.716019 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:25.714702    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0b339a0-cbc3-4c0a-834d-b3a385d7b1db-tls-certs\") pod \"e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb\" (UID: \"d0b339a0-cbc3-4c0a-834d-b3a385d7b1db\") " pod="llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb"
Sep 05 06:40:25.716019 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:25.714748    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0b339a0-cbc3-4c0a-834d-b3a385d7b1db-dshm\") pod \"e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb\" (UID: \"d0b339a0-cbc3-4c0a-834d-b3a385d7b1db\") " pod="llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb"
Sep 05 06:40:25.724131 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:25.724087    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2nt4\" (UniqueName: \"kubernetes.io/projected/d0b339a0-cbc3-4c0a-834d-b3a385d7b1db-kube-api-access-k2nt4\") pod \"e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb\" (UID: \"d0b339a0-cbc3-4c0a-834d-b3a385d7b1db\") " pod="llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb"
Sep 05 06:40:25.880601 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:25.880502    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb"
Sep 05 06:40:25.925010 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:25.924964    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:40:26.183331 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:26.183252    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb"]
Sep 05 06:40:26.185130 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:40:26.185093    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0b339a0_cbc3_4c0a_834d_b3a385d7b1db.slice/crio-47ea1dd2bfb11fe7944309420efc27761f9cc361ee2e17d8f4c2c5c832581805 WatchSource:0}: Error finding container 47ea1dd2bfb11fe7944309420efc27761f9cc361ee2e17d8f4c2c5c832581805: Status 404 returned error can't find the container with id 47ea1dd2bfb11fe7944309420efc27761f9cc361ee2e17d8f4c2c5c832581805
Sep 05 06:40:26.558261 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:26.558215    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb" event={"ID":"d0b339a0-cbc3-4c0a-834d-b3a385d7b1db","Type":"ContainerStarted","Data":"9e19493ebe126ea04ad70d9c3fb88a4aee952c89b51580fcfe7c8d0c69b46faf"}
Sep 05 06:40:26.558261 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:26.558261    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb" event={"ID":"d0b339a0-cbc3-4c0a-834d-b3a385d7b1db","Type":"ContainerStarted","Data":"47ea1dd2bfb11fe7944309420efc27761f9cc361ee2e17d8f4c2c5c832581805"}
Sep 05 06:40:26.579287 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:26.579018    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb" podStartSLOduration=1.579003477 podStartE2EDuration="1.579003477s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:40:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:40:26.577803716 +0000 UTC m=+892.551558385" watchObservedRunningTime="2026-09-05 06:40:26.579003477 +0000 UTC m=+892.552758151"
Sep 05 06:40:26.952373 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:26.952335    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:40:27.563755 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:27.563720    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:40:27.564770 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:27.564751    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:40:33.527303 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:33.527253    2567 patch_prober.go:28] interesting pod/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 05 06:40:33.527833 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:33.527376    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm" podUID="5034f8c0-a2dc-42cd-8691-d4dd18f38604" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 05 06:40:34.518404 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:34.518370    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bb4_7f8a8f16-2422-4c01-a619-1f17fe10cd4c/ovn-acl-logging/0.log"
Sep 05 06:40:34.518690 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:34.518672    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bb4_7f8a8f16-2422-4c01-a619-1f17fe10cd4c/ovn-acl-logging/0.log"
Sep 05 06:40:35.881479 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:35.881435    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb"
Sep 05 06:40:35.881479 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:35.881491    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb"
Sep 05 06:40:35.895143 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:35.895106    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb"
Sep 05 06:40:36.609897 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:36.609867    2567 generic.go:356] "Generic (PLEG): container finished" podID="5034f8c0-a2dc-42cd-8691-d4dd18f38604" containerID="2c03b632010b53004b419e1ae6fce49e99a5daac8fb0ccc21fdcc938d6634d6e" exitCode=0
Sep 05 06:40:36.610152 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:36.609947    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm" event={"ID":"5034f8c0-a2dc-42cd-8691-d4dd18f38604","Type":"ContainerDied","Data":"2c03b632010b53004b419e1ae6fce49e99a5daac8fb0ccc21fdcc938d6634d6e"}
Sep 05 06:40:36.610530 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:36.610509    2567 scope.go:117] "RemoveContainer" containerID="2c03b632010b53004b419e1ae6fce49e99a5daac8fb0ccc21fdcc938d6634d6e"
Sep 05 06:40:36.611642 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:36.611614    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:40:36.611703 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:36.611683    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:40:36.611739 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:36.611716    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:40:36.622433 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:36.622401    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb"
Sep 05 06:40:37.616320 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:37.616277    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm" event={"ID":"5034f8c0-a2dc-42cd-8691-d4dd18f38604","Type":"ContainerStarted","Data":"64b2a092014102970072e7b591d4f55bab1d7cfecc4e5bdd09e1abc06e00c17c"}
Sep 05 06:40:38.390536 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:38.390490    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:40:38.390752 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:38.390728    2567 patch_prober.go:28] interesting pod/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 05 06:40:38.390803 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:38.390781    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm" podUID="5034f8c0-a2dc-42cd-8691-d4dd18f38604" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 05 06:40:39.391646 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:39.391605    2567 patch_prober.go:28] interesting pod/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 05 06:40:39.392085 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:39.391680    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm" podUID="5034f8c0-a2dc-42cd-8691-d4dd18f38604" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 05 06:40:40.391428 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:40.391393    2567 patch_prober.go:28] interesting pod/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 05 06:40:40.391618 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:40.391464    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm" podUID="5034f8c0-a2dc-42cd-8691-d4dd18f38604" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 05 06:40:41.391046 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:41.390989    2567 patch_prober.go:28] interesting pod/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 05 06:40:41.391539 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:41.391085    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm" podUID="5034f8c0-a2dc-42cd-8691-d4dd18f38604" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 05 06:40:41.553694 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:41.553650    2567 patch_prober.go:28] interesting pod/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 05 06:40:41.553914 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:41.553749    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2" podUID="0461ed26-2327-429b-803a-9a6a946ed9a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 05 06:40:42.390705 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:42.390593    2567 patch_prober.go:28] interesting pod/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 05 06:40:42.390705 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:42.390678    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm" podUID="5034f8c0-a2dc-42cd-8691-d4dd18f38604" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 05 06:40:42.672400 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:42.672310    2567 generic.go:356] "Generic (PLEG): container finished" podID="0461ed26-2327-429b-803a-9a6a946ed9a7" containerID="546d9d82582ff141a7e7dcb846257c88857f598a8cea57a6ae18b6ea88114c9a" exitCode=0
Sep 05 06:40:42.672957 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:42.672573    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2" event={"ID":"0461ed26-2327-429b-803a-9a6a946ed9a7","Type":"ContainerDied","Data":"546d9d82582ff141a7e7dcb846257c88857f598a8cea57a6ae18b6ea88114c9a"}
Sep 05 06:40:42.673949 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:42.673928    2567 scope.go:117] "RemoveContainer" containerID="546d9d82582ff141a7e7dcb846257c88857f598a8cea57a6ae18b6ea88114c9a"
Sep 05 06:40:42.675633 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:42.675548    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:40:42.675633 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:42.675624    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:40:42.675756 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:42.675656    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:40:43.394059 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:43.394017    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:40:43.394490 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:43.394467    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:40:43.395154 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:43.395137    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:40:43.680106 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:43.679975    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2" event={"ID":"0461ed26-2327-429b-803a-9a6a946ed9a7","Type":"ContainerStarted","Data":"b5e374479cb58f73a893d7bef24988397769504977c151db2686abf2fd8bc6c2"}
Sep 05 06:40:44.112371 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.112331    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:40:44.112595 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.112571    2567 patch_prober.go:28] interesting pod/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 05 06:40:44.112655 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.112636    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2" podUID="0461ed26-2327-429b-803a-9a6a946ed9a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 05 06:40:44.194332 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.194294    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"]
Sep 05 06:40:44.198630 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.198608    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:40:44.203323 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.203300    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-5d5f17-openshift-default-dockercfg-xnfkb\""
Sep 05 06:40:44.212593 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.212571    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"]
Sep 05 06:40:44.333270 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.333222    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-istio-data\") pod \"e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22\" (UID: \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\") " pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:40:44.333483 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.333296    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-istio-envoy\") pod \"e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22\" (UID: \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\") " pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:40:44.333483 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.333329    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-istio-podinfo\") pod \"e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22\" (UID: \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\") " pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:40:44.333483 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.333358    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-credential-socket\") pod \"e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22\" (UID: \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\") " pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:40:44.333483 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.333406    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrmt9\" (UniqueName: \"kubernetes.io/projected/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-kube-api-access-wrmt9\") pod \"e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22\" (UID: \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\") " pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:40:44.333483 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.333450    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-istiod-ca-cert\") pod \"e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22\" (UID: \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\") " pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:40:44.333483 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.333477    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-istio-token\") pod \"e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22\" (UID: \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\") " pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:40:44.333839 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.333531    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-workload-socket\") pod \"e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22\" (UID: \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\") " pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:40:44.333839 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.333571    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-workload-certs\") pod \"e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22\" (UID: \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\") " pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:40:44.435125 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.435002    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-istiod-ca-cert\") pod \"e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22\" (UID: \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\") " pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:40:44.435125 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.435086    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-istio-token\") pod \"e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22\" (UID: \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\") " pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:40:44.435366 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.435139    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-workload-socket\") pod \"e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22\" (UID: \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\") " pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:40:44.435366 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.435178    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-workload-certs\") pod \"e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22\" (UID: \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\") " pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:40:44.435366 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.435277    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-istio-data\") pod \"e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22\" (UID: \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\") " pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:40:44.435366 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.435314    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-istio-envoy\") pod \"e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22\" (UID: \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\") " pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:40:44.435366 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.435348    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-istio-podinfo\") pod \"e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22\" (UID: \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\") " pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:40:44.435614 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.435377    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-credential-socket\") pod \"e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22\" (UID: \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\") " pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:40:44.435614 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.435423    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrmt9\" (UniqueName: \"kubernetes.io/projected/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-kube-api-access-wrmt9\") pod \"e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22\" (UID: \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\") " pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:40:44.436623 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.436584    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-istiod-ca-cert\") pod \"e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22\" (UID: \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\") " pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:40:44.437239 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.437211    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-workload-socket\") pod \"e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22\" (UID: \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\") " pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:40:44.437533 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.437508    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-workload-certs\") pod \"e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22\" (UID: \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\") " pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:40:44.437753 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.437733    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-istio-data\") pod \"e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22\" (UID: \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\") " pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:40:44.438335 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.438311    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-credential-socket\") pod \"e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22\" (UID: \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\") " pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:40:44.442387 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.442366    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-istio-envoy\") pod \"e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22\" (UID: \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\") " pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:40:44.446738 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.446714    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-istio-podinfo\") pod \"e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22\" (UID: \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\") " pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:40:44.449543 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.449498    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-istio-token\") pod \"e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22\" (UID: \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\") " pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:40:44.452698 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.452649    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrmt9\" (UniqueName: \"kubernetes.io/projected/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-kube-api-access-wrmt9\") pod \"e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22\" (UID: \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\") " pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:40:44.512182 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.512062    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:40:44.843062 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.840845    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"]
Sep 05 06:40:44.852262 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.852217    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:40:44.852494 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.852472    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:40:44.852654 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:44.852636    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:40:45.112387 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:45.112301    2567 patch_prober.go:28] interesting pod/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 05 06:40:45.112387 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:45.112364    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2" podUID="0461ed26-2327-429b-803a-9a6a946ed9a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 05 06:40:45.694947 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:45.694905    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22" event={"ID":"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9","Type":"ContainerStarted","Data":"4f2effc90675dd66ed4fa22e0b9a1328d0c0b3d435fe7aa457e5175e2d6b2838"}
Sep 05 06:40:45.695142 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:45.694975    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22" event={"ID":"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9","Type":"ContainerStarted","Data":"411c1302735adc67cbaa5c94f1580633a3becf480638ef0747f7c23ad85a3270"}
Sep 05 06:40:45.717901 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:45.717843    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22" podStartSLOduration=1.717811754 podStartE2EDuration="1.717811754s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:40:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:40:45.71671044 +0000 UTC m=+911.690465119" watchObservedRunningTime="2026-09-05 06:40:45.717811754 +0000 UTC m=+911.691566429"
Sep 05 06:40:46.112176 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:46.112139    2567 patch_prober.go:28] interesting pod/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 05 06:40:46.112670 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:46.112206    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2" podUID="0461ed26-2327-429b-803a-9a6a946ed9a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 05 06:40:46.513166 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:46.513124    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:40:46.518249 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:46.518218    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:40:46.701411 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:46.701373    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:40:46.707108 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:46.706682    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:40:47.112575 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:47.112532    2567 patch_prober.go:28] interesting pod/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 05 06:40:47.112977 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:47.112591    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2" podUID="0461ed26-2327-429b-803a-9a6a946ed9a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 05 06:40:48.112616 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:48.112579    2567 patch_prober.go:28] interesting pod/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 05 06:40:48.113008 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:48.112636    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2" podUID="0461ed26-2327-429b-803a-9a6a946ed9a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 05 06:40:49.112628 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:49.112586    2567 patch_prober.go:28] interesting pod/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 05 06:40:49.113146 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:49.112653    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2" podUID="0461ed26-2327-429b-803a-9a6a946ed9a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 05 06:40:50.116212 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:50.116177    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:40:50.116717 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:50.116697    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:40:50.117515 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:50.117492    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:40:51.727426 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:51.727349    2567 generic.go:356] "Generic (PLEG): container finished" podID="eef506fe-5b3a-4ef9-9b40-62ad9082fe08" containerID="2bd7b9122afff638b37bd704364a35024f551943be7745a21a969caafc827976" exitCode=0
Sep 05 06:40:51.727979 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:51.727424    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf" event={"ID":"eef506fe-5b3a-4ef9-9b40-62ad9082fe08","Type":"ContainerDied","Data":"2bd7b9122afff638b37bd704364a35024f551943be7745a21a969caafc827976"}
Sep 05 06:40:51.727979 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:51.727896    2567 scope.go:117] "RemoveContainer" containerID="2bd7b9122afff638b37bd704364a35024f551943be7745a21a969caafc827976"
Sep 05 06:40:51.729132 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:51.729078    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:40:51.729215 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:51.729180    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:40:51.729256 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:51.729213    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:40:52.738630 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:52.738593    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf" event={"ID":"eef506fe-5b3a-4ef9-9b40-62ad9082fe08","Type":"ContainerStarted","Data":"6cd647619cc0d81000ceda6a1ab11b157ecff10a834351d4d4929117ca43f93d"}
Sep 05 06:40:52.924742 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:52.924708    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:40:52.925923 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:52.925899    2567 patch_prober.go:28] interesting pod/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 05 06:40:52.926083 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:52.925952    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf" podUID="eef506fe-5b3a-4ef9-9b40-62ad9082fe08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 05 06:40:53.925456 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:53.925423    2567 patch_prober.go:28] interesting pod/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 05 06:40:53.925838 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:53.925479    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf" podUID="eef506fe-5b3a-4ef9-9b40-62ad9082fe08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 05 06:40:54.925042 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:54.924995    2567 patch_prober.go:28] interesting pod/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 05 06:40:54.925250 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:54.925077    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf" podUID="eef506fe-5b3a-4ef9-9b40-62ad9082fe08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 05 06:40:55.925559 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:55.925517    2567 patch_prober.go:28] interesting pod/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 05 06:40:55.926120 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:55.925580    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf" podUID="eef506fe-5b3a-4ef9-9b40-62ad9082fe08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 05 06:40:56.699817 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:56.699782    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-faf2bf41-zfrj7"]
Sep 05 06:40:56.702451 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:56.702434    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-faf2bf41-zfrj7"
Sep 05 06:40:56.705374 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:56.705352    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 05 06:40:56.705513 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:56.705426    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tlgjj\""
Sep 05 06:40:56.712425 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:56.712396    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-faf2bf41-zfrj7"]
Sep 05 06:40:56.799840 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:56.799800    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bae9d511-21c1-4424-bd0c-4714c2a25539-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-faf2bf41-zfrj7\" (UID: \"bae9d511-21c1-4424-bd0c-4714c2a25539\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-faf2bf41-zfrj7"
Sep 05 06:40:56.901492 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:56.901451    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bae9d511-21c1-4424-bd0c-4714c2a25539-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-faf2bf41-zfrj7\" (UID: \"bae9d511-21c1-4424-bd0c-4714c2a25539\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-faf2bf41-zfrj7"
Sep 05 06:40:56.902153 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:56.902132    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bae9d511-21c1-4424-bd0c-4714c2a25539-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-faf2bf41-zfrj7\" (UID: \"bae9d511-21c1-4424-bd0c-4714c2a25539\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-faf2bf41-zfrj7"
Sep 05 06:40:56.924607 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:56.924570    2567 patch_prober.go:28] interesting pod/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 05 06:40:56.924781 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:56.924636    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf" podUID="eef506fe-5b3a-4ef9-9b40-62ad9082fe08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 05 06:40:57.014694 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:57.014584    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-faf2bf41-zfrj7"
Sep 05 06:40:57.338754 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:57.337992    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-faf2bf41-zfrj7"]
Sep 05 06:40:57.355226 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:40:57.355188    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbae9d511_21c1_4424_bd0c_4714c2a25539.slice/crio-1e68fd4e42fa3376676ad63d28d23dcb5060a08298de8e604283dc815c3b20ea WatchSource:0}: Error finding container 1e68fd4e42fa3376676ad63d28d23dcb5060a08298de8e604283dc815c3b20ea: Status 404 returned error can't find the container with id 1e68fd4e42fa3376676ad63d28d23dcb5060a08298de8e604283dc815c3b20ea
Sep 05 06:40:57.563624 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:57.563588    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:40:57.775321 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:57.775285    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-faf2bf41-zfrj7" event={"ID":"bae9d511-21c1-4424-bd0c-4714c2a25539","Type":"ContainerStarted","Data":"1e68fd4e42fa3376676ad63d28d23dcb5060a08298de8e604283dc815c3b20ea"}
Sep 05 06:40:57.925059 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:57.925006    2567 patch_prober.go:28] interesting pod/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 05 06:40:57.925249 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:57.925083    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf" podUID="eef506fe-5b3a-4ef9-9b40-62ad9082fe08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 05 06:40:58.937545 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:58.936368    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:40:58.941441 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:40:58.941402    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:41:00.796481 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:00.796441    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-faf2bf41-zfrj7" event={"ID":"bae9d511-21c1-4424-bd0c-4714c2a25539","Type":"ContainerStarted","Data":"8c95133a587d5add8b279553856033e01cab94712e35bd92be6c8be372976cb0"}
Sep 05 06:41:00.815457 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:00.815401    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-faf2bf41-zfrj7" podStartSLOduration=2.373780489 podStartE2EDuration="4.815384905s" totalImagesPullingTime="2.441604416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:40:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:41:00.81411998 +0000 UTC m=+926.787874656" watchObservedRunningTime="2026-09-05 06:41:00.815384905 +0000 UTC m=+926.789139579"
Sep 05 06:41:01.803138 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:01.803102    2567 generic.go:356] "Generic (PLEG): container finished" podID="bae9d511-21c1-4424-bd0c-4714c2a25539" containerID="8c95133a587d5add8b279553856033e01cab94712e35bd92be6c8be372976cb0" exitCode=0
Sep 05 06:41:01.803591 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:01.803179    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-faf2bf41-zfrj7" event={"ID":"bae9d511-21c1-4424-bd0c-4714c2a25539","Type":"ContainerDied","Data":"8c95133a587d5add8b279553856033e01cab94712e35bd92be6c8be372976cb0"}
Sep 05 06:41:02.988792 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:02.988765    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-faf2bf41-zfrj7"
Sep 05 06:41:03.090195 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:03.090104    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bae9d511-21c1-4424-bd0c-4714c2a25539-maas-api-service-ca\") pod \"bae9d511-21c1-4424-bd0c-4714c2a25539\" (UID: \"bae9d511-21c1-4424-bd0c-4714c2a25539\") "
Sep 05 06:41:03.090426 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:03.090405    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bae9d511-21c1-4424-bd0c-4714c2a25539-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bae9d511-21c1-4424-bd0c-4714c2a25539" (UID: "bae9d511-21c1-4424-bd0c-4714c2a25539"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:41:03.191763 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:03.191717    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bae9d511-21c1-4424-bd0c-4714c2a25539-maas-api-service-ca\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:41:03.817978 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:03.817940    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-faf2bf41-zfrj7" event={"ID":"bae9d511-21c1-4424-bd0c-4714c2a25539","Type":"ContainerDied","Data":"1e68fd4e42fa3376676ad63d28d23dcb5060a08298de8e604283dc815c3b20ea"}
Sep 05 06:41:03.818217 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:03.817991    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e68fd4e42fa3376676ad63d28d23dcb5060a08298de8e604283dc815c3b20ea"
Sep 05 06:41:03.818217 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:03.817946    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-faf2bf41-zfrj7"
Sep 05 06:41:07.842155 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:07.842123    2567 generic.go:356] "Generic (PLEG): container finished" podID="d52ee6af-272e-46cb-9b7b-f7160fdcc0c9" containerID="4f2effc90675dd66ed4fa22e0b9a1328d0c0b3d435fe7aa457e5175e2d6b2838" exitCode=0
Sep 05 06:41:07.842584 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:07.842198    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22" event={"ID":"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9","Type":"ContainerDied","Data":"4f2effc90675dd66ed4fa22e0b9a1328d0c0b3d435fe7aa457e5175e2d6b2838"}
Sep 05 06:41:07.842661 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:07.842645    2567 scope.go:117] "RemoveContainer" containerID="4f2effc90675dd66ed4fa22e0b9a1328d0c0b3d435fe7aa457e5175e2d6b2838"
Sep 05 06:41:07.843760 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:07.843730    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:41:07.843862 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:07.843818    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:41:07.843933 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:07.843891    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:41:08.282409 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:08.282376    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-faf2bf41-zfrj7"]
Sep 05 06:41:08.284840 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:08.284813    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-faf2bf41-zfrj7"]
Sep 05 06:41:08.430265 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:08.430233    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"]
Sep 05 06:41:08.430767 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:08.430730    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2" podUID="0461ed26-2327-429b-803a-9a6a946ed9a7" containerName="istio-proxy" containerID="cri-o://b5e374479cb58f73a893d7bef24988397769504977c151db2686abf2fd8bc6c2" gracePeriod=30
Sep 05 06:41:08.584602 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:08.584500    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bae9d511-21c1-4424-bd0c-4714c2a25539" path="/var/lib/kubelet/pods/bae9d511-21c1-4424-bd0c-4714c2a25539/volumes"
Sep 05 06:41:08.854279 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:08.854178    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22" event={"ID":"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9","Type":"ContainerStarted","Data":"7464664f4d676af24c80a997352f199860633a87d5d315179abd6b25a75e18ef"}
Sep 05 06:41:09.512301 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:09.512267    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:41:09.512505 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:09.512451    2567 patch_prober.go:28] interesting pod/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 05 06:41:09.512584 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:09.512502    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22" podUID="d52ee6af-272e-46cb-9b7b-f7160fdcc0c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 05 06:41:10.513430 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:10.513384    2567 patch_prober.go:28] interesting pod/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 05 06:41:10.513873 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:10.513462    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22" podUID="d52ee6af-272e-46cb-9b7b-f7160fdcc0c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 05 06:41:11.512520 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:11.512481    2567 patch_prober.go:28] interesting pod/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 05 06:41:11.512730 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:11.512542    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22" podUID="d52ee6af-272e-46cb-9b7b-f7160fdcc0c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 05 06:41:12.513232 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:12.513195    2567 patch_prober.go:28] interesting pod/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 05 06:41:12.513638 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:12.513257    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22" podUID="d52ee6af-272e-46cb-9b7b-f7160fdcc0c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 05 06:41:13.513468 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.513419    2567 patch_prober.go:28] interesting pod/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 05 06:41:13.513962 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.513501    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22" podUID="d52ee6af-272e-46cb-9b7b-f7160fdcc0c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 05 06:41:13.718442 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.718370    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:41:13.802177 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.802143    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fp2wf\" (UniqueName: \"kubernetes.io/projected/0461ed26-2327-429b-803a-9a6a946ed9a7-kube-api-access-fp2wf\") pod \"0461ed26-2327-429b-803a-9a6a946ed9a7\" (UID: \"0461ed26-2327-429b-803a-9a6a946ed9a7\") "
Sep 05 06:41:13.802177 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.802189    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0461ed26-2327-429b-803a-9a6a946ed9a7-workload-certs\") pod \"0461ed26-2327-429b-803a-9a6a946ed9a7\" (UID: \"0461ed26-2327-429b-803a-9a6a946ed9a7\") "
Sep 05 06:41:13.802412 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.802207    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0461ed26-2327-429b-803a-9a6a946ed9a7-istio-envoy\") pod \"0461ed26-2327-429b-803a-9a6a946ed9a7\" (UID: \"0461ed26-2327-429b-803a-9a6a946ed9a7\") "
Sep 05 06:41:13.802412 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.802264    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0461ed26-2327-429b-803a-9a6a946ed9a7-istio-podinfo\") pod \"0461ed26-2327-429b-803a-9a6a946ed9a7\" (UID: \"0461ed26-2327-429b-803a-9a6a946ed9a7\") "
Sep 05 06:41:13.802412 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.802329    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0461ed26-2327-429b-803a-9a6a946ed9a7-istiod-ca-cert\") pod \"0461ed26-2327-429b-803a-9a6a946ed9a7\" (UID: \"0461ed26-2327-429b-803a-9a6a946ed9a7\") "
Sep 05 06:41:13.802412 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.802373    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0461ed26-2327-429b-803a-9a6a946ed9a7-credential-socket\") pod \"0461ed26-2327-429b-803a-9a6a946ed9a7\" (UID: \"0461ed26-2327-429b-803a-9a6a946ed9a7\") "
Sep 05 06:41:13.802412 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.802392    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0461ed26-2327-429b-803a-9a6a946ed9a7-istio-token\") pod \"0461ed26-2327-429b-803a-9a6a946ed9a7\" (UID: \"0461ed26-2327-429b-803a-9a6a946ed9a7\") "
Sep 05 06:41:13.802412 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.802409    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0461ed26-2327-429b-803a-9a6a946ed9a7-istio-data\") pod \"0461ed26-2327-429b-803a-9a6a946ed9a7\" (UID: \"0461ed26-2327-429b-803a-9a6a946ed9a7\") "
Sep 05 06:41:13.802729 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.802488    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0461ed26-2327-429b-803a-9a6a946ed9a7-workload-socket\") pod \"0461ed26-2327-429b-803a-9a6a946ed9a7\" (UID: \"0461ed26-2327-429b-803a-9a6a946ed9a7\") "
Sep 05 06:41:13.802729 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.802490    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0461ed26-2327-429b-803a-9a6a946ed9a7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0461ed26-2327-429b-803a-9a6a946ed9a7" (UID: "0461ed26-2327-429b-803a-9a6a946ed9a7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:41:13.802729 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.802667    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0461ed26-2327-429b-803a-9a6a946ed9a7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0461ed26-2327-429b-803a-9a6a946ed9a7" (UID: "0461ed26-2327-429b-803a-9a6a946ed9a7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:41:13.802951 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.802742    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0461ed26-2327-429b-803a-9a6a946ed9a7-istio-data" (OuterVolumeSpecName: "istio-data") pod "0461ed26-2327-429b-803a-9a6a946ed9a7" (UID: "0461ed26-2327-429b-803a-9a6a946ed9a7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:41:13.802951 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.802748    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0461ed26-2327-429b-803a-9a6a946ed9a7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0461ed26-2327-429b-803a-9a6a946ed9a7" (UID: "0461ed26-2327-429b-803a-9a6a946ed9a7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:41:13.802951 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.802878    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0461ed26-2327-429b-803a-9a6a946ed9a7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0461ed26-2327-429b-803a-9a6a946ed9a7" (UID: "0461ed26-2327-429b-803a-9a6a946ed9a7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:41:13.802951 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.802920    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0461ed26-2327-429b-803a-9a6a946ed9a7-istiod-ca-cert\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:41:13.802951 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.802935    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0461ed26-2327-429b-803a-9a6a946ed9a7-credential-socket\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:41:13.802951 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.802944    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0461ed26-2327-429b-803a-9a6a946ed9a7-istio-data\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:41:13.802951 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.802953    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0461ed26-2327-429b-803a-9a6a946ed9a7-workload-certs\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:41:13.804849 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.804817    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0461ed26-2327-429b-803a-9a6a946ed9a7-istio-token" (OuterVolumeSpecName: "istio-token") pod "0461ed26-2327-429b-803a-9a6a946ed9a7" (UID: "0461ed26-2327-429b-803a-9a6a946ed9a7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:41:13.804962 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.804861    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0461ed26-2327-429b-803a-9a6a946ed9a7-kube-api-access-fp2wf" (OuterVolumeSpecName: "kube-api-access-fp2wf") pod "0461ed26-2327-429b-803a-9a6a946ed9a7" (UID: "0461ed26-2327-429b-803a-9a6a946ed9a7"). InnerVolumeSpecName "kube-api-access-fp2wf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:41:13.804962 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.804857    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0461ed26-2327-429b-803a-9a6a946ed9a7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0461ed26-2327-429b-803a-9a6a946ed9a7" (UID: "0461ed26-2327-429b-803a-9a6a946ed9a7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 05 06:41:13.805064 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.805013    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0461ed26-2327-429b-803a-9a6a946ed9a7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0461ed26-2327-429b-803a-9a6a946ed9a7" (UID: "0461ed26-2327-429b-803a-9a6a946ed9a7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:41:13.882283 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.882249    2567 generic.go:356] "Generic (PLEG): container finished" podID="0461ed26-2327-429b-803a-9a6a946ed9a7" containerID="b5e374479cb58f73a893d7bef24988397769504977c151db2686abf2fd8bc6c2" exitCode=0
Sep 05 06:41:13.882454 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.882301    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"
Sep 05 06:41:13.882454 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.882309    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2" event={"ID":"0461ed26-2327-429b-803a-9a6a946ed9a7","Type":"ContainerDied","Data":"b5e374479cb58f73a893d7bef24988397769504977c151db2686abf2fd8bc6c2"}
Sep 05 06:41:13.882454 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.882388    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2" event={"ID":"0461ed26-2327-429b-803a-9a6a946ed9a7","Type":"ContainerDied","Data":"e47cb232d3ae0cdd96e4c2ed5668136abbddf4ced6a8e1f74210c8466545b8c3"}
Sep 05 06:41:13.882454 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.882412    2567 scope.go:117] "RemoveContainer" containerID="b5e374479cb58f73a893d7bef24988397769504977c151db2686abf2fd8bc6c2"
Sep 05 06:41:13.892387 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.892365    2567 scope.go:117] "RemoveContainer" containerID="546d9d82582ff141a7e7dcb846257c88857f598a8cea57a6ae18b6ea88114c9a"
Sep 05 06:41:13.901556 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.901534    2567 scope.go:117] "RemoveContainer" containerID="b5e374479cb58f73a893d7bef24988397769504977c151db2686abf2fd8bc6c2"
Sep 05 06:41:13.901965 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:41:13.901944    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5e374479cb58f73a893d7bef24988397769504977c151db2686abf2fd8bc6c2\": container with ID starting with b5e374479cb58f73a893d7bef24988397769504977c151db2686abf2fd8bc6c2 not found: ID does not exist" containerID="b5e374479cb58f73a893d7bef24988397769504977c151db2686abf2fd8bc6c2"
Sep 05 06:41:13.902008 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.901976    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5e374479cb58f73a893d7bef24988397769504977c151db2686abf2fd8bc6c2"} err="failed to get container status \"b5e374479cb58f73a893d7bef24988397769504977c151db2686abf2fd8bc6c2\": rpc error: code = NotFound desc = could not find container \"b5e374479cb58f73a893d7bef24988397769504977c151db2686abf2fd8bc6c2\": container with ID starting with b5e374479cb58f73a893d7bef24988397769504977c151db2686abf2fd8bc6c2 not found: ID does not exist"
Sep 05 06:41:13.902008 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.901997    2567 scope.go:117] "RemoveContainer" containerID="546d9d82582ff141a7e7dcb846257c88857f598a8cea57a6ae18b6ea88114c9a"
Sep 05 06:41:13.902314 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:41:13.902297    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"546d9d82582ff141a7e7dcb846257c88857f598a8cea57a6ae18b6ea88114c9a\": container with ID starting with 546d9d82582ff141a7e7dcb846257c88857f598a8cea57a6ae18b6ea88114c9a not found: ID does not exist" containerID="546d9d82582ff141a7e7dcb846257c88857f598a8cea57a6ae18b6ea88114c9a"
Sep 05 06:41:13.902356 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.902321    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"546d9d82582ff141a7e7dcb846257c88857f598a8cea57a6ae18b6ea88114c9a"} err="failed to get container status \"546d9d82582ff141a7e7dcb846257c88857f598a8cea57a6ae18b6ea88114c9a\": rpc error: code = NotFound desc = could not find container \"546d9d82582ff141a7e7dcb846257c88857f598a8cea57a6ae18b6ea88114c9a\": container with ID starting with 546d9d82582ff141a7e7dcb846257c88857f598a8cea57a6ae18b6ea88114c9a not found: ID does not exist"
Sep 05 06:41:13.903803 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.903783    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0461ed26-2327-429b-803a-9a6a946ed9a7-workload-socket\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:41:13.903850 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.903807    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fp2wf\" (UniqueName: \"kubernetes.io/projected/0461ed26-2327-429b-803a-9a6a946ed9a7-kube-api-access-fp2wf\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:41:13.903850 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.903817    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0461ed26-2327-429b-803a-9a6a946ed9a7-istio-envoy\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:41:13.903850 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.903826    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0461ed26-2327-429b-803a-9a6a946ed9a7-istio-podinfo\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:41:13.903850 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.903834    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0461ed26-2327-429b-803a-9a6a946ed9a7-istio-token\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:41:13.919167 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.919135    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"]
Sep 05 06:41:13.935074 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:13.934260    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2"]
Sep 05 06:41:14.516937 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:14.516908    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:41:14.517446 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:14.517322    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:41:14.518016 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:14.517994    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:41:14.583221 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:14.583189    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0461ed26-2327-429b-803a-9a6a946ed9a7" path="/var/lib/kubelet/pods/0461ed26-2327-429b-803a-9a6a946ed9a7/volumes"
Sep 05 06:41:16.533251 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:16.533211    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q"]
Sep 05 06:41:16.533658 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:16.533581    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0461ed26-2327-429b-803a-9a6a946ed9a7" containerName="istio-proxy"
Sep 05 06:41:16.533658 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:16.533591    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0461ed26-2327-429b-803a-9a6a946ed9a7" containerName="istio-proxy"
Sep 05 06:41:16.533658 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:16.533617    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bae9d511-21c1-4424-bd0c-4714c2a25539" containerName="revoke-keys"
Sep 05 06:41:16.533658 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:16.533622    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="bae9d511-21c1-4424-bd0c-4714c2a25539" containerName="revoke-keys"
Sep 05 06:41:16.533658 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:16.533629    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0461ed26-2327-429b-803a-9a6a946ed9a7" containerName="istio-proxy"
Sep 05 06:41:16.533658 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:16.533635    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0461ed26-2327-429b-803a-9a6a946ed9a7" containerName="istio-proxy"
Sep 05 06:41:16.533857 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:16.533685    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0461ed26-2327-429b-803a-9a6a946ed9a7" containerName="istio-proxy"
Sep 05 06:41:16.533857 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:16.533693    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="bae9d511-21c1-4424-bd0c-4714c2a25539" containerName="revoke-keys"
Sep 05 06:41:16.533857 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:16.533702    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0461ed26-2327-429b-803a-9a6a946ed9a7" containerName="istio-proxy"
Sep 05 06:41:16.538281 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:16.538263    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q"
Sep 05 06:41:16.541557 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:16.541528    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-ea7120c2-dockercfg-d4vg5\""
Sep 05 06:41:16.541712 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:16.541581    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-ea7120c2\""
Sep 05 06:41:16.551226 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:16.551198    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q"]
Sep 05 06:41:16.632106 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:16.632070    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncq8l\" (UniqueName: \"kubernetes.io/projected/55b6d8db-8fe3-4c16-bd34-dad6f16d9d2b-kube-api-access-ncq8l\") pod \"payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q\" (UID: \"55b6d8db-8fe3-4c16-bd34-dad6f16d9d2b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q"
Sep 05 06:41:16.632325 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:16.632146    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55b6d8db-8fe3-4c16-bd34-dad6f16d9d2b-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q\" (UID: \"55b6d8db-8fe3-4c16-bd34-dad6f16d9d2b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q"
Sep 05 06:41:16.733304 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:16.733258    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55b6d8db-8fe3-4c16-bd34-dad6f16d9d2b-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q\" (UID: \"55b6d8db-8fe3-4c16-bd34-dad6f16d9d2b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q"
Sep 05 06:41:16.733495 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:16.733417    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncq8l\" (UniqueName: \"kubernetes.io/projected/55b6d8db-8fe3-4c16-bd34-dad6f16d9d2b-kube-api-access-ncq8l\") pod \"payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q\" (UID: \"55b6d8db-8fe3-4c16-bd34-dad6f16d9d2b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q"
Sep 05 06:41:16.734000 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:16.733977    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55b6d8db-8fe3-4c16-bd34-dad6f16d9d2b-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q\" (UID: \"55b6d8db-8fe3-4c16-bd34-dad6f16d9d2b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q"
Sep 05 06:41:16.752681 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:16.752646    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncq8l\" (UniqueName: \"kubernetes.io/projected/55b6d8db-8fe3-4c16-bd34-dad6f16d9d2b-kube-api-access-ncq8l\") pod \"payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q\" (UID: \"55b6d8db-8fe3-4c16-bd34-dad6f16d9d2b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q"
Sep 05 06:41:16.850495 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:16.850409    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q"
Sep 05 06:41:17.139576 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:17.139544    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q"]
Sep 05 06:41:17.142070 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:41:17.142018    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55b6d8db_8fe3_4c16_bd34_dad6f16d9d2b.slice/crio-9f5b2363d3ffda701ed2a17d4c9252e07c4a106f986fe670250635930c870a52 WatchSource:0}: Error finding container 9f5b2363d3ffda701ed2a17d4c9252e07c4a106f986fe670250635930c870a52: Status 404 returned error can't find the container with id 9f5b2363d3ffda701ed2a17d4c9252e07c4a106f986fe670250635930c870a52
Sep 05 06:41:17.909453 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:17.909410    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q" event={"ID":"55b6d8db-8fe3-4c16-bd34-dad6f16d9d2b","Type":"ContainerStarted","Data":"9f5b2363d3ffda701ed2a17d4c9252e07c4a106f986fe670250635930c870a52"}
Sep 05 06:41:19.787316 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:19.787279    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw"]
Sep 05 06:41:19.790839 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:19.790817    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw"
Sep 05 06:41:19.796116 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:19.796090    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-b-5cc5e81b-kserve-self-signed-certs\""
Sep 05 06:41:19.805273 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:19.805235    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw"]
Sep 05 06:41:19.869300 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:19.869257    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c2019d3-d2a9-47f7-a0d4-933ea16bdc60-dshm\") pod \"e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw\" (UID: \"7c2019d3-d2a9-47f7-a0d4-933ea16bdc60\") " pod="llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw"
Sep 05 06:41:19.869508 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:19.869318    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c2019d3-d2a9-47f7-a0d4-933ea16bdc60-home\") pod \"e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw\" (UID: \"7c2019d3-d2a9-47f7-a0d4-933ea16bdc60\") " pod="llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw"
Sep 05 06:41:19.869508 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:19.869390    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c2019d3-d2a9-47f7-a0d4-933ea16bdc60-tmp-dir\") pod \"e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw\" (UID: \"7c2019d3-d2a9-47f7-a0d4-933ea16bdc60\") " pod="llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw"
Sep 05 06:41:19.869508 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:19.869446    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgxzj\" (UniqueName: \"kubernetes.io/projected/7c2019d3-d2a9-47f7-a0d4-933ea16bdc60-kube-api-access-tgxzj\") pod \"e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw\" (UID: \"7c2019d3-d2a9-47f7-a0d4-933ea16bdc60\") " pod="llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw"
Sep 05 06:41:19.869508 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:19.869493    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c2019d3-d2a9-47f7-a0d4-933ea16bdc60-tls-certs\") pod \"e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw\" (UID: \"7c2019d3-d2a9-47f7-a0d4-933ea16bdc60\") " pod="llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw"
Sep 05 06:41:19.869732 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:19.869538    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c2019d3-d2a9-47f7-a0d4-933ea16bdc60-model-cache\") pod \"e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw\" (UID: \"7c2019d3-d2a9-47f7-a0d4-933ea16bdc60\") " pod="llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw"
Sep 05 06:41:19.924609 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:19.924571    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q" event={"ID":"55b6d8db-8fe3-4c16-bd34-dad6f16d9d2b","Type":"ContainerStarted","Data":"e508e551d9d412c98651752d9f35da78b08967f8afeb0fa13abf794fd12fc0fa"}
Sep 05 06:41:19.924802 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:19.924687    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q"
Sep 05 06:41:19.954948 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:19.954898    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q" podStartSLOduration=1.748893053 podStartE2EDuration="3.954880058s" totalImagesPullingTime="2.205987005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:41:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:41:19.953788293 +0000 UTC m=+945.927542970" watchObservedRunningTime="2026-09-05 06:41:19.954880058 +0000 UTC m=+945.928634732"
Sep 05 06:41:19.970097 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:19.970060    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c2019d3-d2a9-47f7-a0d4-933ea16bdc60-home\") pod \"e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw\" (UID: \"7c2019d3-d2a9-47f7-a0d4-933ea16bdc60\") " pod="llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw"
Sep 05 06:41:19.970097 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:19.970105    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c2019d3-d2a9-47f7-a0d4-933ea16bdc60-tmp-dir\") pod \"e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw\" (UID: \"7c2019d3-d2a9-47f7-a0d4-933ea16bdc60\") " pod="llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw"
Sep 05 06:41:19.970352 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:19.970138    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgxzj\" (UniqueName: \"kubernetes.io/projected/7c2019d3-d2a9-47f7-a0d4-933ea16bdc60-kube-api-access-tgxzj\") pod \"e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw\" (UID: \"7c2019d3-d2a9-47f7-a0d4-933ea16bdc60\") " pod="llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw"
Sep 05 06:41:19.970352 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:19.970163    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c2019d3-d2a9-47f7-a0d4-933ea16bdc60-tls-certs\") pod \"e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw\" (UID: \"7c2019d3-d2a9-47f7-a0d4-933ea16bdc60\") " pod="llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw"
Sep 05 06:41:19.970352 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:19.970200    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c2019d3-d2a9-47f7-a0d4-933ea16bdc60-model-cache\") pod \"e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw\" (UID: \"7c2019d3-d2a9-47f7-a0d4-933ea16bdc60\") " pod="llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw"
Sep 05 06:41:19.970352 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:19.970278    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c2019d3-d2a9-47f7-a0d4-933ea16bdc60-dshm\") pod \"e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw\" (UID: \"7c2019d3-d2a9-47f7-a0d4-933ea16bdc60\") " pod="llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw"
Sep 05 06:41:19.970568 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:19.970516    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c2019d3-d2a9-47f7-a0d4-933ea16bdc60-home\") pod \"e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw\" (UID: \"7c2019d3-d2a9-47f7-a0d4-933ea16bdc60\") " pod="llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw"
Sep 05 06:41:19.970568 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:19.970555    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c2019d3-d2a9-47f7-a0d4-933ea16bdc60-tmp-dir\") pod \"e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw\" (UID: \"7c2019d3-d2a9-47f7-a0d4-933ea16bdc60\") " pod="llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw"
Sep 05 06:41:19.970670 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:19.970598    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c2019d3-d2a9-47f7-a0d4-933ea16bdc60-model-cache\") pod \"e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw\" (UID: \"7c2019d3-d2a9-47f7-a0d4-933ea16bdc60\") " pod="llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw"
Sep 05 06:41:19.972746 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:19.972723    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c2019d3-d2a9-47f7-a0d4-933ea16bdc60-dshm\") pod \"e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw\" (UID: \"7c2019d3-d2a9-47f7-a0d4-933ea16bdc60\") " pod="llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw"
Sep 05 06:41:19.972885 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:19.972862    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c2019d3-d2a9-47f7-a0d4-933ea16bdc60-tls-certs\") pod \"e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw\" (UID: \"7c2019d3-d2a9-47f7-a0d4-933ea16bdc60\") " pod="llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw"
Sep 05 06:41:19.986635 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:19.986605    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgxzj\" (UniqueName: \"kubernetes.io/projected/7c2019d3-d2a9-47f7-a0d4-933ea16bdc60-kube-api-access-tgxzj\") pod \"e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw\" (UID: \"7c2019d3-d2a9-47f7-a0d4-933ea16bdc60\") " pod="llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw"
Sep 05 06:41:20.100786 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:20.100683    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw"
Sep 05 06:41:20.382134 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:20.382102    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw"]
Sep 05 06:41:20.383514 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:41:20.383487    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c2019d3_d2a9_47f7_a0d4_933ea16bdc60.slice/crio-d3df417133f44ea3cd98dcd4e7ebdb555bad1e7d0dded6d79b62c11969a218d6 WatchSource:0}: Error finding container d3df417133f44ea3cd98dcd4e7ebdb555bad1e7d0dded6d79b62c11969a218d6: Status 404 returned error can't find the container with id d3df417133f44ea3cd98dcd4e7ebdb555bad1e7d0dded6d79b62c11969a218d6
Sep 05 06:41:20.931617 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:20.931577    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw" event={"ID":"7c2019d3-d2a9-47f7-a0d4-933ea16bdc60","Type":"ContainerStarted","Data":"c7f6f08e651233dfd0031cd3633d5130ca8c8f82f266e29fe4a14fd62b27a2bf"}
Sep 05 06:41:20.931617 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:20.931624    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw" event={"ID":"7c2019d3-d2a9-47f7-a0d4-933ea16bdc60","Type":"ContainerStarted","Data":"d3df417133f44ea3cd98dcd4e7ebdb555bad1e7d0dded6d79b62c11969a218d6"}
Sep 05 06:41:20.959464 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:20.959412    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw" podStartSLOduration=1.9593932760000001 podStartE2EDuration="1.959393276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:41:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:41:20.95676858 +0000 UTC m=+946.930523247" watchObservedRunningTime="2026-09-05 06:41:20.959393276 +0000 UTC m=+946.933147951"
Sep 05 06:41:30.101344 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:30.101307    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw"
Sep 05 06:41:30.101843 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:30.101372    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw"
Sep 05 06:41:30.114116 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:30.114093    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw"
Sep 05 06:41:30.934102 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:30.934068    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q"
Sep 05 06:41:30.997732 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:30.997704    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw"
Sep 05 06:41:38.038788 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:38.038749    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw"]
Sep 05 06:41:39.526175 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:39.526142    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e04a57-hvn9p"]
Sep 05 06:41:39.530810 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:39.530794    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e04a57-hvn9p"
Sep 05 06:41:39.533792 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:39.533757    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 05 06:41:39.533955 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:39.533858    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tlgjj\""
Sep 05 06:41:39.537995 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:39.537969    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e04a57-hvn9p"]
Sep 05 06:41:39.574895 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:39.574855    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/261fa8b4-40d9-43b3-ade2-11d8e83004c6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-e04a57-hvn9p\" (UID: \"261fa8b4-40d9-43b3-ade2-11d8e83004c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e04a57-hvn9p"
Sep 05 06:41:39.675709 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:39.675667    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/261fa8b4-40d9-43b3-ade2-11d8e83004c6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-e04a57-hvn9p\" (UID: \"261fa8b4-40d9-43b3-ade2-11d8e83004c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e04a57-hvn9p"
Sep 05 06:41:39.676316 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:39.676295    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/261fa8b4-40d9-43b3-ade2-11d8e83004c6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-e04a57-hvn9p\" (UID: \"261fa8b4-40d9-43b3-ade2-11d8e83004c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e04a57-hvn9p"
Sep 05 06:41:39.842700 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:39.842619    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e04a57-hvn9p"
Sep 05 06:41:40.118766 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:40.118741    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e04a57-hvn9p"]
Sep 05 06:41:40.120523 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:41:40.120492    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod261fa8b4_40d9_43b3_ade2_11d8e83004c6.slice/crio-194b43957a0fd10a425d7d6a70f889a3af92e68874e50b1468e90ad6c4809551 WatchSource:0}: Error finding container 194b43957a0fd10a425d7d6a70f889a3af92e68874e50b1468e90ad6c4809551: Status 404 returned error can't find the container with id 194b43957a0fd10a425d7d6a70f889a3af92e68874e50b1468e90ad6c4809551
Sep 05 06:41:41.037184 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:41.037149    2567 generic.go:356] "Generic (PLEG): container finished" podID="261fa8b4-40d9-43b3-ade2-11d8e83004c6" containerID="b9fc421c02e6d401bd24687ff48d4d00c94019589aba046ac44c940864e4c9ea" exitCode=0
Sep 05 06:41:41.037559 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:41.037234    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e04a57-hvn9p" event={"ID":"261fa8b4-40d9-43b3-ade2-11d8e83004c6","Type":"ContainerDied","Data":"b9fc421c02e6d401bd24687ff48d4d00c94019589aba046ac44c940864e4c9ea"}
Sep 05 06:41:41.037559 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:41.037288    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e04a57-hvn9p" event={"ID":"261fa8b4-40d9-43b3-ade2-11d8e83004c6","Type":"ContainerStarted","Data":"194b43957a0fd10a425d7d6a70f889a3af92e68874e50b1468e90ad6c4809551"}
Sep 05 06:41:42.180343 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:42.180311    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e04a57-hvn9p"
Sep 05 06:41:42.303555 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:42.303458    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/261fa8b4-40d9-43b3-ade2-11d8e83004c6-maas-api-service-ca\") pod \"261fa8b4-40d9-43b3-ade2-11d8e83004c6\" (UID: \"261fa8b4-40d9-43b3-ade2-11d8e83004c6\") "
Sep 05 06:41:42.303796 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:42.303772    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/261fa8b4-40d9-43b3-ade2-11d8e83004c6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "261fa8b4-40d9-43b3-ade2-11d8e83004c6" (UID: "261fa8b4-40d9-43b3-ade2-11d8e83004c6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:41:42.303923 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:42.303910    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/261fa8b4-40d9-43b3-ade2-11d8e83004c6-maas-api-service-ca\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:41:43.049142 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:43.049103    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e04a57-hvn9p" event={"ID":"261fa8b4-40d9-43b3-ade2-11d8e83004c6","Type":"ContainerDied","Data":"194b43957a0fd10a425d7d6a70f889a3af92e68874e50b1468e90ad6c4809551"}
Sep 05 06:41:43.049328 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:43.049164    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e04a57-hvn9p"
Sep 05 06:41:43.049328 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:43.049188    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="194b43957a0fd10a425d7d6a70f889a3af92e68874e50b1468e90ad6c4809551"
Sep 05 06:41:50.717290 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:50.717252    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e04a57-hvn9p"]
Sep 05 06:41:50.719971 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:50.719945    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e04a57-hvn9p"]
Sep 05 06:41:52.582050 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:52.581986    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="261fa8b4-40d9-43b3-ade2-11d8e83004c6" path="/var/lib/kubelet/pods/261fa8b4-40d9-43b3-ade2-11d8e83004c6/volumes"
Sep 05 06:41:53.059987 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:53.059927    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw" podUID="7c2019d3-d2a9-47f7-a0d4-933ea16bdc60" containerName="main" containerID="cri-o://c7f6f08e651233dfd0031cd3633d5130ca8c8f82f266e29fe4a14fd62b27a2bf" gracePeriod=45
Sep 05 06:41:53.325907 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:53.325841    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw"
Sep 05 06:41:53.414255 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:53.414207    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgxzj\" (UniqueName: \"kubernetes.io/projected/7c2019d3-d2a9-47f7-a0d4-933ea16bdc60-kube-api-access-tgxzj\") pod \"7c2019d3-d2a9-47f7-a0d4-933ea16bdc60\" (UID: \"7c2019d3-d2a9-47f7-a0d4-933ea16bdc60\") "
Sep 05 06:41:53.414440 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:53.414288    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c2019d3-d2a9-47f7-a0d4-933ea16bdc60-tls-certs\") pod \"7c2019d3-d2a9-47f7-a0d4-933ea16bdc60\" (UID: \"7c2019d3-d2a9-47f7-a0d4-933ea16bdc60\") "
Sep 05 06:41:53.414440 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:53.414355    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c2019d3-d2a9-47f7-a0d4-933ea16bdc60-home\") pod \"7c2019d3-d2a9-47f7-a0d4-933ea16bdc60\" (UID: \"7c2019d3-d2a9-47f7-a0d4-933ea16bdc60\") "
Sep 05 06:41:53.414644 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:53.414513    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c2019d3-d2a9-47f7-a0d4-933ea16bdc60-model-cache\") pod \"7c2019d3-d2a9-47f7-a0d4-933ea16bdc60\" (UID: \"7c2019d3-d2a9-47f7-a0d4-933ea16bdc60\") "
Sep 05 06:41:53.414644 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:53.414570    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c2019d3-d2a9-47f7-a0d4-933ea16bdc60-dshm\") pod \"7c2019d3-d2a9-47f7-a0d4-933ea16bdc60\" (UID: \"7c2019d3-d2a9-47f7-a0d4-933ea16bdc60\") "
Sep 05 06:41:53.414644 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:53.414600    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c2019d3-d2a9-47f7-a0d4-933ea16bdc60-tmp-dir\") pod \"7c2019d3-d2a9-47f7-a0d4-933ea16bdc60\" (UID: \"7c2019d3-d2a9-47f7-a0d4-933ea16bdc60\") "
Sep 05 06:41:53.414644 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:53.414571    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c2019d3-d2a9-47f7-a0d4-933ea16bdc60-home" (OuterVolumeSpecName: "home") pod "7c2019d3-d2a9-47f7-a0d4-933ea16bdc60" (UID: "7c2019d3-d2a9-47f7-a0d4-933ea16bdc60"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:41:53.414861 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:53.414761    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c2019d3-d2a9-47f7-a0d4-933ea16bdc60-model-cache" (OuterVolumeSpecName: "model-cache") pod "7c2019d3-d2a9-47f7-a0d4-933ea16bdc60" (UID: "7c2019d3-d2a9-47f7-a0d4-933ea16bdc60"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:41:53.414929 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:53.414899    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c2019d3-d2a9-47f7-a0d4-933ea16bdc60-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7c2019d3-d2a9-47f7-a0d4-933ea16bdc60" (UID: "7c2019d3-d2a9-47f7-a0d4-933ea16bdc60"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:41:53.414989 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:53.414975    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c2019d3-d2a9-47f7-a0d4-933ea16bdc60-home\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:41:53.415209 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:53.414990    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c2019d3-d2a9-47f7-a0d4-933ea16bdc60-model-cache\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:41:53.415209 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:53.415000    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c2019d3-d2a9-47f7-a0d4-933ea16bdc60-tmp-dir\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:41:53.416710 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:53.416678    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c2019d3-d2a9-47f7-a0d4-933ea16bdc60-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7c2019d3-d2a9-47f7-a0d4-933ea16bdc60" (UID: "7c2019d3-d2a9-47f7-a0d4-933ea16bdc60"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 05 06:41:53.416833 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:53.416761    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c2019d3-d2a9-47f7-a0d4-933ea16bdc60-kube-api-access-tgxzj" (OuterVolumeSpecName: "kube-api-access-tgxzj") pod "7c2019d3-d2a9-47f7-a0d4-933ea16bdc60" (UID: "7c2019d3-d2a9-47f7-a0d4-933ea16bdc60"). InnerVolumeSpecName "kube-api-access-tgxzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:41:53.416833 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:53.416767    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c2019d3-d2a9-47f7-a0d4-933ea16bdc60-dshm" (OuterVolumeSpecName: "dshm") pod "7c2019d3-d2a9-47f7-a0d4-933ea16bdc60" (UID: "7c2019d3-d2a9-47f7-a0d4-933ea16bdc60"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:41:53.515558 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:53.515518    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c2019d3-d2a9-47f7-a0d4-933ea16bdc60-dshm\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:41:53.515558 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:53.515552    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgxzj\" (UniqueName: \"kubernetes.io/projected/7c2019d3-d2a9-47f7-a0d4-933ea16bdc60-kube-api-access-tgxzj\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:41:53.515558 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:53.515567    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c2019d3-d2a9-47f7-a0d4-933ea16bdc60-tls-certs\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:41:54.107963 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:54.107928    2567 generic.go:356] "Generic (PLEG): container finished" podID="7c2019d3-d2a9-47f7-a0d4-933ea16bdc60" containerID="c7f6f08e651233dfd0031cd3633d5130ca8c8f82f266e29fe4a14fd62b27a2bf" exitCode=0
Sep 05 06:41:54.108417 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:54.107970    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw"
Sep 05 06:41:54.108417 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:54.108011    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw" event={"ID":"7c2019d3-d2a9-47f7-a0d4-933ea16bdc60","Type":"ContainerDied","Data":"c7f6f08e651233dfd0031cd3633d5130ca8c8f82f266e29fe4a14fd62b27a2bf"}
Sep 05 06:41:54.108417 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:54.108068    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw" event={"ID":"7c2019d3-d2a9-47f7-a0d4-933ea16bdc60","Type":"ContainerDied","Data":"d3df417133f44ea3cd98dcd4e7ebdb555bad1e7d0dded6d79b62c11969a218d6"}
Sep 05 06:41:54.108417 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:54.108085    2567 scope.go:117] "RemoveContainer" containerID="c7f6f08e651233dfd0031cd3633d5130ca8c8f82f266e29fe4a14fd62b27a2bf"
Sep 05 06:41:54.117807 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:54.117787    2567 scope.go:117] "RemoveContainer" containerID="c7f6f08e651233dfd0031cd3633d5130ca8c8f82f266e29fe4a14fd62b27a2bf"
Sep 05 06:41:54.118096 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:41:54.118078    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7f6f08e651233dfd0031cd3633d5130ca8c8f82f266e29fe4a14fd62b27a2bf\": container with ID starting with c7f6f08e651233dfd0031cd3633d5130ca8c8f82f266e29fe4a14fd62b27a2bf not found: ID does not exist" containerID="c7f6f08e651233dfd0031cd3633d5130ca8c8f82f266e29fe4a14fd62b27a2bf"
Sep 05 06:41:54.118157 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:54.118105    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7f6f08e651233dfd0031cd3633d5130ca8c8f82f266e29fe4a14fd62b27a2bf"} err="failed to get container status \"c7f6f08e651233dfd0031cd3633d5130ca8c8f82f266e29fe4a14fd62b27a2bf\": rpc error: code = NotFound desc = could not find container \"c7f6f08e651233dfd0031cd3633d5130ca8c8f82f266e29fe4a14fd62b27a2bf\": container with ID starting with c7f6f08e651233dfd0031cd3633d5130ca8c8f82f266e29fe4a14fd62b27a2bf not found: ID does not exist"
Sep 05 06:41:54.130923 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:54.130902    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw"]
Sep 05 06:41:54.135259 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:54.135241    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-b-5cc5e81b-kserve-5c7484687c-m9tcw"]
Sep 05 06:41:54.581461 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:54.581428    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c2019d3-d2a9-47f7-a0d4-933ea16bdc60" path="/var/lib/kubelet/pods/7c2019d3-d2a9-47f7-a0d4-933ea16bdc60/volumes"
Sep 05 06:41:56.679730 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:56.679701    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q"]
Sep 05 06:41:56.680237 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:56.679919    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q" podUID="55b6d8db-8fe3-4c16-bd34-dad6f16d9d2b" containerName="payload-pre-processing" containerID="cri-o://e508e551d9d412c98651752d9f35da78b08967f8afeb0fa13abf794fd12fc0fa" gracePeriod=30
Sep 05 06:41:56.961834 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:56.961806    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q"
Sep 05 06:41:57.055542 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:57.055506    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55b6d8db-8fe3-4c16-bd34-dad6f16d9d2b-plugins-config-volume\") pod \"55b6d8db-8fe3-4c16-bd34-dad6f16d9d2b\" (UID: \"55b6d8db-8fe3-4c16-bd34-dad6f16d9d2b\") "
Sep 05 06:41:57.055764 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:57.055677    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncq8l\" (UniqueName: \"kubernetes.io/projected/55b6d8db-8fe3-4c16-bd34-dad6f16d9d2b-kube-api-access-ncq8l\") pod \"55b6d8db-8fe3-4c16-bd34-dad6f16d9d2b\" (UID: \"55b6d8db-8fe3-4c16-bd34-dad6f16d9d2b\") "
Sep 05 06:41:57.055972 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:57.055946    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55b6d8db-8fe3-4c16-bd34-dad6f16d9d2b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "55b6d8db-8fe3-4c16-bd34-dad6f16d9d2b" (UID: "55b6d8db-8fe3-4c16-bd34-dad6f16d9d2b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:41:57.059237 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:57.059204    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55b6d8db-8fe3-4c16-bd34-dad6f16d9d2b-kube-api-access-ncq8l" (OuterVolumeSpecName: "kube-api-access-ncq8l") pod "55b6d8db-8fe3-4c16-bd34-dad6f16d9d2b" (UID: "55b6d8db-8fe3-4c16-bd34-dad6f16d9d2b"). InnerVolumeSpecName "kube-api-access-ncq8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:41:57.126504 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:57.126468    2567 generic.go:356] "Generic (PLEG): container finished" podID="55b6d8db-8fe3-4c16-bd34-dad6f16d9d2b" containerID="e508e551d9d412c98651752d9f35da78b08967f8afeb0fa13abf794fd12fc0fa" exitCode=0
Sep 05 06:41:57.126681 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:57.126515    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q"
Sep 05 06:41:57.126681 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:57.126549    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q" event={"ID":"55b6d8db-8fe3-4c16-bd34-dad6f16d9d2b","Type":"ContainerDied","Data":"e508e551d9d412c98651752d9f35da78b08967f8afeb0fa13abf794fd12fc0fa"}
Sep 05 06:41:57.126681 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:57.126605    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q" event={"ID":"55b6d8db-8fe3-4c16-bd34-dad6f16d9d2b","Type":"ContainerDied","Data":"9f5b2363d3ffda701ed2a17d4c9252e07c4a106f986fe670250635930c870a52"}
Sep 05 06:41:57.126681 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:57.126629    2567 scope.go:117] "RemoveContainer" containerID="e508e551d9d412c98651752d9f35da78b08967f8afeb0fa13abf794fd12fc0fa"
Sep 05 06:41:57.153692 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:57.153517    2567 scope.go:117] "RemoveContainer" containerID="e508e551d9d412c98651752d9f35da78b08967f8afeb0fa13abf794fd12fc0fa"
Sep 05 06:41:57.154094 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:41:57.154053    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e508e551d9d412c98651752d9f35da78b08967f8afeb0fa13abf794fd12fc0fa\": container with ID starting with e508e551d9d412c98651752d9f35da78b08967f8afeb0fa13abf794fd12fc0fa not found: ID does not exist" containerID="e508e551d9d412c98651752d9f35da78b08967f8afeb0fa13abf794fd12fc0fa"
Sep 05 06:41:57.154205 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:57.154099    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e508e551d9d412c98651752d9f35da78b08967f8afeb0fa13abf794fd12fc0fa"} err="failed to get container status \"e508e551d9d412c98651752d9f35da78b08967f8afeb0fa13abf794fd12fc0fa\": rpc error: code = NotFound desc = could not find container \"e508e551d9d412c98651752d9f35da78b08967f8afeb0fa13abf794fd12fc0fa\": container with ID starting with e508e551d9d412c98651752d9f35da78b08967f8afeb0fa13abf794fd12fc0fa not found: ID does not exist"
Sep 05 06:41:57.158056 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:57.157153    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncq8l\" (UniqueName: \"kubernetes.io/projected/55b6d8db-8fe3-4c16-bd34-dad6f16d9d2b-kube-api-access-ncq8l\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:41:57.158056 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:57.157181    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55b6d8db-8fe3-4c16-bd34-dad6f16d9d2b-plugins-config-volume\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:41:57.162051 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:57.161817    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q"]
Sep 05 06:41:57.173790 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:57.173305    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q"]
Sep 05 06:41:57.831899 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:57.831866    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"]
Sep 05 06:41:57.832289 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:57.832269    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c2019d3-d2a9-47f7-a0d4-933ea16bdc60" containerName="main"
Sep 05 06:41:57.832289 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:57.832283    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c2019d3-d2a9-47f7-a0d4-933ea16bdc60" containerName="main"
Sep 05 06:41:57.832361 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:57.832295    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55b6d8db-8fe3-4c16-bd34-dad6f16d9d2b" containerName="payload-pre-processing"
Sep 05 06:41:57.832361 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:57.832301    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="55b6d8db-8fe3-4c16-bd34-dad6f16d9d2b" containerName="payload-pre-processing"
Sep 05 06:41:57.832361 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:57.832309    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="261fa8b4-40d9-43b3-ade2-11d8e83004c6" containerName="revoke-keys"
Sep 05 06:41:57.832361 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:57.832315    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="261fa8b4-40d9-43b3-ade2-11d8e83004c6" containerName="revoke-keys"
Sep 05 06:41:57.832486 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:57.832378    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="55b6d8db-8fe3-4c16-bd34-dad6f16d9d2b" containerName="payload-pre-processing"
Sep 05 06:41:57.832486 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:57.832390    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c2019d3-d2a9-47f7-a0d4-933ea16bdc60" containerName="main"
Sep 05 06:41:57.832486 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:57.832395    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="261fa8b4-40d9-43b3-ade2-11d8e83004c6" containerName="revoke-keys"
Sep 05 06:41:57.837485 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:57.837465    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:41:57.840560 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:57.840537    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-46fa710a-openshift-default-dockercfg-mgcwr\""
Sep 05 06:41:57.853256 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:57.853231    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"]
Sep 05 06:41:57.964657 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:57.964615    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4be56ba-c269-408c-9aef-a9c9ee9b5566-istiod-ca-cert\") pod \"e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4\" (UID: \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\") " pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:41:57.964657 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:57.964665    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4be56ba-c269-408c-9aef-a9c9ee9b5566-istio-envoy\") pod \"e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4\" (UID: \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\") " pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:41:57.964878 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:57.964697    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4be56ba-c269-408c-9aef-a9c9ee9b5566-workload-certs\") pod \"e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4\" (UID: \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\") " pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:41:57.964878 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:57.964798    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4be56ba-c269-408c-9aef-a9c9ee9b5566-istio-data\") pod \"e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4\" (UID: \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\") " pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:41:57.964878 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:57.964836    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4be56ba-c269-408c-9aef-a9c9ee9b5566-istio-token\") pod \"e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4\" (UID: \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\") " pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:41:57.964977 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:57.964887    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4be56ba-c269-408c-9aef-a9c9ee9b5566-istio-podinfo\") pod \"e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4\" (UID: \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\") " pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:41:57.964977 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:57.964926    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbtsr\" (UniqueName: \"kubernetes.io/projected/c4be56ba-c269-408c-9aef-a9c9ee9b5566-kube-api-access-lbtsr\") pod \"e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4\" (UID: \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\") " pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:41:57.964977 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:57.964959    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4be56ba-c269-408c-9aef-a9c9ee9b5566-credential-socket\") pod \"e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4\" (UID: \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\") " pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:41:57.964977 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:57.964975    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4be56ba-c269-408c-9aef-a9c9ee9b5566-workload-socket\") pod \"e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4\" (UID: \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\") " pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:41:58.065981 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:58.065942    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4be56ba-c269-408c-9aef-a9c9ee9b5566-istio-envoy\") pod \"e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4\" (UID: \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\") " pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:41:58.066197 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:58.065997    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4be56ba-c269-408c-9aef-a9c9ee9b5566-workload-certs\") pod \"e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4\" (UID: \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\") " pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:41:58.066197 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:58.066079    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4be56ba-c269-408c-9aef-a9c9ee9b5566-istio-data\") pod \"e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4\" (UID: \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\") " pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:41:58.066197 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:58.066113    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4be56ba-c269-408c-9aef-a9c9ee9b5566-istio-token\") pod \"e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4\" (UID: \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\") " pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:41:58.066197 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:58.066144    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4be56ba-c269-408c-9aef-a9c9ee9b5566-istio-podinfo\") pod \"e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4\" (UID: \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\") " pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:41:58.066197 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:58.066183    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbtsr\" (UniqueName: \"kubernetes.io/projected/c4be56ba-c269-408c-9aef-a9c9ee9b5566-kube-api-access-lbtsr\") pod \"e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4\" (UID: \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\") " pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:41:58.066455 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:58.066319    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4be56ba-c269-408c-9aef-a9c9ee9b5566-credential-socket\") pod \"e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4\" (UID: \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\") " pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:41:58.066455 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:58.066354    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4be56ba-c269-408c-9aef-a9c9ee9b5566-workload-socket\") pod \"e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4\" (UID: \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\") " pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:41:58.066455 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:58.066400    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4be56ba-c269-408c-9aef-a9c9ee9b5566-istiod-ca-cert\") pod \"e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4\" (UID: \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\") " pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:41:58.066613 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:58.066484    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4be56ba-c269-408c-9aef-a9c9ee9b5566-istio-data\") pod \"e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4\" (UID: \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\") " pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:41:58.066700 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:58.066678    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4be56ba-c269-408c-9aef-a9c9ee9b5566-credential-socket\") pod \"e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4\" (UID: \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\") " pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:41:58.066766 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:58.066743    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4be56ba-c269-408c-9aef-a9c9ee9b5566-workload-socket\") pod \"e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4\" (UID: \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\") " pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:41:58.066814 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:58.066794    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4be56ba-c269-408c-9aef-a9c9ee9b5566-workload-certs\") pod \"e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4\" (UID: \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\") " pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:41:58.067048 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:58.067006    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4be56ba-c269-408c-9aef-a9c9ee9b5566-istiod-ca-cert\") pod \"e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4\" (UID: \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\") " pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:41:58.068472 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:58.068451    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4be56ba-c269-408c-9aef-a9c9ee9b5566-istio-envoy\") pod \"e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4\" (UID: \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\") " pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:41:58.068792 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:58.068777    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4be56ba-c269-408c-9aef-a9c9ee9b5566-istio-podinfo\") pod \"e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4\" (UID: \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\") " pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:41:58.075729 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:58.075702    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4be56ba-c269-408c-9aef-a9c9ee9b5566-istio-token\") pod \"e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4\" (UID: \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\") " pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:41:58.075927 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:58.075905    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbtsr\" (UniqueName: \"kubernetes.io/projected/c4be56ba-c269-408c-9aef-a9c9ee9b5566-kube-api-access-lbtsr\") pod \"e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4\" (UID: \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\") " pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:41:58.152873 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:58.152783    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:41:58.437505 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:58.437471    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"]
Sep 05 06:41:58.439769 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:41:58.439740    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4be56ba_c269_408c_9aef_a9c9ee9b5566.slice/crio-ee3accea3417f3bedd1e4c87e4320dcc346525ea5b2d59aa97be5093e25f3e84 WatchSource:0}: Error finding container ee3accea3417f3bedd1e4c87e4320dcc346525ea5b2d59aa97be5093e25f3e84: Status 404 returned error can't find the container with id ee3accea3417f3bedd1e4c87e4320dcc346525ea5b2d59aa97be5093e25f3e84
Sep 05 06:41:58.442256 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:58.442217    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:41:58.442363 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:58.442291    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:41:58.442363 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:58.442321    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:41:58.534402 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:58.534370    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"]
Sep 05 06:41:58.534606 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:58.534578    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf" podUID="eef506fe-5b3a-4ef9-9b40-62ad9082fe08" containerName="istio-proxy" containerID="cri-o://6cd647619cc0d81000ceda6a1ab11b157ecff10a834351d4d4929117ca43f93d" gracePeriod=30
Sep 05 06:41:58.588461 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:58.588413    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55b6d8db-8fe3-4c16-bd34-dad6f16d9d2b" path="/var/lib/kubelet/pods/55b6d8db-8fe3-4c16-bd34-dad6f16d9d2b/volumes"
Sep 05 06:41:58.940674 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:58.940634    2567 patch_prober.go:28] interesting pod/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 05 06:41:58.941076 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:58.940700    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf" podUID="eef506fe-5b3a-4ef9-9b40-62ad9082fe08" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 05 06:41:59.141202 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:59.141159    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4" event={"ID":"c4be56ba-c269-408c-9aef-a9c9ee9b5566","Type":"ContainerStarted","Data":"2fe81ddbec3b26a8e7ed4887269b6791e5d4cd44bdf1a4fa0cb0cc936cd0eee4"}
Sep 05 06:41:59.141381 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:59.141219    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4" event={"ID":"c4be56ba-c269-408c-9aef-a9c9ee9b5566","Type":"ContainerStarted","Data":"ee3accea3417f3bedd1e4c87e4320dcc346525ea5b2d59aa97be5093e25f3e84"}
Sep 05 06:41:59.153363 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:59.153335    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:41:59.158372 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:59.158348    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:41:59.172710 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:41:59.172663    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4" podStartSLOduration=2.172646202 podStartE2EDuration="2.172646202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:41:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:41:59.170678527 +0000 UTC m=+985.144433203" watchObservedRunningTime="2026-09-05 06:41:59.172646202 +0000 UTC m=+985.146400876"
Sep 05 06:42:00.146322 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:00.146287    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:42:00.147433 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:00.147410    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:42:02.601589 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:02.601548    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs"]
Sep 05 06:42:02.605137 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:02.605115    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs"
Sep 05 06:42:02.609300 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:02.609273    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-46fa710a\""
Sep 05 06:42:02.620022 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:02.619993    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs"]
Sep 05 06:42:02.715400 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:02.715357    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d90696f1-ab91-4bbf-a229-8bd89d67b68b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs\" (UID: \"d90696f1-ab91-4bbf-a229-8bd89d67b68b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs"
Sep 05 06:42:02.715610 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:02.715517    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl6xs\" (UniqueName: \"kubernetes.io/projected/d90696f1-ab91-4bbf-a229-8bd89d67b68b-kube-api-access-cl6xs\") pod \"payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs\" (UID: \"d90696f1-ab91-4bbf-a229-8bd89d67b68b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs"
Sep 05 06:42:02.816746 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:02.816697    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d90696f1-ab91-4bbf-a229-8bd89d67b68b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs\" (UID: \"d90696f1-ab91-4bbf-a229-8bd89d67b68b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs"
Sep 05 06:42:02.816914 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:02.816870    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl6xs\" (UniqueName: \"kubernetes.io/projected/d90696f1-ab91-4bbf-a229-8bd89d67b68b-kube-api-access-cl6xs\") pod \"payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs\" (UID: \"d90696f1-ab91-4bbf-a229-8bd89d67b68b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs"
Sep 05 06:42:02.817418 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:02.817397    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d90696f1-ab91-4bbf-a229-8bd89d67b68b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs\" (UID: \"d90696f1-ab91-4bbf-a229-8bd89d67b68b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs"
Sep 05 06:42:02.833352 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:02.833320    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl6xs\" (UniqueName: \"kubernetes.io/projected/d90696f1-ab91-4bbf-a229-8bd89d67b68b-kube-api-access-cl6xs\") pod \"payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs\" (UID: \"d90696f1-ab91-4bbf-a229-8bd89d67b68b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs"
Sep 05 06:42:02.916480 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:02.916388    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs"
Sep 05 06:42:03.197692 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:03.197655    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs"]
Sep 05 06:42:03.199774 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:42:03.199743    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd90696f1_ab91_4bbf_a229_8bd89d67b68b.slice/crio-9e888dfc8b255098f16a6ef1d4a1017de0ee2ccc0639eec0f77899e33c20836a WatchSource:0}: Error finding container 9e888dfc8b255098f16a6ef1d4a1017de0ee2ccc0639eec0f77899e33c20836a: Status 404 returned error can't find the container with id 9e888dfc8b255098f16a6ef1d4a1017de0ee2ccc0639eec0f77899e33c20836a
Sep 05 06:42:03.791172 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:03.791116    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:42:03.928855 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:03.928820    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-credential-socket\") pod \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\" (UID: \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\") "
Sep 05 06:42:03.928855 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:03.928859    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8ftb\" (UniqueName: \"kubernetes.io/projected/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-kube-api-access-k8ftb\") pod \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\" (UID: \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\") "
Sep 05 06:42:03.929127 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:03.928887    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-istio-podinfo\") pod \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\" (UID: \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\") "
Sep 05 06:42:03.929127 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:03.928911    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-workload-socket\") pod \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\" (UID: \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\") "
Sep 05 06:42:03.929127 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:03.929102    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-istio-data\") pod \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\" (UID: \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\") "
Sep 05 06:42:03.929294 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:03.929150    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-istio-token\") pod \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\" (UID: \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\") "
Sep 05 06:42:03.929294 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:03.929201    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eef506fe-5b3a-4ef9-9b40-62ad9082fe08" (UID: "eef506fe-5b3a-4ef9-9b40-62ad9082fe08"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:42:03.929294 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:03.929209    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-istio-envoy\") pod \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\" (UID: \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\") "
Sep 05 06:42:03.929448 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:03.929371    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-istiod-ca-cert\") pod \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\" (UID: \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\") "
Sep 05 06:42:03.929448 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:03.929219    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eef506fe-5b3a-4ef9-9b40-62ad9082fe08" (UID: "eef506fe-5b3a-4ef9-9b40-62ad9082fe08"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:42:03.929448 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:03.929395    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-istio-data" (OuterVolumeSpecName: "istio-data") pod "eef506fe-5b3a-4ef9-9b40-62ad9082fe08" (UID: "eef506fe-5b3a-4ef9-9b40-62ad9082fe08"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:42:03.929448 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:03.929404    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-workload-certs\") pod \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\" (UID: \"eef506fe-5b3a-4ef9-9b40-62ad9082fe08\") "
Sep 05 06:42:03.929660 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:03.929643    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eef506fe-5b3a-4ef9-9b40-62ad9082fe08" (UID: "eef506fe-5b3a-4ef9-9b40-62ad9082fe08"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:42:03.929716 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:03.929692    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eef506fe-5b3a-4ef9-9b40-62ad9082fe08" (UID: "eef506fe-5b3a-4ef9-9b40-62ad9082fe08"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:42:03.930084 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:03.929996    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-credential-socket\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:42:03.930181 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:03.930090    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-workload-socket\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:42:03.930181 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:03.930107    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-istio-data\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:42:03.930181 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:03.930120    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-istiod-ca-cert\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:42:03.930181 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:03.930132    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-workload-certs\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:42:03.931644 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:03.931619    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-istio-token" (OuterVolumeSpecName: "istio-token") pod "eef506fe-5b3a-4ef9-9b40-62ad9082fe08" (UID: "eef506fe-5b3a-4ef9-9b40-62ad9082fe08"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:42:03.931644 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:03.931627    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eef506fe-5b3a-4ef9-9b40-62ad9082fe08" (UID: "eef506fe-5b3a-4ef9-9b40-62ad9082fe08"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:42:03.931644 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:03.931634    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eef506fe-5b3a-4ef9-9b40-62ad9082fe08" (UID: "eef506fe-5b3a-4ef9-9b40-62ad9082fe08"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 05 06:42:03.931832 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:03.931818    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-kube-api-access-k8ftb" (OuterVolumeSpecName: "kube-api-access-k8ftb") pod "eef506fe-5b3a-4ef9-9b40-62ad9082fe08" (UID: "eef506fe-5b3a-4ef9-9b40-62ad9082fe08"). InnerVolumeSpecName "kube-api-access-k8ftb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:42:04.031461 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:04.031405    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-istio-envoy\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:42:04.031671 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:04.031455    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8ftb\" (UniqueName: \"kubernetes.io/projected/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-kube-api-access-k8ftb\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:42:04.037432 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:04.031927    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-istio-podinfo\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:42:04.037432 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:04.031953    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eef506fe-5b3a-4ef9-9b40-62ad9082fe08-istio-token\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:42:04.169172 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:04.169070    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs" event={"ID":"d90696f1-ab91-4bbf-a229-8bd89d67b68b","Type":"ContainerStarted","Data":"578792c4c94a8725a73e19a2d47d584eed743d1185d4826b92b691a7ce042539"}
Sep 05 06:42:04.169345 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:04.169188    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs"
Sep 05 06:42:04.169345 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:04.169216    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs" event={"ID":"d90696f1-ab91-4bbf-a229-8bd89d67b68b","Type":"ContainerStarted","Data":"9e888dfc8b255098f16a6ef1d4a1017de0ee2ccc0639eec0f77899e33c20836a"}
Sep 05 06:42:04.171115 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:04.171090    2567 generic.go:356] "Generic (PLEG): container finished" podID="eef506fe-5b3a-4ef9-9b40-62ad9082fe08" containerID="6cd647619cc0d81000ceda6a1ab11b157ecff10a834351d4d4929117ca43f93d" exitCode=0
Sep 05 06:42:04.171228 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:04.171134    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf" event={"ID":"eef506fe-5b3a-4ef9-9b40-62ad9082fe08","Type":"ContainerDied","Data":"6cd647619cc0d81000ceda6a1ab11b157ecff10a834351d4d4929117ca43f93d"}
Sep 05 06:42:04.171228 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:04.171167    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"
Sep 05 06:42:04.171228 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:04.171187    2567 scope.go:117] "RemoveContainer" containerID="6cd647619cc0d81000ceda6a1ab11b157ecff10a834351d4d4929117ca43f93d"
Sep 05 06:42:04.171374 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:04.171177    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf" event={"ID":"eef506fe-5b3a-4ef9-9b40-62ad9082fe08","Type":"ContainerDied","Data":"d33764498563c6676d81552d1af605e1587b38cd5bcb1d80abccd5ba85a33b1b"}
Sep 05 06:42:04.181084 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:04.181066    2567 scope.go:117] "RemoveContainer" containerID="2bd7b9122afff638b37bd704364a35024f551943be7745a21a969caafc827976"
Sep 05 06:42:04.188182 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:04.188133    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs" podStartSLOduration=2.188114473 podStartE2EDuration="2.188114473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:42:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:42:04.186198749 +0000 UTC m=+990.159953462" watchObservedRunningTime="2026-09-05 06:42:04.188114473 +0000 UTC m=+990.161869148"
Sep 05 06:42:04.190595 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:04.190575    2567 scope.go:117] "RemoveContainer" containerID="6cd647619cc0d81000ceda6a1ab11b157ecff10a834351d4d4929117ca43f93d"
Sep 05 06:42:04.190926 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:42:04.190905    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cd647619cc0d81000ceda6a1ab11b157ecff10a834351d4d4929117ca43f93d\": container with ID starting with 6cd647619cc0d81000ceda6a1ab11b157ecff10a834351d4d4929117ca43f93d not found: ID does not exist" containerID="6cd647619cc0d81000ceda6a1ab11b157ecff10a834351d4d4929117ca43f93d"
Sep 05 06:42:04.190971 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:04.190937    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cd647619cc0d81000ceda6a1ab11b157ecff10a834351d4d4929117ca43f93d"} err="failed to get container status \"6cd647619cc0d81000ceda6a1ab11b157ecff10a834351d4d4929117ca43f93d\": rpc error: code = NotFound desc = could not find container \"6cd647619cc0d81000ceda6a1ab11b157ecff10a834351d4d4929117ca43f93d\": container with ID starting with 6cd647619cc0d81000ceda6a1ab11b157ecff10a834351d4d4929117ca43f93d not found: ID does not exist"
Sep 05 06:42:04.190971 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:04.190955    2567 scope.go:117] "RemoveContainer" containerID="2bd7b9122afff638b37bd704364a35024f551943be7745a21a969caafc827976"
Sep 05 06:42:04.191329 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:42:04.191302    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bd7b9122afff638b37bd704364a35024f551943be7745a21a969caafc827976\": container with ID starting with 2bd7b9122afff638b37bd704364a35024f551943be7745a21a969caafc827976 not found: ID does not exist" containerID="2bd7b9122afff638b37bd704364a35024f551943be7745a21a969caafc827976"
Sep 05 06:42:04.191439 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:04.191337    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bd7b9122afff638b37bd704364a35024f551943be7745a21a969caafc827976"} err="failed to get container status \"2bd7b9122afff638b37bd704364a35024f551943be7745a21a969caafc827976\": rpc error: code = NotFound desc = could not find container \"2bd7b9122afff638b37bd704364a35024f551943be7745a21a969caafc827976\": container with ID starting with 2bd7b9122afff638b37bd704364a35024f551943be7745a21a969caafc827976 not found: ID does not exist"
Sep 05 06:42:04.202533 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:04.202500    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"]
Sep 05 06:42:04.206757 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:04.206728    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf"]
Sep 05 06:42:04.471900 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:04.471866    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-a092eb-68bc75587c-586bb"]
Sep 05 06:42:04.472418 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:04.472403    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eef506fe-5b3a-4ef9-9b40-62ad9082fe08" containerName="istio-proxy"
Sep 05 06:42:04.472467 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:04.472421    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="eef506fe-5b3a-4ef9-9b40-62ad9082fe08" containerName="istio-proxy"
Sep 05 06:42:04.472537 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:04.472524    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="eef506fe-5b3a-4ef9-9b40-62ad9082fe08" containerName="istio-proxy"
Sep 05 06:42:04.477382 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:04.477361    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-a092eb-68bc75587c-586bb"
Sep 05 06:42:04.480199 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:04.480173    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-a092eb\""
Sep 05 06:42:04.480320 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:04.480230    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-a092eb-dockercfg-d8rnj\""
Sep 05 06:42:04.487078 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:04.487048    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-a092eb-68bc75587c-586bb"]
Sep 05 06:42:04.588494 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:04.588456    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eef506fe-5b3a-4ef9-9b40-62ad9082fe08" path="/var/lib/kubelet/pods/eef506fe-5b3a-4ef9-9b40-62ad9082fe08/volumes"
Sep 05 06:42:04.638006 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:04.637972    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45d3849b-542b-47fb-99a9-6c70c5649419-plugins-config-volume\") pod \"payload-processing-e2e-explicit-a092eb-68bc75587c-586bb\" (UID: \"45d3849b-542b-47fb-99a9-6c70c5649419\") " pod="openshift-ingress/payload-processing-e2e-explicit-a092eb-68bc75587c-586bb"
Sep 05 06:42:04.638195 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:04.638043    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kcpz\" (UniqueName: \"kubernetes.io/projected/45d3849b-542b-47fb-99a9-6c70c5649419-kube-api-access-5kcpz\") pod \"payload-processing-e2e-explicit-a092eb-68bc75587c-586bb\" (UID: \"45d3849b-542b-47fb-99a9-6c70c5649419\") " pod="openshift-ingress/payload-processing-e2e-explicit-a092eb-68bc75587c-586bb"
Sep 05 06:42:04.738925 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:04.738834    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kcpz\" (UniqueName: \"kubernetes.io/projected/45d3849b-542b-47fb-99a9-6c70c5649419-kube-api-access-5kcpz\") pod \"payload-processing-e2e-explicit-a092eb-68bc75587c-586bb\" (UID: \"45d3849b-542b-47fb-99a9-6c70c5649419\") " pod="openshift-ingress/payload-processing-e2e-explicit-a092eb-68bc75587c-586bb"
Sep 05 06:42:04.739125 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:04.738978    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45d3849b-542b-47fb-99a9-6c70c5649419-plugins-config-volume\") pod \"payload-processing-e2e-explicit-a092eb-68bc75587c-586bb\" (UID: \"45d3849b-542b-47fb-99a9-6c70c5649419\") " pod="openshift-ingress/payload-processing-e2e-explicit-a092eb-68bc75587c-586bb"
Sep 05 06:42:04.739675 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:04.739655    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45d3849b-542b-47fb-99a9-6c70c5649419-plugins-config-volume\") pod \"payload-processing-e2e-explicit-a092eb-68bc75587c-586bb\" (UID: \"45d3849b-542b-47fb-99a9-6c70c5649419\") " pod="openshift-ingress/payload-processing-e2e-explicit-a092eb-68bc75587c-586bb"
Sep 05 06:42:04.756751 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:04.756703    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kcpz\" (UniqueName: \"kubernetes.io/projected/45d3849b-542b-47fb-99a9-6c70c5649419-kube-api-access-5kcpz\") pod \"payload-processing-e2e-explicit-a092eb-68bc75587c-586bb\" (UID: \"45d3849b-542b-47fb-99a9-6c70c5649419\") " pod="openshift-ingress/payload-processing-e2e-explicit-a092eb-68bc75587c-586bb"
Sep 05 06:42:04.788546 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:04.788517    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-a092eb-68bc75587c-586bb"
Sep 05 06:42:05.067487 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:05.067463    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-a092eb-68bc75587c-586bb"]
Sep 05 06:42:05.068996 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:42:05.068970    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45d3849b_542b_47fb_99a9_6c70c5649419.slice/crio-37f1638ed3d7a0d99d274153788b709eb43e9cbd345b035929a39a6e0c2c90eb WatchSource:0}: Error finding container 37f1638ed3d7a0d99d274153788b709eb43e9cbd345b035929a39a6e0c2c90eb: Status 404 returned error can't find the container with id 37f1638ed3d7a0d99d274153788b709eb43e9cbd345b035929a39a6e0c2c90eb
Sep 05 06:42:05.179495 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:05.179461    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-a092eb-68bc75587c-586bb" event={"ID":"45d3849b-542b-47fb-99a9-6c70c5649419","Type":"ContainerStarted","Data":"ba7e4f08f37c53c2c5753495d6883e9327b01461da638f2b79575ca40c136af3"}
Sep 05 06:42:05.179688 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:05.179518    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-a092eb-68bc75587c-586bb" event={"ID":"45d3849b-542b-47fb-99a9-6c70c5649419","Type":"ContainerStarted","Data":"37f1638ed3d7a0d99d274153788b709eb43e9cbd345b035929a39a6e0c2c90eb"}
Sep 05 06:42:05.179759 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:05.179701    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-a092eb-68bc75587c-586bb"
Sep 05 06:42:05.199360 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:05.199301    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-a092eb-68bc75587c-586bb" podStartSLOduration=1.199283165 podStartE2EDuration="1.199283165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:42:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:42:05.198184419 +0000 UTC m=+991.171939095" watchObservedRunningTime="2026-09-05 06:42:05.199283165 +0000 UTC m=+991.173037840"
Sep 05 06:42:15.182051 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:15.182001    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs"
Sep 05 06:42:16.188244 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:16.188196    2567 patch_prober.go:28] interesting pod/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 05 06:42:16.188647 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:16.188292    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4" podUID="c4be56ba-c269-408c-9aef-a9c9ee9b5566" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 05 06:42:16.193592 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:16.193556    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-a092eb-68bc75587c-586bb"
Sep 05 06:42:18.257595 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:18.257541    2567 generic.go:356] "Generic (PLEG): container finished" podID="c4be56ba-c269-408c-9aef-a9c9ee9b5566" containerID="2fe81ddbec3b26a8e7ed4887269b6791e5d4cd44bdf1a4fa0cb0cc936cd0eee4" exitCode=0
Sep 05 06:42:18.258345 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:18.257617    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4" event={"ID":"c4be56ba-c269-408c-9aef-a9c9ee9b5566","Type":"ContainerDied","Data":"2fe81ddbec3b26a8e7ed4887269b6791e5d4cd44bdf1a4fa0cb0cc936cd0eee4"}
Sep 05 06:42:18.258345 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:18.258320    2567 scope.go:117] "RemoveContainer" containerID="2fe81ddbec3b26a8e7ed4887269b6791e5d4cd44bdf1a4fa0cb0cc936cd0eee4"
Sep 05 06:42:18.259504 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:18.259472    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:42:18.259592 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:18.259545    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:42:18.259632 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:18.259594    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:42:18.544990 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:18.544886    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb"]
Sep 05 06:42:19.265235 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:19.265191    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4" event={"ID":"c4be56ba-c269-408c-9aef-a9c9ee9b5566","Type":"ContainerStarted","Data":"8b2c06cf78a4818e842d8fba65d199c40351a552221540954548652d8609d769"}
Sep 05 06:42:20.153809 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:20.153743    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:42:20.154204 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:20.154180    2567 patch_prober.go:28] interesting pod/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 05 06:42:20.154324 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:20.154254    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4" podUID="c4be56ba-c269-408c-9aef-a9c9ee9b5566" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 05 06:42:21.153429 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:21.153392    2567 patch_prober.go:28] interesting pod/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 05 06:42:21.153884 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:21.153451    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4" podUID="c4be56ba-c269-408c-9aef-a9c9ee9b5566" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 05 06:42:22.153633 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:22.153597    2567 patch_prober.go:28] interesting pod/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 05 06:42:22.154187 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:22.153670    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4" podUID="c4be56ba-c269-408c-9aef-a9c9ee9b5566" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 05 06:42:23.153651 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:23.153607    2567 patch_prober.go:28] interesting pod/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 05 06:42:23.154142 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:23.153698    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4" podUID="c4be56ba-c269-408c-9aef-a9c9ee9b5566" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 05 06:42:24.154130 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:24.154078    2567 patch_prober.go:28] interesting pod/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 05 06:42:24.154566 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:24.154154    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4" podUID="c4be56ba-c269-408c-9aef-a9c9ee9b5566" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 05 06:42:25.154106 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:25.154064    2567 patch_prober.go:28] interesting pod/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 05 06:42:25.154299 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:25.154135    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4" podUID="c4be56ba-c269-408c-9aef-a9c9ee9b5566" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 05 06:42:26.168056 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:26.167996    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:42:26.168560 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:26.168510    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:42:26.169671 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:26.169645    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:42:26.470651 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:26.470599    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46fa710a-4scq5"]
Sep 05 06:42:26.471116 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:26.471094    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eef506fe-5b3a-4ef9-9b40-62ad9082fe08" containerName="istio-proxy"
Sep 05 06:42:26.471116 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:26.471113    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="eef506fe-5b3a-4ef9-9b40-62ad9082fe08" containerName="istio-proxy"
Sep 05 06:42:26.471367 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:26.471172    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="eef506fe-5b3a-4ef9-9b40-62ad9082fe08" containerName="istio-proxy"
Sep 05 06:42:26.474327 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:26.474297    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46fa710a-4scq5"
Sep 05 06:42:26.477002 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:26.476977    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 05 06:42:26.477176 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:26.477067    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tlgjj\""
Sep 05 06:42:26.482268 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:26.482239    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46fa710a-4scq5"]
Sep 05 06:42:26.567980 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:26.567933    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/de4c7e26-1243-4858-b27f-6f382f7272a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-46fa710a-4scq5\" (UID: \"de4c7e26-1243-4858-b27f-6f382f7272a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46fa710a-4scq5"
Sep 05 06:42:26.669710 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:26.669651    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/de4c7e26-1243-4858-b27f-6f382f7272a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-46fa710a-4scq5\" (UID: \"de4c7e26-1243-4858-b27f-6f382f7272a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46fa710a-4scq5"
Sep 05 06:42:26.670441 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:26.670417    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/de4c7e26-1243-4858-b27f-6f382f7272a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-46fa710a-4scq5\" (UID: \"de4c7e26-1243-4858-b27f-6f382f7272a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46fa710a-4scq5"
Sep 05 06:42:26.786854 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:26.786741    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46fa710a-4scq5"
Sep 05 06:42:27.093951 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:27.093915    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46fa710a-4scq5"]
Sep 05 06:42:27.096655 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:42:27.096622    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde4c7e26_1243_4858_b27f_6f382f7272a4.slice/crio-efab77f98edf898353aab0de231cad5c3e10b568fa4481fd9cd35e32ba9bb620 WatchSource:0}: Error finding container efab77f98edf898353aab0de231cad5c3e10b568fa4481fd9cd35e32ba9bb620: Status 404 returned error can't find the container with id efab77f98edf898353aab0de231cad5c3e10b568fa4481fd9cd35e32ba9bb620
Sep 05 06:42:27.309411 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:27.309368    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46fa710a-4scq5" event={"ID":"de4c7e26-1243-4858-b27f-6f382f7272a4","Type":"ContainerStarted","Data":"efab77f98edf898353aab0de231cad5c3e10b568fa4481fd9cd35e32ba9bb620"}
Sep 05 06:42:28.316610 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:28.316577    2567 generic.go:356] "Generic (PLEG): container finished" podID="de4c7e26-1243-4858-b27f-6f382f7272a4" containerID="12f67850e73e9669af7972274eaca709980a0244c6c7ba598abf134748862ec3" exitCode=0
Sep 05 06:42:28.317052 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:28.316669    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46fa710a-4scq5" event={"ID":"de4c7e26-1243-4858-b27f-6f382f7272a4","Type":"ContainerDied","Data":"12f67850e73e9669af7972274eaca709980a0244c6c7ba598abf134748862ec3"}
Sep 05 06:42:29.481507 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:29.481476    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46fa710a-4scq5"
Sep 05 06:42:29.602052 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:29.601916    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/de4c7e26-1243-4858-b27f-6f382f7272a4-maas-api-service-ca\") pod \"de4c7e26-1243-4858-b27f-6f382f7272a4\" (UID: \"de4c7e26-1243-4858-b27f-6f382f7272a4\") "
Sep 05 06:42:29.602322 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:29.602299    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de4c7e26-1243-4858-b27f-6f382f7272a4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "de4c7e26-1243-4858-b27f-6f382f7272a4" (UID: "de4c7e26-1243-4858-b27f-6f382f7272a4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:42:29.703386 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:29.703342    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/de4c7e26-1243-4858-b27f-6f382f7272a4-maas-api-service-ca\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:42:29.955169 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:29.955136    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf"]
Sep 05 06:42:29.955542 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:29.955530    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de4c7e26-1243-4858-b27f-6f382f7272a4" containerName="revoke-keys"
Sep 05 06:42:29.955594 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:29.955544    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="de4c7e26-1243-4858-b27f-6f382f7272a4" containerName="revoke-keys"
Sep 05 06:42:29.955632 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:29.955605    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="de4c7e26-1243-4858-b27f-6f382f7272a4" containerName="revoke-keys"
Sep 05 06:42:29.958407 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:29.958386    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf"
Sep 05 06:42:29.961456 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:29.961428    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-5d5f17\"/\"kube-root-ca.crt\""
Sep 05 06:42:29.961613 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:29.961439    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-5d5f17\"/\"openshift-service-ca.crt\""
Sep 05 06:42:29.962665 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:29.962649    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-5d5f17\"/\"default-dockercfg-9x8fw\""
Sep 05 06:42:29.962731 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:29.962660    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-5d5f17\"/\"test-model-5d5f17-kserve-self-signed-certs\""
Sep 05 06:42:29.970133 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:29.970102    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf"]
Sep 05 06:42:30.106958 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:30.106909    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq8s9\" (UniqueName: \"kubernetes.io/projected/3a8841c6-ed23-4ff9-993b-0c378ccaaf0f-kube-api-access-hq8s9\") pod \"test-model-5d5f17-kserve-6bf7ffcf97-vbpsf\" (UID: \"3a8841c6-ed23-4ff9-993b-0c378ccaaf0f\") " pod="ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf"
Sep 05 06:42:30.107198 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:30.107020    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a8841c6-ed23-4ff9-993b-0c378ccaaf0f-tls-certs\") pod \"test-model-5d5f17-kserve-6bf7ffcf97-vbpsf\" (UID: \"3a8841c6-ed23-4ff9-993b-0c378ccaaf0f\") " pod="ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf"
Sep 05 06:42:30.107198 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:30.107087    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a8841c6-ed23-4ff9-993b-0c378ccaaf0f-home\") pod \"test-model-5d5f17-kserve-6bf7ffcf97-vbpsf\" (UID: \"3a8841c6-ed23-4ff9-993b-0c378ccaaf0f\") " pod="ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf"
Sep 05 06:42:30.107198 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:30.107127    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a8841c6-ed23-4ff9-993b-0c378ccaaf0f-dshm\") pod \"test-model-5d5f17-kserve-6bf7ffcf97-vbpsf\" (UID: \"3a8841c6-ed23-4ff9-993b-0c378ccaaf0f\") " pod="ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf"
Sep 05 06:42:30.107198 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:30.107154    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a8841c6-ed23-4ff9-993b-0c378ccaaf0f-model-cache\") pod \"test-model-5d5f17-kserve-6bf7ffcf97-vbpsf\" (UID: \"3a8841c6-ed23-4ff9-993b-0c378ccaaf0f\") " pod="ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf"
Sep 05 06:42:30.107364 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:30.107216    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a8841c6-ed23-4ff9-993b-0c378ccaaf0f-tmp-dir\") pod \"test-model-5d5f17-kserve-6bf7ffcf97-vbpsf\" (UID: \"3a8841c6-ed23-4ff9-993b-0c378ccaaf0f\") " pod="ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf"
Sep 05 06:42:30.208140 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:30.207990    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a8841c6-ed23-4ff9-993b-0c378ccaaf0f-dshm\") pod \"test-model-5d5f17-kserve-6bf7ffcf97-vbpsf\" (UID: \"3a8841c6-ed23-4ff9-993b-0c378ccaaf0f\") " pod="ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf"
Sep 05 06:42:30.208140 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:30.208086    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a8841c6-ed23-4ff9-993b-0c378ccaaf0f-model-cache\") pod \"test-model-5d5f17-kserve-6bf7ffcf97-vbpsf\" (UID: \"3a8841c6-ed23-4ff9-993b-0c378ccaaf0f\") " pod="ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf"
Sep 05 06:42:30.208434 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:30.208144    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a8841c6-ed23-4ff9-993b-0c378ccaaf0f-tmp-dir\") pod \"test-model-5d5f17-kserve-6bf7ffcf97-vbpsf\" (UID: \"3a8841c6-ed23-4ff9-993b-0c378ccaaf0f\") " pod="ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf"
Sep 05 06:42:30.208434 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:30.208298    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq8s9\" (UniqueName: \"kubernetes.io/projected/3a8841c6-ed23-4ff9-993b-0c378ccaaf0f-kube-api-access-hq8s9\") pod \"test-model-5d5f17-kserve-6bf7ffcf97-vbpsf\" (UID: \"3a8841c6-ed23-4ff9-993b-0c378ccaaf0f\") " pod="ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf"
Sep 05 06:42:30.208434 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:30.208385    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a8841c6-ed23-4ff9-993b-0c378ccaaf0f-tls-certs\") pod \"test-model-5d5f17-kserve-6bf7ffcf97-vbpsf\" (UID: \"3a8841c6-ed23-4ff9-993b-0c378ccaaf0f\") " pod="ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf"
Sep 05 06:42:30.208434 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:30.208425    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a8841c6-ed23-4ff9-993b-0c378ccaaf0f-home\") pod \"test-model-5d5f17-kserve-6bf7ffcf97-vbpsf\" (UID: \"3a8841c6-ed23-4ff9-993b-0c378ccaaf0f\") " pod="ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf"
Sep 05 06:42:30.208644 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:30.208510    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a8841c6-ed23-4ff9-993b-0c378ccaaf0f-tmp-dir\") pod \"test-model-5d5f17-kserve-6bf7ffcf97-vbpsf\" (UID: \"3a8841c6-ed23-4ff9-993b-0c378ccaaf0f\") " pod="ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf"
Sep 05 06:42:30.208644 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:30.208559    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a8841c6-ed23-4ff9-993b-0c378ccaaf0f-model-cache\") pod \"test-model-5d5f17-kserve-6bf7ffcf97-vbpsf\" (UID: \"3a8841c6-ed23-4ff9-993b-0c378ccaaf0f\") " pod="ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf"
Sep 05 06:42:30.208771 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:30.208753    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a8841c6-ed23-4ff9-993b-0c378ccaaf0f-home\") pod \"test-model-5d5f17-kserve-6bf7ffcf97-vbpsf\" (UID: \"3a8841c6-ed23-4ff9-993b-0c378ccaaf0f\") " pod="ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf"
Sep 05 06:42:30.210683 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:30.210662    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a8841c6-ed23-4ff9-993b-0c378ccaaf0f-dshm\") pod \"test-model-5d5f17-kserve-6bf7ffcf97-vbpsf\" (UID: \"3a8841c6-ed23-4ff9-993b-0c378ccaaf0f\") " pod="ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf"
Sep 05 06:42:30.210967 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:30.210951    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a8841c6-ed23-4ff9-993b-0c378ccaaf0f-tls-certs\") pod \"test-model-5d5f17-kserve-6bf7ffcf97-vbpsf\" (UID: \"3a8841c6-ed23-4ff9-993b-0c378ccaaf0f\") " pod="ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf"
Sep 05 06:42:30.220524 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:30.220488    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq8s9\" (UniqueName: \"kubernetes.io/projected/3a8841c6-ed23-4ff9-993b-0c378ccaaf0f-kube-api-access-hq8s9\") pod \"test-model-5d5f17-kserve-6bf7ffcf97-vbpsf\" (UID: \"3a8841c6-ed23-4ff9-993b-0c378ccaaf0f\") " pod="ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf"
Sep 05 06:42:30.269549 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:30.269501    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf"
Sep 05 06:42:30.332200 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:30.331964    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46fa710a-4scq5" event={"ID":"de4c7e26-1243-4858-b27f-6f382f7272a4","Type":"ContainerDied","Data":"efab77f98edf898353aab0de231cad5c3e10b568fa4481fd9cd35e32ba9bb620"}
Sep 05 06:42:30.332200 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:30.332052    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46fa710a-4scq5"
Sep 05 06:42:30.332200 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:30.332102    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="efab77f98edf898353aab0de231cad5c3e10b568fa4481fd9cd35e32ba9bb620"
Sep 05 06:42:30.545726 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:30.545698    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf"]
Sep 05 06:42:30.547277 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:42:30.547247    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a8841c6_ed23_4ff9_993b_0c378ccaaf0f.slice/crio-3458d58835f3439fcbd97fcfbaf58d4dc9bf287df59ebb8d61fe2837887b7aa4 WatchSource:0}: Error finding container 3458d58835f3439fcbd97fcfbaf58d4dc9bf287df59ebb8d61fe2837887b7aa4: Status 404 returned error can't find the container with id 3458d58835f3439fcbd97fcfbaf58d4dc9bf287df59ebb8d61fe2837887b7aa4
Sep 05 06:42:31.339380 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:31.339341    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf" event={"ID":"3a8841c6-ed23-4ff9-993b-0c378ccaaf0f","Type":"ContainerStarted","Data":"6e824a425889c5e1d89955e21b5b16cdf8a0fa1ac0ef727e554127d6183638fe"}
Sep 05 06:42:31.339580 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:31.339389    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf" event={"ID":"3a8841c6-ed23-4ff9-993b-0c378ccaaf0f","Type":"ContainerStarted","Data":"3458d58835f3439fcbd97fcfbaf58d4dc9bf287df59ebb8d61fe2837887b7aa4"}
Sep 05 06:42:31.360402 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:31.360349    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf" podStartSLOduration=2.360329529 podStartE2EDuration="2.360329529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:42:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:42:31.358820438 +0000 UTC m=+1017.332575114" watchObservedRunningTime="2026-09-05 06:42:31.360329529 +0000 UTC m=+1017.334084203"
Sep 05 06:42:32.779923 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:32.779713    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs"]
Sep 05 06:42:32.780463 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:32.779983    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs" podUID="d90696f1-ab91-4bbf-a229-8bd89d67b68b" containerName="payload-pre-processing" containerID="cri-o://578792c4c94a8725a73e19a2d47d584eed743d1185d4826b92b691a7ce042539" gracePeriod=30
Sep 05 06:42:33.001196 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:32.999431    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46fa710a-4scq5"]
Sep 05 06:42:33.003758 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:33.003469    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46fa710a-4scq5"]
Sep 05 06:42:33.083436 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:33.083406    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs"
Sep 05 06:42:33.144128 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:33.144088    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cl6xs\" (UniqueName: \"kubernetes.io/projected/d90696f1-ab91-4bbf-a229-8bd89d67b68b-kube-api-access-cl6xs\") pod \"d90696f1-ab91-4bbf-a229-8bd89d67b68b\" (UID: \"d90696f1-ab91-4bbf-a229-8bd89d67b68b\") "
Sep 05 06:42:33.144366 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:33.144193    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d90696f1-ab91-4bbf-a229-8bd89d67b68b-plugins-config-volume\") pod \"d90696f1-ab91-4bbf-a229-8bd89d67b68b\" (UID: \"d90696f1-ab91-4bbf-a229-8bd89d67b68b\") "
Sep 05 06:42:33.144733 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:33.144702    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d90696f1-ab91-4bbf-a229-8bd89d67b68b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d90696f1-ab91-4bbf-a229-8bd89d67b68b" (UID: "d90696f1-ab91-4bbf-a229-8bd89d67b68b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:42:33.145259 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:33.145207    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d90696f1-ab91-4bbf-a229-8bd89d67b68b-plugins-config-volume\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:42:33.146931 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:33.146898    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d90696f1-ab91-4bbf-a229-8bd89d67b68b-kube-api-access-cl6xs" (OuterVolumeSpecName: "kube-api-access-cl6xs") pod "d90696f1-ab91-4bbf-a229-8bd89d67b68b" (UID: "d90696f1-ab91-4bbf-a229-8bd89d67b68b"). InnerVolumeSpecName "kube-api-access-cl6xs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:42:33.246634 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:33.246590    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cl6xs\" (UniqueName: \"kubernetes.io/projected/d90696f1-ab91-4bbf-a229-8bd89d67b68b-kube-api-access-cl6xs\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:42:33.353119 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:33.352998    2567 generic.go:356] "Generic (PLEG): container finished" podID="d90696f1-ab91-4bbf-a229-8bd89d67b68b" containerID="578792c4c94a8725a73e19a2d47d584eed743d1185d4826b92b691a7ce042539" exitCode=0
Sep 05 06:42:33.353119 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:33.353069    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs" event={"ID":"d90696f1-ab91-4bbf-a229-8bd89d67b68b","Type":"ContainerDied","Data":"578792c4c94a8725a73e19a2d47d584eed743d1185d4826b92b691a7ce042539"}
Sep 05 06:42:33.353119 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:33.353121    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs" event={"ID":"d90696f1-ab91-4bbf-a229-8bd89d67b68b","Type":"ContainerDied","Data":"9e888dfc8b255098f16a6ef1d4a1017de0ee2ccc0639eec0f77899e33c20836a"}
Sep 05 06:42:33.353355 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:33.353144    2567 scope.go:117] "RemoveContainer" containerID="578792c4c94a8725a73e19a2d47d584eed743d1185d4826b92b691a7ce042539"
Sep 05 06:42:33.353355 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:33.353079    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs"
Sep 05 06:42:33.363597 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:33.363574    2567 scope.go:117] "RemoveContainer" containerID="578792c4c94a8725a73e19a2d47d584eed743d1185d4826b92b691a7ce042539"
Sep 05 06:42:33.364081 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:42:33.364057    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"578792c4c94a8725a73e19a2d47d584eed743d1185d4826b92b691a7ce042539\": container with ID starting with 578792c4c94a8725a73e19a2d47d584eed743d1185d4826b92b691a7ce042539 not found: ID does not exist" containerID="578792c4c94a8725a73e19a2d47d584eed743d1185d4826b92b691a7ce042539"
Sep 05 06:42:33.364168 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:33.364092    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"578792c4c94a8725a73e19a2d47d584eed743d1185d4826b92b691a7ce042539"} err="failed to get container status \"578792c4c94a8725a73e19a2d47d584eed743d1185d4826b92b691a7ce042539\": rpc error: code = NotFound desc = could not find container \"578792c4c94a8725a73e19a2d47d584eed743d1185d4826b92b691a7ce042539\": container with ID starting with 578792c4c94a8725a73e19a2d47d584eed743d1185d4826b92b691a7ce042539 not found: ID does not exist"
Sep 05 06:42:33.379368 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:33.379328    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs"]
Sep 05 06:42:33.383745 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:33.383713    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs"]
Sep 05 06:42:33.569104 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:33.569058    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb" podUID="d0b339a0-cbc3-4c0a-834d-b3a385d7b1db" containerName="main" containerID="cri-o://9e19493ebe126ea04ad70d9c3fb88a4aee952c89b51580fcfe7c8d0c69b46faf" gracePeriod=45
Sep 05 06:42:33.840279 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:33.840242    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb"
Sep 05 06:42:33.952857 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:33.952815    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0b339a0-cbc3-4c0a-834d-b3a385d7b1db-tls-certs\") pod \"d0b339a0-cbc3-4c0a-834d-b3a385d7b1db\" (UID: \"d0b339a0-cbc3-4c0a-834d-b3a385d7b1db\") "
Sep 05 06:42:33.953041 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:33.952867    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2nt4\" (UniqueName: \"kubernetes.io/projected/d0b339a0-cbc3-4c0a-834d-b3a385d7b1db-kube-api-access-k2nt4\") pod \"d0b339a0-cbc3-4c0a-834d-b3a385d7b1db\" (UID: \"d0b339a0-cbc3-4c0a-834d-b3a385d7b1db\") "
Sep 05 06:42:33.953041 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:33.952918    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0b339a0-cbc3-4c0a-834d-b3a385d7b1db-home\") pod \"d0b339a0-cbc3-4c0a-834d-b3a385d7b1db\" (UID: \"d0b339a0-cbc3-4c0a-834d-b3a385d7b1db\") "
Sep 05 06:42:33.953041 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:33.952956    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0b339a0-cbc3-4c0a-834d-b3a385d7b1db-tmp-dir\") pod \"d0b339a0-cbc3-4c0a-834d-b3a385d7b1db\" (UID: \"d0b339a0-cbc3-4c0a-834d-b3a385d7b1db\") "
Sep 05 06:42:33.953182 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:33.953088    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0b339a0-cbc3-4c0a-834d-b3a385d7b1db-model-cache\") pod \"d0b339a0-cbc3-4c0a-834d-b3a385d7b1db\" (UID: \"d0b339a0-cbc3-4c0a-834d-b3a385d7b1db\") "
Sep 05 06:42:33.953182 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:33.953134    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0b339a0-cbc3-4c0a-834d-b3a385d7b1db-dshm\") pod \"d0b339a0-cbc3-4c0a-834d-b3a385d7b1db\" (UID: \"d0b339a0-cbc3-4c0a-834d-b3a385d7b1db\") "
Sep 05 06:42:33.953744 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:33.953422    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0b339a0-cbc3-4c0a-834d-b3a385d7b1db-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d0b339a0-cbc3-4c0a-834d-b3a385d7b1db" (UID: "d0b339a0-cbc3-4c0a-834d-b3a385d7b1db"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:42:33.953744 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:33.953478    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0b339a0-cbc3-4c0a-834d-b3a385d7b1db-model-cache" (OuterVolumeSpecName: "model-cache") pod "d0b339a0-cbc3-4c0a-834d-b3a385d7b1db" (UID: "d0b339a0-cbc3-4c0a-834d-b3a385d7b1db"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:42:33.953744 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:33.953600    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0b339a0-cbc3-4c0a-834d-b3a385d7b1db-tmp-dir\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:42:33.953744 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:33.953621    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0b339a0-cbc3-4c0a-834d-b3a385d7b1db-model-cache\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:42:33.953744 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:33.953700    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0b339a0-cbc3-4c0a-834d-b3a385d7b1db-home" (OuterVolumeSpecName: "home") pod "d0b339a0-cbc3-4c0a-834d-b3a385d7b1db" (UID: "d0b339a0-cbc3-4c0a-834d-b3a385d7b1db"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:42:33.955213 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:33.955184    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0b339a0-cbc3-4c0a-834d-b3a385d7b1db-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d0b339a0-cbc3-4c0a-834d-b3a385d7b1db" (UID: "d0b339a0-cbc3-4c0a-834d-b3a385d7b1db"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 05 06:42:33.955675 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:33.955649    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0b339a0-cbc3-4c0a-834d-b3a385d7b1db-kube-api-access-k2nt4" (OuterVolumeSpecName: "kube-api-access-k2nt4") pod "d0b339a0-cbc3-4c0a-834d-b3a385d7b1db" (UID: "d0b339a0-cbc3-4c0a-834d-b3a385d7b1db"). InnerVolumeSpecName "kube-api-access-k2nt4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:42:33.955839 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:33.955822    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0b339a0-cbc3-4c0a-834d-b3a385d7b1db-dshm" (OuterVolumeSpecName: "dshm") pod "d0b339a0-cbc3-4c0a-834d-b3a385d7b1db" (UID: "d0b339a0-cbc3-4c0a-834d-b3a385d7b1db"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:42:34.054467 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:34.054421    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0b339a0-cbc3-4c0a-834d-b3a385d7b1db-tls-certs\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:42:34.054467 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:34.054466    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2nt4\" (UniqueName: \"kubernetes.io/projected/d0b339a0-cbc3-4c0a-834d-b3a385d7b1db-kube-api-access-k2nt4\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:42:34.054467 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:34.054475    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0b339a0-cbc3-4c0a-834d-b3a385d7b1db-home\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:42:34.054722 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:34.054485    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0b339a0-cbc3-4c0a-834d-b3a385d7b1db-dshm\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:42:34.169401 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:34.160234    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"]
Sep 05 06:42:34.169401 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:34.160581    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4" podUID="c4be56ba-c269-408c-9aef-a9c9ee9b5566" containerName="istio-proxy" containerID="cri-o://8b2c06cf78a4818e842d8fba65d199c40351a552221540954548652d8609d769" gracePeriod=30
Sep 05 06:42:34.361767 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:34.361663    2567 generic.go:356] "Generic (PLEG): container finished" podID="d0b339a0-cbc3-4c0a-834d-b3a385d7b1db" containerID="9e19493ebe126ea04ad70d9c3fb88a4aee952c89b51580fcfe7c8d0c69b46faf" exitCode=0
Sep 05 06:42:34.361767 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:34.361710    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb"
Sep 05 06:42:34.361767 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:34.361746    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb" event={"ID":"d0b339a0-cbc3-4c0a-834d-b3a385d7b1db","Type":"ContainerDied","Data":"9e19493ebe126ea04ad70d9c3fb88a4aee952c89b51580fcfe7c8d0c69b46faf"}
Sep 05 06:42:34.362084 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:34.361814    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb" event={"ID":"d0b339a0-cbc3-4c0a-834d-b3a385d7b1db","Type":"ContainerDied","Data":"47ea1dd2bfb11fe7944309420efc27761f9cc361ee2e17d8f4c2c5c832581805"}
Sep 05 06:42:34.362084 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:34.361838    2567 scope.go:117] "RemoveContainer" containerID="9e19493ebe126ea04ad70d9c3fb88a4aee952c89b51580fcfe7c8d0c69b46faf"
Sep 05 06:42:34.371848 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:34.371823    2567 scope.go:117] "RemoveContainer" containerID="9e19493ebe126ea04ad70d9c3fb88a4aee952c89b51580fcfe7c8d0c69b46faf"
Sep 05 06:42:34.372508 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:42:34.372485    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e19493ebe126ea04ad70d9c3fb88a4aee952c89b51580fcfe7c8d0c69b46faf\": container with ID starting with 9e19493ebe126ea04ad70d9c3fb88a4aee952c89b51580fcfe7c8d0c69b46faf not found: ID does not exist" containerID="9e19493ebe126ea04ad70d9c3fb88a4aee952c89b51580fcfe7c8d0c69b46faf"
Sep 05 06:42:34.372611 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:34.372514    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e19493ebe126ea04ad70d9c3fb88a4aee952c89b51580fcfe7c8d0c69b46faf"} err="failed to get container status \"9e19493ebe126ea04ad70d9c3fb88a4aee952c89b51580fcfe7c8d0c69b46faf\": rpc error: code = NotFound desc = could not find container \"9e19493ebe126ea04ad70d9c3fb88a4aee952c89b51580fcfe7c8d0c69b46faf\": container with ID starting with 9e19493ebe126ea04ad70d9c3fb88a4aee952c89b51580fcfe7c8d0c69b46faf not found: ID does not exist"
Sep 05 06:42:34.388394 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:34.388357    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb"]
Sep 05 06:42:34.393326 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:34.393291    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-a-5cc5e81b-kserve-64866f44bc-9qkpb"]
Sep 05 06:42:34.610845 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:34.610437    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0b339a0-cbc3-4c0a-834d-b3a385d7b1db" path="/var/lib/kubelet/pods/d0b339a0-cbc3-4c0a-834d-b3a385d7b1db/volumes"
Sep 05 06:42:34.611082 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:34.611046    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d90696f1-ab91-4bbf-a229-8bd89d67b68b" path="/var/lib/kubelet/pods/d90696f1-ab91-4bbf-a229-8bd89d67b68b/volumes"
Sep 05 06:42:34.611436 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:34.611419    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de4c7e26-1243-4858-b27f-6f382f7272a4" path="/var/lib/kubelet/pods/de4c7e26-1243-4858-b27f-6f382f7272a4/volumes"
Sep 05 06:42:34.921501 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:34.921410    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"]
Sep 05 06:42:34.921893 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:34.921840    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0b339a0-cbc3-4c0a-834d-b3a385d7b1db" containerName="main"
Sep 05 06:42:34.921893 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:34.921855    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0b339a0-cbc3-4c0a-834d-b3a385d7b1db" containerName="main"
Sep 05 06:42:34.921893 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:34.921865    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d90696f1-ab91-4bbf-a229-8bd89d67b68b" containerName="payload-pre-processing"
Sep 05 06:42:34.921893 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:34.921871    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d90696f1-ab91-4bbf-a229-8bd89d67b68b" containerName="payload-pre-processing"
Sep 05 06:42:34.922048 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:34.921954    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0b339a0-cbc3-4c0a-834d-b3a385d7b1db" containerName="main"
Sep 05 06:42:34.922048 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:34.921965    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d90696f1-ab91-4bbf-a229-8bd89d67b68b" containerName="payload-pre-processing"
Sep 05 06:42:34.926606 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:34.926582    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:42:34.929976 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:34.929951    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-a40054de-openshift-default-dockercfg-bn4fg\""
Sep 05 06:42:34.938334 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:34.938301    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"]
Sep 05 06:42:35.067611 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:35.067567    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61b1640f-f0b3-408b-b4f6-9399057ba641-istio-data\") pod \"e2e-derive-a40054de-openshift-default-5749884b64-pmt9k\" (UID: \"61b1640f-f0b3-408b-b4f6-9399057ba641\") " pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:42:35.067849 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:35.067657    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61b1640f-f0b3-408b-b4f6-9399057ba641-istio-podinfo\") pod \"e2e-derive-a40054de-openshift-default-5749884b64-pmt9k\" (UID: \"61b1640f-f0b3-408b-b4f6-9399057ba641\") " pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:42:35.067849 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:35.067713    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61b1640f-f0b3-408b-b4f6-9399057ba641-workload-socket\") pod \"e2e-derive-a40054de-openshift-default-5749884b64-pmt9k\" (UID: \"61b1640f-f0b3-408b-b4f6-9399057ba641\") " pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:42:35.067849 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:35.067733    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61b1640f-f0b3-408b-b4f6-9399057ba641-istio-token\") pod \"e2e-derive-a40054de-openshift-default-5749884b64-pmt9k\" (UID: \"61b1640f-f0b3-408b-b4f6-9399057ba641\") " pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:42:35.067849 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:35.067807    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61b1640f-f0b3-408b-b4f6-9399057ba641-credential-socket\") pod \"e2e-derive-a40054de-openshift-default-5749884b64-pmt9k\" (UID: \"61b1640f-f0b3-408b-b4f6-9399057ba641\") " pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:42:35.067849 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:35.067843    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61b1640f-f0b3-408b-b4f6-9399057ba641-workload-certs\") pod \"e2e-derive-a40054de-openshift-default-5749884b64-pmt9k\" (UID: \"61b1640f-f0b3-408b-b4f6-9399057ba641\") " pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:42:35.068072 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:35.067891    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtrfc\" (UniqueName: \"kubernetes.io/projected/61b1640f-f0b3-408b-b4f6-9399057ba641-kube-api-access-mtrfc\") pod \"e2e-derive-a40054de-openshift-default-5749884b64-pmt9k\" (UID: \"61b1640f-f0b3-408b-b4f6-9399057ba641\") " pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:42:35.068072 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:35.067911    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61b1640f-f0b3-408b-b4f6-9399057ba641-istio-envoy\") pod \"e2e-derive-a40054de-openshift-default-5749884b64-pmt9k\" (UID: \"61b1640f-f0b3-408b-b4f6-9399057ba641\") " pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:42:35.068072 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:35.067930    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61b1640f-f0b3-408b-b4f6-9399057ba641-istiod-ca-cert\") pod \"e2e-derive-a40054de-openshift-default-5749884b64-pmt9k\" (UID: \"61b1640f-f0b3-408b-b4f6-9399057ba641\") " pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:42:35.168936 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:35.168895    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61b1640f-f0b3-408b-b4f6-9399057ba641-istio-podinfo\") pod \"e2e-derive-a40054de-openshift-default-5749884b64-pmt9k\" (UID: \"61b1640f-f0b3-408b-b4f6-9399057ba641\") " pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:42:35.169187 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:35.168984    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61b1640f-f0b3-408b-b4f6-9399057ba641-workload-socket\") pod \"e2e-derive-a40054de-openshift-default-5749884b64-pmt9k\" (UID: \"61b1640f-f0b3-408b-b4f6-9399057ba641\") " pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:42:35.169187 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:35.169012    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61b1640f-f0b3-408b-b4f6-9399057ba641-istio-token\") pod \"e2e-derive-a40054de-openshift-default-5749884b64-pmt9k\" (UID: \"61b1640f-f0b3-408b-b4f6-9399057ba641\") " pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:42:35.169187 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:35.169084    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61b1640f-f0b3-408b-b4f6-9399057ba641-credential-socket\") pod \"e2e-derive-a40054de-openshift-default-5749884b64-pmt9k\" (UID: \"61b1640f-f0b3-408b-b4f6-9399057ba641\") " pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:42:35.169187 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:35.169112    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61b1640f-f0b3-408b-b4f6-9399057ba641-workload-certs\") pod \"e2e-derive-a40054de-openshift-default-5749884b64-pmt9k\" (UID: \"61b1640f-f0b3-408b-b4f6-9399057ba641\") " pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:42:35.169187 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:35.169149    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtrfc\" (UniqueName: \"kubernetes.io/projected/61b1640f-f0b3-408b-b4f6-9399057ba641-kube-api-access-mtrfc\") pod \"e2e-derive-a40054de-openshift-default-5749884b64-pmt9k\" (UID: \"61b1640f-f0b3-408b-b4f6-9399057ba641\") " pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:42:35.169444 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:35.169248    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61b1640f-f0b3-408b-b4f6-9399057ba641-istio-envoy\") pod \"e2e-derive-a40054de-openshift-default-5749884b64-pmt9k\" (UID: \"61b1640f-f0b3-408b-b4f6-9399057ba641\") " pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:42:35.169444 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:35.169294    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61b1640f-f0b3-408b-b4f6-9399057ba641-istiod-ca-cert\") pod \"e2e-derive-a40054de-openshift-default-5749884b64-pmt9k\" (UID: \"61b1640f-f0b3-408b-b4f6-9399057ba641\") " pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:42:35.169444 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:35.169357    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61b1640f-f0b3-408b-b4f6-9399057ba641-istio-data\") pod \"e2e-derive-a40054de-openshift-default-5749884b64-pmt9k\" (UID: \"61b1640f-f0b3-408b-b4f6-9399057ba641\") " pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:42:35.169595 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:35.169452    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61b1640f-f0b3-408b-b4f6-9399057ba641-workload-socket\") pod \"e2e-derive-a40054de-openshift-default-5749884b64-pmt9k\" (UID: \"61b1640f-f0b3-408b-b4f6-9399057ba641\") " pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:42:35.169595 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:35.169490    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61b1640f-f0b3-408b-b4f6-9399057ba641-credential-socket\") pod \"e2e-derive-a40054de-openshift-default-5749884b64-pmt9k\" (UID: \"61b1640f-f0b3-408b-b4f6-9399057ba641\") " pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:42:35.169692 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:35.169681    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61b1640f-f0b3-408b-b4f6-9399057ba641-istio-data\") pod \"e2e-derive-a40054de-openshift-default-5749884b64-pmt9k\" (UID: \"61b1640f-f0b3-408b-b4f6-9399057ba641\") " pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:42:35.169815 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:35.169786    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61b1640f-f0b3-408b-b4f6-9399057ba641-workload-certs\") pod \"e2e-derive-a40054de-openshift-default-5749884b64-pmt9k\" (UID: \"61b1640f-f0b3-408b-b4f6-9399057ba641\") " pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:42:35.170121 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:35.170104    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61b1640f-f0b3-408b-b4f6-9399057ba641-istiod-ca-cert\") pod \"e2e-derive-a40054de-openshift-default-5749884b64-pmt9k\" (UID: \"61b1640f-f0b3-408b-b4f6-9399057ba641\") " pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:42:35.172294 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:35.172224    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61b1640f-f0b3-408b-b4f6-9399057ba641-istio-envoy\") pod \"e2e-derive-a40054de-openshift-default-5749884b64-pmt9k\" (UID: \"61b1640f-f0b3-408b-b4f6-9399057ba641\") " pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:42:35.172456 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:35.172437    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61b1640f-f0b3-408b-b4f6-9399057ba641-istio-podinfo\") pod \"e2e-derive-a40054de-openshift-default-5749884b64-pmt9k\" (UID: \"61b1640f-f0b3-408b-b4f6-9399057ba641\") " pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:42:35.178126 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:35.178092    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61b1640f-f0b3-408b-b4f6-9399057ba641-istio-token\") pod \"e2e-derive-a40054de-openshift-default-5749884b64-pmt9k\" (UID: \"61b1640f-f0b3-408b-b4f6-9399057ba641\") " pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:42:35.178287 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:35.178203    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtrfc\" (UniqueName: \"kubernetes.io/projected/61b1640f-f0b3-408b-b4f6-9399057ba641-kube-api-access-mtrfc\") pod \"e2e-derive-a40054de-openshift-default-5749884b64-pmt9k\" (UID: \"61b1640f-f0b3-408b-b4f6-9399057ba641\") " pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:42:35.240315 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:35.240270    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:42:35.525830 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:35.525800    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"]
Sep 05 06:42:35.528001 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:42:35.527971    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61b1640f_f0b3_408b_b4f6_9399057ba641.slice/crio-d52f6de69ed44180a7c8ec5d53b2e6b1a58a6b977a0b71e4afead15c4f1e625e WatchSource:0}: Error finding container d52f6de69ed44180a7c8ec5d53b2e6b1a58a6b977a0b71e4afead15c4f1e625e: Status 404 returned error can't find the container with id d52f6de69ed44180a7c8ec5d53b2e6b1a58a6b977a0b71e4afead15c4f1e625e
Sep 05 06:42:35.530525 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:35.530492    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:42:35.530604 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:35.530563    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:42:35.530604 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:35.530596    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:42:36.376850 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:36.376808    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k" event={"ID":"61b1640f-f0b3-408b-b4f6-9399057ba641","Type":"ContainerStarted","Data":"7fe7a948cc4dce20bd0a7ddc4bb46476acb920fdd5b9d56f9d187f14a49b7e76"}
Sep 05 06:42:36.377272 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:36.376872    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k" event={"ID":"61b1640f-f0b3-408b-b4f6-9399057ba641","Type":"ContainerStarted","Data":"d52f6de69ed44180a7c8ec5d53b2e6b1a58a6b977a0b71e4afead15c4f1e625e"}
Sep 05 06:42:36.404600 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:36.404534    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k" podStartSLOduration=2.404514198 podStartE2EDuration="2.404514198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:42:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:42:36.402379348 +0000 UTC m=+1022.376134024" watchObservedRunningTime="2026-09-05 06:42:36.404514198 +0000 UTC m=+1022.378268873"
Sep 05 06:42:37.240946 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:37.240908    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:42:37.246550 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:37.246519    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:42:37.382457 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:37.382415    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:42:37.383664 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:37.383642    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:42:39.395304 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.395271    2567 generic.go:356] "Generic (PLEG): container finished" podID="c4be56ba-c269-408c-9aef-a9c9ee9b5566" containerID="8b2c06cf78a4818e842d8fba65d199c40351a552221540954548652d8609d769" exitCode=0
Sep 05 06:42:39.395758 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.395336    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4" event={"ID":"c4be56ba-c269-408c-9aef-a9c9ee9b5566","Type":"ContainerDied","Data":"8b2c06cf78a4818e842d8fba65d199c40351a552221540954548652d8609d769"}
Sep 05 06:42:39.395758 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.395400    2567 scope.go:117] "RemoveContainer" containerID="2fe81ddbec3b26a8e7ed4887269b6791e5d4cd44bdf1a4fa0cb0cc936cd0eee4"
Sep 05 06:42:39.419059 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.419020    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:42:39.517950 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.517907    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4be56ba-c269-408c-9aef-a9c9ee9b5566-istiod-ca-cert\") pod \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\" (UID: \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\") "
Sep 05 06:42:39.518203 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.518001    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4be56ba-c269-408c-9aef-a9c9ee9b5566-istio-token\") pod \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\" (UID: \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\") "
Sep 05 06:42:39.518203 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.518064    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbtsr\" (UniqueName: \"kubernetes.io/projected/c4be56ba-c269-408c-9aef-a9c9ee9b5566-kube-api-access-lbtsr\") pod \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\" (UID: \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\") "
Sep 05 06:42:39.518203 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.518090    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4be56ba-c269-408c-9aef-a9c9ee9b5566-workload-socket\") pod \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\" (UID: \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\") "
Sep 05 06:42:39.518203 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.518110    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4be56ba-c269-408c-9aef-a9c9ee9b5566-workload-certs\") pod \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\" (UID: \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\") "
Sep 05 06:42:39.518203 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.518127    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4be56ba-c269-408c-9aef-a9c9ee9b5566-istio-data\") pod \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\" (UID: \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\") "
Sep 05 06:42:39.518203 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.518149    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4be56ba-c269-408c-9aef-a9c9ee9b5566-istio-podinfo\") pod \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\" (UID: \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\") "
Sep 05 06:42:39.518203 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.518173    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4be56ba-c269-408c-9aef-a9c9ee9b5566-istio-envoy\") pod \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\" (UID: \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\") "
Sep 05 06:42:39.518587 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.518197    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4be56ba-c269-408c-9aef-a9c9ee9b5566-credential-socket\") pod \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\" (UID: \"c4be56ba-c269-408c-9aef-a9c9ee9b5566\") "
Sep 05 06:42:39.518587 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.518435    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4be56ba-c269-408c-9aef-a9c9ee9b5566-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c4be56ba-c269-408c-9aef-a9c9ee9b5566" (UID: "c4be56ba-c269-408c-9aef-a9c9ee9b5566"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:42:39.518587 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.518482    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4be56ba-c269-408c-9aef-a9c9ee9b5566-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c4be56ba-c269-408c-9aef-a9c9ee9b5566" (UID: "c4be56ba-c269-408c-9aef-a9c9ee9b5566"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:42:39.518744 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.518713    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4be56ba-c269-408c-9aef-a9c9ee9b5566-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c4be56ba-c269-408c-9aef-a9c9ee9b5566" (UID: "c4be56ba-c269-408c-9aef-a9c9ee9b5566"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:42:39.518744 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.518728    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4be56ba-c269-408c-9aef-a9c9ee9b5566-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c4be56ba-c269-408c-9aef-a9c9ee9b5566" (UID: "c4be56ba-c269-408c-9aef-a9c9ee9b5566"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:42:39.518959 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.518917    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4be56ba-c269-408c-9aef-a9c9ee9b5566-istio-data" (OuterVolumeSpecName: "istio-data") pod "c4be56ba-c269-408c-9aef-a9c9ee9b5566" (UID: "c4be56ba-c269-408c-9aef-a9c9ee9b5566"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:42:39.519212 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.519086    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4be56ba-c269-408c-9aef-a9c9ee9b5566-istiod-ca-cert\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:42:39.519212 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.519108    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4be56ba-c269-408c-9aef-a9c9ee9b5566-workload-socket\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:42:39.519212 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.519121    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4be56ba-c269-408c-9aef-a9c9ee9b5566-workload-certs\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:42:39.519212 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.519134    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4be56ba-c269-408c-9aef-a9c9ee9b5566-credential-socket\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:42:39.520615 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.520586    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4be56ba-c269-408c-9aef-a9c9ee9b5566-istio-token" (OuterVolumeSpecName: "istio-token") pod "c4be56ba-c269-408c-9aef-a9c9ee9b5566" (UID: "c4be56ba-c269-408c-9aef-a9c9ee9b5566"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:42:39.520748 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.520676    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4be56ba-c269-408c-9aef-a9c9ee9b5566-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c4be56ba-c269-408c-9aef-a9c9ee9b5566" (UID: "c4be56ba-c269-408c-9aef-a9c9ee9b5566"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:42:39.520858 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.520837    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4be56ba-c269-408c-9aef-a9c9ee9b5566-kube-api-access-lbtsr" (OuterVolumeSpecName: "kube-api-access-lbtsr") pod "c4be56ba-c269-408c-9aef-a9c9ee9b5566" (UID: "c4be56ba-c269-408c-9aef-a9c9ee9b5566"). InnerVolumeSpecName "kube-api-access-lbtsr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:42:39.520913 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.520899    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c4be56ba-c269-408c-9aef-a9c9ee9b5566-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c4be56ba-c269-408c-9aef-a9c9ee9b5566" (UID: "c4be56ba-c269-408c-9aef-a9c9ee9b5566"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 05 06:42:39.620270 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.620227    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4be56ba-c269-408c-9aef-a9c9ee9b5566-istio-envoy\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:42:39.620270 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.620261    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4be56ba-c269-408c-9aef-a9c9ee9b5566-istio-token\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:42:39.620270 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.620273    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbtsr\" (UniqueName: \"kubernetes.io/projected/c4be56ba-c269-408c-9aef-a9c9ee9b5566-kube-api-access-lbtsr\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:42:39.620270 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.620282    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4be56ba-c269-408c-9aef-a9c9ee9b5566-istio-data\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:42:39.620568 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.620291    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4be56ba-c269-408c-9aef-a9c9ee9b5566-istio-podinfo\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:42:39.671367 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.671327    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt"]
Sep 05 06:42:39.671718 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.671702    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4be56ba-c269-408c-9aef-a9c9ee9b5566" containerName="istio-proxy"
Sep 05 06:42:39.671718 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.671717    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4be56ba-c269-408c-9aef-a9c9ee9b5566" containerName="istio-proxy"
Sep 05 06:42:39.671861 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.671792    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4be56ba-c269-408c-9aef-a9c9ee9b5566" containerName="istio-proxy"
Sep 05 06:42:39.676228 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.676205    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt"
Sep 05 06:42:39.679051 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.679009    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-a40054de-dockercfg-mdz7k\""
Sep 05 06:42:39.679186 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.679009    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-a40054de\""
Sep 05 06:42:39.687488 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.687459    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt"]
Sep 05 06:42:39.822130 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.821996    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6tjx\" (UniqueName: \"kubernetes.io/projected/2637e56d-a4c5-4f06-8798-bcc299e19888-kube-api-access-k6tjx\") pod \"payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt\" (UID: \"2637e56d-a4c5-4f06-8798-bcc299e19888\") " pod="openshift-ingress/payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt"
Sep 05 06:42:39.822288 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.822235    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2637e56d-a4c5-4f06-8798-bcc299e19888-plugins-config-volume\") pod \"payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt\" (UID: \"2637e56d-a4c5-4f06-8798-bcc299e19888\") " pod="openshift-ingress/payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt"
Sep 05 06:42:39.923647 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.923586    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2637e56d-a4c5-4f06-8798-bcc299e19888-plugins-config-volume\") pod \"payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt\" (UID: \"2637e56d-a4c5-4f06-8798-bcc299e19888\") " pod="openshift-ingress/payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt"
Sep 05 06:42:39.923647 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.923667    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6tjx\" (UniqueName: \"kubernetes.io/projected/2637e56d-a4c5-4f06-8798-bcc299e19888-kube-api-access-k6tjx\") pod \"payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt\" (UID: \"2637e56d-a4c5-4f06-8798-bcc299e19888\") " pod="openshift-ingress/payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt"
Sep 05 06:42:39.924414 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.924387    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2637e56d-a4c5-4f06-8798-bcc299e19888-plugins-config-volume\") pod \"payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt\" (UID: \"2637e56d-a4c5-4f06-8798-bcc299e19888\") " pod="openshift-ingress/payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt"
Sep 05 06:42:39.934759 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.934726    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6tjx\" (UniqueName: \"kubernetes.io/projected/2637e56d-a4c5-4f06-8798-bcc299e19888-kube-api-access-k6tjx\") pod \"payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt\" (UID: \"2637e56d-a4c5-4f06-8798-bcc299e19888\") " pod="openshift-ingress/payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt"
Sep 05 06:42:39.988759 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:39.988723    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt"
Sep 05 06:42:40.267867 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:40.267836    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt"]
Sep 05 06:42:40.269679 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:40.269639    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf"
Sep 05 06:42:40.269840 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:40.269693    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf"
Sep 05 06:42:40.269963 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:42:40.269924    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2637e56d_a4c5_4f06_8798_bcc299e19888.slice/crio-4635a6200135d57a1ace7605ff99f1af418e91fb0af469d8b9f3764212a4211f WatchSource:0}: Error finding container 4635a6200135d57a1ace7605ff99f1af418e91fb0af469d8b9f3764212a4211f: Status 404 returned error can't find the container with id 4635a6200135d57a1ace7605ff99f1af418e91fb0af469d8b9f3764212a4211f
Sep 05 06:42:40.282918 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:40.282891    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf"
Sep 05 06:42:40.402346 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:40.402321    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"
Sep 05 06:42:40.402854 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:40.402367    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4" event={"ID":"c4be56ba-c269-408c-9aef-a9c9ee9b5566","Type":"ContainerDied","Data":"ee3accea3417f3bedd1e4c87e4320dcc346525ea5b2d59aa97be5093e25f3e84"}
Sep 05 06:42:40.402854 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:40.402437    2567 scope.go:117] "RemoveContainer" containerID="8b2c06cf78a4818e842d8fba65d199c40351a552221540954548652d8609d769"
Sep 05 06:42:40.404901 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:40.404845    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt" event={"ID":"2637e56d-a4c5-4f06-8798-bcc299e19888","Type":"ContainerStarted","Data":"7829aa847a43109e63e5d6ea83f12cd7594b2c735192597219afcd8d4d2b71c5"}
Sep 05 06:42:40.405055 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:40.404917    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt" event={"ID":"2637e56d-a4c5-4f06-8798-bcc299e19888","Type":"ContainerStarted","Data":"4635a6200135d57a1ace7605ff99f1af418e91fb0af469d8b9f3764212a4211f"}
Sep 05 06:42:40.418222 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:40.418189    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf"
Sep 05 06:42:40.442517 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:40.442472    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"]
Sep 05 06:42:40.446169 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:40.446135    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4"]
Sep 05 06:42:40.462212 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:40.462141    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt" podStartSLOduration=1.4621180329999999 podStartE2EDuration="1.462118033s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:42:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:42:40.46180759 +0000 UTC m=+1026.435562244" watchObservedRunningTime="2026-09-05 06:42:40.462118033 +0000 UTC m=+1026.435872709"
Sep 05 06:42:40.582556 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:40.582459    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4be56ba-c269-408c-9aef-a9c9ee9b5566" path="/var/lib/kubelet/pods/c4be56ba-c269-408c-9aef-a9c9ee9b5566/volumes"
Sep 05 06:42:41.418534 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:41.418496    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt"
Sep 05 06:42:52.427267 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:42:52.427224    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt"
Sep 05 06:43:00.531648 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:00.531617    2567 generic.go:356] "Generic (PLEG): container finished" podID="61b1640f-f0b3-408b-b4f6-9399057ba641" containerID="7fe7a948cc4dce20bd0a7ddc4bb46476acb920fdd5b9d56f9d187f14a49b7e76" exitCode=0
Sep 05 06:43:00.532107 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:00.531688    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k" event={"ID":"61b1640f-f0b3-408b-b4f6-9399057ba641","Type":"ContainerDied","Data":"7fe7a948cc4dce20bd0a7ddc4bb46476acb920fdd5b9d56f9d187f14a49b7e76"}
Sep 05 06:43:00.532163 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:00.532146    2567 scope.go:117] "RemoveContainer" containerID="7fe7a948cc4dce20bd0a7ddc4bb46476acb920fdd5b9d56f9d187f14a49b7e76"
Sep 05 06:43:00.533261 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:00.533236    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:43:00.533319 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:00.533302    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:43:00.533397 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:00.533332    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:43:01.542667 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:01.542621    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k" event={"ID":"61b1640f-f0b3-408b-b4f6-9399057ba641","Type":"ContainerStarted","Data":"1a7ea460bb7a1e1dec226c7d2f5d1f4cc84d782283605cd19f05bdfa6c9e52ed"}
Sep 05 06:43:02.241200 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:02.241162    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:43:02.242071 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:02.241923    2567 patch_prober.go:28] interesting pod/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 05 06:43:02.242294 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:02.242269    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k" podUID="61b1640f-f0b3-408b-b4f6-9399057ba641" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 05 06:43:02.680586 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:02.680485    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a40054de-p8lns"]
Sep 05 06:43:02.681128 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:02.681106    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4be56ba-c269-408c-9aef-a9c9ee9b5566" containerName="istio-proxy"
Sep 05 06:43:02.681221 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:02.681131    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4be56ba-c269-408c-9aef-a9c9ee9b5566" containerName="istio-proxy"
Sep 05 06:43:02.681290 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:02.681276    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4be56ba-c269-408c-9aef-a9c9ee9b5566" containerName="istio-proxy"
Sep 05 06:43:02.683411 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:02.683385    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a40054de-p8lns"
Sep 05 06:43:02.707097 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:02.707004    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tlgjj\""
Sep 05 06:43:02.707097 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:02.707004    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 05 06:43:02.720841 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:02.720802    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a40054de-p8lns"]
Sep 05 06:43:02.764099 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:02.764050    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe1663a0-f37c-4bde-9867-e867e2f946ce-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a40054de-p8lns\" (UID: \"fe1663a0-f37c-4bde-9867-e867e2f946ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a40054de-p8lns"
Sep 05 06:43:02.865727 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:02.865683    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe1663a0-f37c-4bde-9867-e867e2f946ce-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a40054de-p8lns\" (UID: \"fe1663a0-f37c-4bde-9867-e867e2f946ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a40054de-p8lns"
Sep 05 06:43:02.866398 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:02.866376    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe1663a0-f37c-4bde-9867-e867e2f946ce-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a40054de-p8lns\" (UID: \"fe1663a0-f37c-4bde-9867-e867e2f946ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a40054de-p8lns"
Sep 05 06:43:02.994240 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:02.994196    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a40054de-p8lns"
Sep 05 06:43:03.241554 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:03.241009    2567 patch_prober.go:28] interesting pod/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 05 06:43:03.241554 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:03.241116    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k" podUID="61b1640f-f0b3-408b-b4f6-9399057ba641" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 05 06:43:03.288443 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:03.288414    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a40054de-p8lns"]
Sep 05 06:43:03.290392 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:43:03.290359    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe1663a0_f37c_4bde_9867_e867e2f946ce.slice/crio-ee65549e4fc4e3cba3d26ad15249f892db2cfd40976de2531328fea280708c08 WatchSource:0}: Error finding container ee65549e4fc4e3cba3d26ad15249f892db2cfd40976de2531328fea280708c08: Status 404 returned error can't find the container with id ee65549e4fc4e3cba3d26ad15249f892db2cfd40976de2531328fea280708c08
Sep 05 06:43:03.561400 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:03.561343    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a40054de-p8lns" event={"ID":"fe1663a0-f37c-4bde-9867-e867e2f946ce","Type":"ContainerStarted","Data":"ee65549e4fc4e3cba3d26ad15249f892db2cfd40976de2531328fea280708c08"}
Sep 05 06:43:04.241249 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:04.241204    2567 patch_prober.go:28] interesting pod/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 05 06:43:04.241926 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:04.241884    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k" podUID="61b1640f-f0b3-408b-b4f6-9399057ba641" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 05 06:43:04.568222 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:04.568120    2567 generic.go:356] "Generic (PLEG): container finished" podID="fe1663a0-f37c-4bde-9867-e867e2f946ce" containerID="fa2f43f7da146739c5b799c889a1caf01386a52091a774e99b5ab19c1aa138db" exitCode=0
Sep 05 06:43:04.568391 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:04.568236    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a40054de-p8lns" event={"ID":"fe1663a0-f37c-4bde-9867-e867e2f946ce","Type":"ContainerDied","Data":"fa2f43f7da146739c5b799c889a1caf01386a52091a774e99b5ab19c1aa138db"}
Sep 05 06:43:05.241142 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:05.241093    2567 patch_prober.go:28] interesting pod/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 05 06:43:05.241459 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:05.241425    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k" podUID="61b1640f-f0b3-408b-b4f6-9399057ba641" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 05 06:43:05.758510 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:05.758483    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a40054de-p8lns"
Sep 05 06:43:05.795943 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:05.795863    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe1663a0-f37c-4bde-9867-e867e2f946ce-maas-api-service-ca\") pod \"fe1663a0-f37c-4bde-9867-e867e2f946ce\" (UID: \"fe1663a0-f37c-4bde-9867-e867e2f946ce\") "
Sep 05 06:43:05.796265 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:05.796239    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe1663a0-f37c-4bde-9867-e867e2f946ce-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fe1663a0-f37c-4bde-9867-e867e2f946ce" (UID: "fe1663a0-f37c-4bde-9867-e867e2f946ce"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:43:05.796409 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:05.796396    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe1663a0-f37c-4bde-9867-e867e2f946ce-maas-api-service-ca\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:43:06.241401 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:06.241347    2567 patch_prober.go:28] interesting pod/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 05 06:43:06.241650 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:06.241465    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k" podUID="61b1640f-f0b3-408b-b4f6-9399057ba641" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 05 06:43:06.582227 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:06.582129    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a40054de-p8lns"
Sep 05 06:43:06.582227 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:06.582147    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a40054de-p8lns" event={"ID":"fe1663a0-f37c-4bde-9867-e867e2f946ce","Type":"ContainerDied","Data":"ee65549e4fc4e3cba3d26ad15249f892db2cfd40976de2531328fea280708c08"}
Sep 05 06:43:06.582227 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:06.582193    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ee65549e4fc4e3cba3d26ad15249f892db2cfd40976de2531328fea280708c08"
Sep 05 06:43:06.912549 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:06.912439    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a092eb-z82zk"]
Sep 05 06:43:06.912963 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:06.912940    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe1663a0-f37c-4bde-9867-e867e2f946ce" containerName="revoke-keys"
Sep 05 06:43:06.913075 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:06.912967    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe1663a0-f37c-4bde-9867-e867e2f946ce" containerName="revoke-keys"
Sep 05 06:43:06.913147 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:06.913100    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe1663a0-f37c-4bde-9867-e867e2f946ce" containerName="revoke-keys"
Sep 05 06:43:06.915790 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:06.915749    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a092eb-z82zk"
Sep 05 06:43:06.918984 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:06.918950    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tlgjj\""
Sep 05 06:43:06.919241 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:06.919223    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 05 06:43:06.926091 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:06.926061    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a092eb-z82zk"]
Sep 05 06:43:07.008249 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:07.008210    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/753c88c8-0d60-4d0e-a1be-a619f8a3170a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-a092eb-z82zk\" (UID: \"753c88c8-0d60-4d0e-a1be-a619f8a3170a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a092eb-z82zk"
Sep 05 06:43:07.110053 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:07.109984    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/753c88c8-0d60-4d0e-a1be-a619f8a3170a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-a092eb-z82zk\" (UID: \"753c88c8-0d60-4d0e-a1be-a619f8a3170a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a092eb-z82zk"
Sep 05 06:43:07.110946 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:07.110916    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/753c88c8-0d60-4d0e-a1be-a619f8a3170a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-a092eb-z82zk\" (UID: \"753c88c8-0d60-4d0e-a1be-a619f8a3170a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a092eb-z82zk"
Sep 05 06:43:07.230252 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:07.230215    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a092eb-z82zk"
Sep 05 06:43:07.282551 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:07.282277    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:43:07.283067 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:07.282866    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:43:07.284073 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:07.284048    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:43:07.528290 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:07.528094    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a092eb-z82zk"]
Sep 05 06:43:07.530601 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:43:07.530549    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod753c88c8_0d60_4d0e_a1be_a619f8a3170a.slice/crio-9b941a8f903cc9f9a011b37943e3ef4213fbd430f355ae74b6cd8def7ea6180b WatchSource:0}: Error finding container 9b941a8f903cc9f9a011b37943e3ef4213fbd430f355ae74b6cd8def7ea6180b: Status 404 returned error can't find the container with id 9b941a8f903cc9f9a011b37943e3ef4213fbd430f355ae74b6cd8def7ea6180b
Sep 05 06:43:07.589450 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:07.589410    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a092eb-z82zk" event={"ID":"753c88c8-0d60-4d0e-a1be-a619f8a3170a","Type":"ContainerStarted","Data":"9b941a8f903cc9f9a011b37943e3ef4213fbd430f355ae74b6cd8def7ea6180b"}
Sep 05 06:43:08.596850 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:08.596756    2567 generic.go:356] "Generic (PLEG): container finished" podID="753c88c8-0d60-4d0e-a1be-a619f8a3170a" containerID="064dc82fed05239da27796552101d384fb312529929de08c7af4f49fffd65aaf" exitCode=0
Sep 05 06:43:08.596850 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:08.596837    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a092eb-z82zk" event={"ID":"753c88c8-0d60-4d0e-a1be-a619f8a3170a","Type":"ContainerDied","Data":"064dc82fed05239da27796552101d384fb312529929de08c7af4f49fffd65aaf"}
Sep 05 06:43:09.743447 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:09.743419    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a092eb-z82zk"
Sep 05 06:43:09.842208 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:09.842174    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/753c88c8-0d60-4d0e-a1be-a619f8a3170a-maas-api-service-ca\") pod \"753c88c8-0d60-4d0e-a1be-a619f8a3170a\" (UID: \"753c88c8-0d60-4d0e-a1be-a619f8a3170a\") "
Sep 05 06:43:09.842565 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:09.842542    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/753c88c8-0d60-4d0e-a1be-a619f8a3170a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "753c88c8-0d60-4d0e-a1be-a619f8a3170a" (UID: "753c88c8-0d60-4d0e-a1be-a619f8a3170a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:43:09.858163 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:09.858054    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt"]
Sep 05 06:43:09.858383 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:09.858351    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt" podUID="2637e56d-a4c5-4f06-8798-bcc299e19888" containerName="payload-processing" containerID="cri-o://7829aa847a43109e63e5d6ea83f12cd7594b2c735192597219afcd8d4d2b71c5" gracePeriod=30
Sep 05 06:43:09.943184 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:09.943152    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/753c88c8-0d60-4d0e-a1be-a619f8a3170a-maas-api-service-ca\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:43:10.039896 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:10.039860    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a40054de-p8lns"]
Sep 05 06:43:10.045677 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:10.045635    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a40054de-p8lns"]
Sep 05 06:43:10.108571 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:10.108491    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt"
Sep 05 06:43:10.179010 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:10.178964    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"]
Sep 05 06:43:10.179262 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:10.179236    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k" podUID="61b1640f-f0b3-408b-b4f6-9399057ba641" containerName="istio-proxy" containerID="cri-o://1a7ea460bb7a1e1dec226c7d2f5d1f4cc84d782283605cd19f05bdfa6c9e52ed" gracePeriod=30
Sep 05 06:43:10.246553 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:10.246515    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6tjx\" (UniqueName: \"kubernetes.io/projected/2637e56d-a4c5-4f06-8798-bcc299e19888-kube-api-access-k6tjx\") pod \"2637e56d-a4c5-4f06-8798-bcc299e19888\" (UID: \"2637e56d-a4c5-4f06-8798-bcc299e19888\") "
Sep 05 06:43:10.246787 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:10.246692    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2637e56d-a4c5-4f06-8798-bcc299e19888-plugins-config-volume\") pod \"2637e56d-a4c5-4f06-8798-bcc299e19888\" (UID: \"2637e56d-a4c5-4f06-8798-bcc299e19888\") "
Sep 05 06:43:10.247100 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:10.247076    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2637e56d-a4c5-4f06-8798-bcc299e19888-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2637e56d-a4c5-4f06-8798-bcc299e19888" (UID: "2637e56d-a4c5-4f06-8798-bcc299e19888"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:43:10.248945 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:10.248920    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2637e56d-a4c5-4f06-8798-bcc299e19888-kube-api-access-k6tjx" (OuterVolumeSpecName: "kube-api-access-k6tjx") pod "2637e56d-a4c5-4f06-8798-bcc299e19888" (UID: "2637e56d-a4c5-4f06-8798-bcc299e19888"). InnerVolumeSpecName "kube-api-access-k6tjx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:43:10.348561 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:10.348518    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6tjx\" (UniqueName: \"kubernetes.io/projected/2637e56d-a4c5-4f06-8798-bcc299e19888-kube-api-access-k6tjx\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:43:10.348561 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:10.348554    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2637e56d-a4c5-4f06-8798-bcc299e19888-plugins-config-volume\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:43:10.581899 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:10.581864    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe1663a0-f37c-4bde-9867-e867e2f946ce" path="/var/lib/kubelet/pods/fe1663a0-f37c-4bde-9867-e867e2f946ce/volumes"
Sep 05 06:43:10.608519 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:10.608488    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a092eb-z82zk"
Sep 05 06:43:10.608519 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:10.608498    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a092eb-z82zk" event={"ID":"753c88c8-0d60-4d0e-a1be-a619f8a3170a","Type":"ContainerDied","Data":"9b941a8f903cc9f9a011b37943e3ef4213fbd430f355ae74b6cd8def7ea6180b"}
Sep 05 06:43:10.608796 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:10.608553    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b941a8f903cc9f9a011b37943e3ef4213fbd430f355ae74b6cd8def7ea6180b"
Sep 05 06:43:10.610289 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:10.610240    2567 generic.go:356] "Generic (PLEG): container finished" podID="2637e56d-a4c5-4f06-8798-bcc299e19888" containerID="7829aa847a43109e63e5d6ea83f12cd7594b2c735192597219afcd8d4d2b71c5" exitCode=0
Sep 05 06:43:10.610473 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:10.610296    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt"
Sep 05 06:43:10.610473 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:10.610320    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt" event={"ID":"2637e56d-a4c5-4f06-8798-bcc299e19888","Type":"ContainerDied","Data":"7829aa847a43109e63e5d6ea83f12cd7594b2c735192597219afcd8d4d2b71c5"}
Sep 05 06:43:10.610473 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:10.610381    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt" event={"ID":"2637e56d-a4c5-4f06-8798-bcc299e19888","Type":"ContainerDied","Data":"4635a6200135d57a1ace7605ff99f1af418e91fb0af469d8b9f3764212a4211f"}
Sep 05 06:43:10.610473 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:10.610406    2567 scope.go:117] "RemoveContainer" containerID="7829aa847a43109e63e5d6ea83f12cd7594b2c735192597219afcd8d4d2b71c5"
Sep 05 06:43:10.620581 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:10.620559    2567 scope.go:117] "RemoveContainer" containerID="7829aa847a43109e63e5d6ea83f12cd7594b2c735192597219afcd8d4d2b71c5"
Sep 05 06:43:10.621074 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:43:10.621051    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7829aa847a43109e63e5d6ea83f12cd7594b2c735192597219afcd8d4d2b71c5\": container with ID starting with 7829aa847a43109e63e5d6ea83f12cd7594b2c735192597219afcd8d4d2b71c5 not found: ID does not exist" containerID="7829aa847a43109e63e5d6ea83f12cd7594b2c735192597219afcd8d4d2b71c5"
Sep 05 06:43:10.621157 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:10.621086    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7829aa847a43109e63e5d6ea83f12cd7594b2c735192597219afcd8d4d2b71c5"} err="failed to get container status \"7829aa847a43109e63e5d6ea83f12cd7594b2c735192597219afcd8d4d2b71c5\": rpc error: code = NotFound desc = could not find container \"7829aa847a43109e63e5d6ea83f12cd7594b2c735192597219afcd8d4d2b71c5\": container with ID starting with 7829aa847a43109e63e5d6ea83f12cd7594b2c735192597219afcd8d4d2b71c5 not found: ID does not exist"
Sep 05 06:43:10.629825 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:10.629780    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt"]
Sep 05 06:43:10.634010 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:10.633980    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt"]
Sep 05 06:43:12.581446 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:12.581411    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2637e56d-a4c5-4f06-8798-bcc299e19888" path="/var/lib/kubelet/pods/2637e56d-a4c5-4f06-8798-bcc299e19888/volumes"
Sep 05 06:43:15.215626 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:43:15.215592    2567 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61b1640f_f0b3_408b_b4f6_9399057ba641.slice/crio-1a7ea460bb7a1e1dec226c7d2f5d1f4cc84d782283605cd19f05bdfa6c9e52ed.scope\": RecentStats: unable to find data in memory cache]"
Sep 05 06:43:15.464753 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.464724    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:43:15.598559 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.598519    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtrfc\" (UniqueName: \"kubernetes.io/projected/61b1640f-f0b3-408b-b4f6-9399057ba641-kube-api-access-mtrfc\") pod \"61b1640f-f0b3-408b-b4f6-9399057ba641\" (UID: \"61b1640f-f0b3-408b-b4f6-9399057ba641\") "
Sep 05 06:43:15.598559 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.598556    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61b1640f-f0b3-408b-b4f6-9399057ba641-istiod-ca-cert\") pod \"61b1640f-f0b3-408b-b4f6-9399057ba641\" (UID: \"61b1640f-f0b3-408b-b4f6-9399057ba641\") "
Sep 05 06:43:15.598812 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.598604    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61b1640f-f0b3-408b-b4f6-9399057ba641-istio-data\") pod \"61b1640f-f0b3-408b-b4f6-9399057ba641\" (UID: \"61b1640f-f0b3-408b-b4f6-9399057ba641\") "
Sep 05 06:43:15.598812 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.598627    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61b1640f-f0b3-408b-b4f6-9399057ba641-istio-podinfo\") pod \"61b1640f-f0b3-408b-b4f6-9399057ba641\" (UID: \"61b1640f-f0b3-408b-b4f6-9399057ba641\") "
Sep 05 06:43:15.598812 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.598661    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61b1640f-f0b3-408b-b4f6-9399057ba641-istio-token\") pod \"61b1640f-f0b3-408b-b4f6-9399057ba641\" (UID: \"61b1640f-f0b3-408b-b4f6-9399057ba641\") "
Sep 05 06:43:15.598812 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.598687    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61b1640f-f0b3-408b-b4f6-9399057ba641-workload-certs\") pod \"61b1640f-f0b3-408b-b4f6-9399057ba641\" (UID: \"61b1640f-f0b3-408b-b4f6-9399057ba641\") "
Sep 05 06:43:15.598812 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.598746    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61b1640f-f0b3-408b-b4f6-9399057ba641-credential-socket\") pod \"61b1640f-f0b3-408b-b4f6-9399057ba641\" (UID: \"61b1640f-f0b3-408b-b4f6-9399057ba641\") "
Sep 05 06:43:15.598812 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.598789    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61b1640f-f0b3-408b-b4f6-9399057ba641-istio-envoy\") pod \"61b1640f-f0b3-408b-b4f6-9399057ba641\" (UID: \"61b1640f-f0b3-408b-b4f6-9399057ba641\") "
Sep 05 06:43:15.599167 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.598823    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61b1640f-f0b3-408b-b4f6-9399057ba641-workload-socket\") pod \"61b1640f-f0b3-408b-b4f6-9399057ba641\" (UID: \"61b1640f-f0b3-408b-b4f6-9399057ba641\") "
Sep 05 06:43:15.599167 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.598932    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61b1640f-f0b3-408b-b4f6-9399057ba641-istio-data" (OuterVolumeSpecName: "istio-data") pod "61b1640f-f0b3-408b-b4f6-9399057ba641" (UID: "61b1640f-f0b3-408b-b4f6-9399057ba641"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:43:15.599283 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.599190    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61b1640f-f0b3-408b-b4f6-9399057ba641-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "61b1640f-f0b3-408b-b4f6-9399057ba641" (UID: "61b1640f-f0b3-408b-b4f6-9399057ba641"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:43:15.599283 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.599221    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61b1640f-f0b3-408b-b4f6-9399057ba641-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "61b1640f-f0b3-408b-b4f6-9399057ba641" (UID: "61b1640f-f0b3-408b-b4f6-9399057ba641"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:43:15.599380 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.599285    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61b1640f-f0b3-408b-b4f6-9399057ba641-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "61b1640f-f0b3-408b-b4f6-9399057ba641" (UID: "61b1640f-f0b3-408b-b4f6-9399057ba641"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:43:15.599380 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.599366    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61b1640f-f0b3-408b-b4f6-9399057ba641-istiod-ca-cert\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:43:15.599477 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.599388    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61b1640f-f0b3-408b-b4f6-9399057ba641-istio-data\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:43:15.599477 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.599402    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61b1640f-f0b3-408b-b4f6-9399057ba641-credential-socket\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:43:15.599477 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.599417    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61b1640f-f0b3-408b-b4f6-9399057ba641-workload-socket\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:43:15.599616 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.599534    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61b1640f-f0b3-408b-b4f6-9399057ba641-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "61b1640f-f0b3-408b-b4f6-9399057ba641" (UID: "61b1640f-f0b3-408b-b4f6-9399057ba641"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:43:15.601021 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.600993    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61b1640f-f0b3-408b-b4f6-9399057ba641-kube-api-access-mtrfc" (OuterVolumeSpecName: "kube-api-access-mtrfc") pod "61b1640f-f0b3-408b-b4f6-9399057ba641" (UID: "61b1640f-f0b3-408b-b4f6-9399057ba641"). InnerVolumeSpecName "kube-api-access-mtrfc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:43:15.601181 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.601092    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/61b1640f-f0b3-408b-b4f6-9399057ba641-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "61b1640f-f0b3-408b-b4f6-9399057ba641" (UID: "61b1640f-f0b3-408b-b4f6-9399057ba641"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 05 06:43:15.601318 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.601301    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61b1640f-f0b3-408b-b4f6-9399057ba641-istio-token" (OuterVolumeSpecName: "istio-token") pod "61b1640f-f0b3-408b-b4f6-9399057ba641" (UID: "61b1640f-f0b3-408b-b4f6-9399057ba641"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:43:15.601490 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.601466    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61b1640f-f0b3-408b-b4f6-9399057ba641-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "61b1640f-f0b3-408b-b4f6-9399057ba641" (UID: "61b1640f-f0b3-408b-b4f6-9399057ba641"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:43:15.640153 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.640119    2567 generic.go:356] "Generic (PLEG): container finished" podID="61b1640f-f0b3-408b-b4f6-9399057ba641" containerID="1a7ea460bb7a1e1dec226c7d2f5d1f4cc84d782283605cd19f05bdfa6c9e52ed" exitCode=0
Sep 05 06:43:15.640334 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.640175    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"
Sep 05 06:43:15.640334 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.640207    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k" event={"ID":"61b1640f-f0b3-408b-b4f6-9399057ba641","Type":"ContainerDied","Data":"1a7ea460bb7a1e1dec226c7d2f5d1f4cc84d782283605cd19f05bdfa6c9e52ed"}
Sep 05 06:43:15.640334 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.640271    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k" event={"ID":"61b1640f-f0b3-408b-b4f6-9399057ba641","Type":"ContainerDied","Data":"d52f6de69ed44180a7c8ec5d53b2e6b1a58a6b977a0b71e4afead15c4f1e625e"}
Sep 05 06:43:15.640334 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.640302    2567 scope.go:117] "RemoveContainer" containerID="1a7ea460bb7a1e1dec226c7d2f5d1f4cc84d782283605cd19f05bdfa6c9e52ed"
Sep 05 06:43:15.650431 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.650413    2567 scope.go:117] "RemoveContainer" containerID="7fe7a948cc4dce20bd0a7ddc4bb46476acb920fdd5b9d56f9d187f14a49b7e76"
Sep 05 06:43:15.664075 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.664052    2567 scope.go:117] "RemoveContainer" containerID="1a7ea460bb7a1e1dec226c7d2f5d1f4cc84d782283605cd19f05bdfa6c9e52ed"
Sep 05 06:43:15.664174 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.664128    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"]
Sep 05 06:43:15.664452 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:43:15.664432    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a7ea460bb7a1e1dec226c7d2f5d1f4cc84d782283605cd19f05bdfa6c9e52ed\": container with ID starting with 1a7ea460bb7a1e1dec226c7d2f5d1f4cc84d782283605cd19f05bdfa6c9e52ed not found: ID does not exist" containerID="1a7ea460bb7a1e1dec226c7d2f5d1f4cc84d782283605cd19f05bdfa6c9e52ed"
Sep 05 06:43:15.664527 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.664466    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a7ea460bb7a1e1dec226c7d2f5d1f4cc84d782283605cd19f05bdfa6c9e52ed"} err="failed to get container status \"1a7ea460bb7a1e1dec226c7d2f5d1f4cc84d782283605cd19f05bdfa6c9e52ed\": rpc error: code = NotFound desc = could not find container \"1a7ea460bb7a1e1dec226c7d2f5d1f4cc84d782283605cd19f05bdfa6c9e52ed\": container with ID starting with 1a7ea460bb7a1e1dec226c7d2f5d1f4cc84d782283605cd19f05bdfa6c9e52ed not found: ID does not exist"
Sep 05 06:43:15.664527 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.664494    2567 scope.go:117] "RemoveContainer" containerID="7fe7a948cc4dce20bd0a7ddc4bb46476acb920fdd5b9d56f9d187f14a49b7e76"
Sep 05 06:43:15.664805 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:43:15.664789    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fe7a948cc4dce20bd0a7ddc4bb46476acb920fdd5b9d56f9d187f14a49b7e76\": container with ID starting with 7fe7a948cc4dce20bd0a7ddc4bb46476acb920fdd5b9d56f9d187f14a49b7e76 not found: ID does not exist" containerID="7fe7a948cc4dce20bd0a7ddc4bb46476acb920fdd5b9d56f9d187f14a49b7e76"
Sep 05 06:43:15.664844 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.664812    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fe7a948cc4dce20bd0a7ddc4bb46476acb920fdd5b9d56f9d187f14a49b7e76"} err="failed to get container status \"7fe7a948cc4dce20bd0a7ddc4bb46476acb920fdd5b9d56f9d187f14a49b7e76\": rpc error: code = NotFound desc = could not find container \"7fe7a948cc4dce20bd0a7ddc4bb46476acb920fdd5b9d56f9d187f14a49b7e76\": container with ID starting with 7fe7a948cc4dce20bd0a7ddc4bb46476acb920fdd5b9d56f9d187f14a49b7e76 not found: ID does not exist"
Sep 05 06:43:15.668740 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.668696    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k"]
Sep 05 06:43:15.700572 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.700482    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61b1640f-f0b3-408b-b4f6-9399057ba641-istio-podinfo\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:43:15.700572 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.700512    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61b1640f-f0b3-408b-b4f6-9399057ba641-istio-token\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:43:15.700572 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.700522    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61b1640f-f0b3-408b-b4f6-9399057ba641-workload-certs\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:43:15.700572 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.700532    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61b1640f-f0b3-408b-b4f6-9399057ba641-istio-envoy\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:43:15.700572 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:15.700542    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtrfc\" (UniqueName: \"kubernetes.io/projected/61b1640f-f0b3-408b-b4f6-9399057ba641-kube-api-access-mtrfc\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:43:16.581910 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:16.581869    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61b1640f-f0b3-408b-b4f6-9399057ba641" path="/var/lib/kubelet/pods/61b1640f-f0b3-408b-b4f6-9399057ba641/volumes"
Sep 05 06:43:17.893762 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:17.893719    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-a092eb-68bc75587c-586bb"]
Sep 05 06:43:17.894661 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:17.894619    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-a092eb-68bc75587c-586bb" podUID="45d3849b-542b-47fb-99a9-6c70c5649419" containerName="payload-processing" containerID="cri-o://ba7e4f08f37c53c2c5753495d6883e9327b01461da638f2b79575ca40c136af3" gracePeriod=30
Sep 05 06:43:18.075527 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:18.075494    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a092eb-z82zk"]
Sep 05 06:43:18.078933 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:18.078900    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a092eb-z82zk"]
Sep 05 06:43:18.164369 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:18.164340    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-a092eb-68bc75587c-586bb"
Sep 05 06:43:18.226196 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:18.226156    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45d3849b-542b-47fb-99a9-6c70c5649419-plugins-config-volume\") pod \"45d3849b-542b-47fb-99a9-6c70c5649419\" (UID: \"45d3849b-542b-47fb-99a9-6c70c5649419\") "
Sep 05 06:43:18.226392 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:18.226304    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kcpz\" (UniqueName: \"kubernetes.io/projected/45d3849b-542b-47fb-99a9-6c70c5649419-kube-api-access-5kcpz\") pod \"45d3849b-542b-47fb-99a9-6c70c5649419\" (UID: \"45d3849b-542b-47fb-99a9-6c70c5649419\") "
Sep 05 06:43:18.226691 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:18.226655    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45d3849b-542b-47fb-99a9-6c70c5649419-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "45d3849b-542b-47fb-99a9-6c70c5649419" (UID: "45d3849b-542b-47fb-99a9-6c70c5649419"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:43:18.229469 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:18.229426    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45d3849b-542b-47fb-99a9-6c70c5649419-kube-api-access-5kcpz" (OuterVolumeSpecName: "kube-api-access-5kcpz") pod "45d3849b-542b-47fb-99a9-6c70c5649419" (UID: "45d3849b-542b-47fb-99a9-6c70c5649419"). InnerVolumeSpecName "kube-api-access-5kcpz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:43:18.327516 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:18.327468    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kcpz\" (UniqueName: \"kubernetes.io/projected/45d3849b-542b-47fb-99a9-6c70c5649419-kube-api-access-5kcpz\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:43:18.327516 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:18.327509    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45d3849b-542b-47fb-99a9-6c70c5649419-plugins-config-volume\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:43:18.582045 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:18.581993    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="753c88c8-0d60-4d0e-a1be-a619f8a3170a" path="/var/lib/kubelet/pods/753c88c8-0d60-4d0e-a1be-a619f8a3170a/volumes"
Sep 05 06:43:18.661379 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:18.661340    2567 generic.go:356] "Generic (PLEG): container finished" podID="45d3849b-542b-47fb-99a9-6c70c5649419" containerID="ba7e4f08f37c53c2c5753495d6883e9327b01461da638f2b79575ca40c136af3" exitCode=0
Sep 05 06:43:18.661560 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:18.661440    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-a092eb-68bc75587c-586bb"
Sep 05 06:43:18.661560 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:18.661478    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-a092eb-68bc75587c-586bb" event={"ID":"45d3849b-542b-47fb-99a9-6c70c5649419","Type":"ContainerDied","Data":"ba7e4f08f37c53c2c5753495d6883e9327b01461da638f2b79575ca40c136af3"}
Sep 05 06:43:18.661560 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:18.661537    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-a092eb-68bc75587c-586bb" event={"ID":"45d3849b-542b-47fb-99a9-6c70c5649419","Type":"ContainerDied","Data":"37f1638ed3d7a0d99d274153788b709eb43e9cbd345b035929a39a6e0c2c90eb"}
Sep 05 06:43:18.661725 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:18.661565    2567 scope.go:117] "RemoveContainer" containerID="ba7e4f08f37c53c2c5753495d6883e9327b01461da638f2b79575ca40c136af3"
Sep 05 06:43:18.671717 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:18.671697    2567 scope.go:117] "RemoveContainer" containerID="ba7e4f08f37c53c2c5753495d6883e9327b01461da638f2b79575ca40c136af3"
Sep 05 06:43:18.672113 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:43:18.672085    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba7e4f08f37c53c2c5753495d6883e9327b01461da638f2b79575ca40c136af3\": container with ID starting with ba7e4f08f37c53c2c5753495d6883e9327b01461da638f2b79575ca40c136af3 not found: ID does not exist" containerID="ba7e4f08f37c53c2c5753495d6883e9327b01461da638f2b79575ca40c136af3"
Sep 05 06:43:18.672205 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:18.672126    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba7e4f08f37c53c2c5753495d6883e9327b01461da638f2b79575ca40c136af3"} err="failed to get container status \"ba7e4f08f37c53c2c5753495d6883e9327b01461da638f2b79575ca40c136af3\": rpc error: code = NotFound desc = could not find container \"ba7e4f08f37c53c2c5753495d6883e9327b01461da638f2b79575ca40c136af3\": container with ID starting with ba7e4f08f37c53c2c5753495d6883e9327b01461da638f2b79575ca40c136af3 not found: ID does not exist"
Sep 05 06:43:18.681466 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:18.681425    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-a092eb-68bc75587c-586bb"]
Sep 05 06:43:18.688830 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:18.688797    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-a092eb-68bc75587c-586bb"]
Sep 05 06:43:20.582379 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:20.582327    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45d3849b-542b-47fb-99a9-6c70c5649419" path="/var/lib/kubelet/pods/45d3849b-542b-47fb-99a9-6c70c5649419/volumes"
Sep 05 06:43:26.068765 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.068669    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"]
Sep 05 06:43:26.069208 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.069069    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45d3849b-542b-47fb-99a9-6c70c5649419" containerName="payload-processing"
Sep 05 06:43:26.069208 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.069082    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="45d3849b-542b-47fb-99a9-6c70c5649419" containerName="payload-processing"
Sep 05 06:43:26.069208 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.069095    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61b1640f-f0b3-408b-b4f6-9399057ba641" containerName="istio-proxy"
Sep 05 06:43:26.069208 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.069100    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="61b1640f-f0b3-408b-b4f6-9399057ba641" containerName="istio-proxy"
Sep 05 06:43:26.069208 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.069128    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="753c88c8-0d60-4d0e-a1be-a619f8a3170a" containerName="revoke-keys"
Sep 05 06:43:26.069208 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.069134    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="753c88c8-0d60-4d0e-a1be-a619f8a3170a" containerName="revoke-keys"
Sep 05 06:43:26.069208 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.069141    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2637e56d-a4c5-4f06-8798-bcc299e19888" containerName="payload-processing"
Sep 05 06:43:26.069208 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.069148    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2637e56d-a4c5-4f06-8798-bcc299e19888" containerName="payload-processing"
Sep 05 06:43:26.069208 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.069204    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2637e56d-a4c5-4f06-8798-bcc299e19888" containerName="payload-processing"
Sep 05 06:43:26.069208 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.069211    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="61b1640f-f0b3-408b-b4f6-9399057ba641" containerName="istio-proxy"
Sep 05 06:43:26.069208 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.069219    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="45d3849b-542b-47fb-99a9-6c70c5649419" containerName="payload-processing"
Sep 05 06:43:26.069208 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.069225    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="753c88c8-0d60-4d0e-a1be-a619f8a3170a" containerName="revoke-keys"
Sep 05 06:43:26.071349 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.071327    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"
Sep 05 06:43:26.074117 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.074090    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-3f08e4-openshift-default-dockercfg-4s5rr\""
Sep 05 06:43:26.086652 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.086617    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"]
Sep 05 06:43:26.217249 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.217202    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-credential-socket\") pod \"e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6\" (UID: \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\") " pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"
Sep 05 06:43:26.217483 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.217267    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-istio-data\") pod \"e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6\" (UID: \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\") " pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"
Sep 05 06:43:26.217483 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.217320    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-istio-envoy\") pod \"e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6\" (UID: \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\") " pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"
Sep 05 06:43:26.217483 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.217425    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-istio-token\") pod \"e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6\" (UID: \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\") " pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"
Sep 05 06:43:26.217483 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.217452    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-istiod-ca-cert\") pod \"e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6\" (UID: \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\") " pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"
Sep 05 06:43:26.217641 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.217488    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-istio-podinfo\") pod \"e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6\" (UID: \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\") " pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"
Sep 05 06:43:26.217641 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.217567    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-workload-certs\") pod \"e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6\" (UID: \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\") " pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"
Sep 05 06:43:26.217641 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.217606    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-workload-socket\") pod \"e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6\" (UID: \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\") " pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"
Sep 05 06:43:26.217641 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.217626    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbmwc\" (UniqueName: \"kubernetes.io/projected/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-kube-api-access-gbmwc\") pod \"e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6\" (UID: \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\") " pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"
Sep 05 06:43:26.318604 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.318553    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-credential-socket\") pod \"e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6\" (UID: \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\") " pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"
Sep 05 06:43:26.318604 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.318615    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-istio-data\") pod \"e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6\" (UID: \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\") " pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"
Sep 05 06:43:26.318917 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.318635    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-istio-envoy\") pod \"e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6\" (UID: \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\") " pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"
Sep 05 06:43:26.318917 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.318688    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-istio-token\") pod \"e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6\" (UID: \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\") " pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"
Sep 05 06:43:26.318917 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.318831    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-istiod-ca-cert\") pod \"e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6\" (UID: \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\") " pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"
Sep 05 06:43:26.318917 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.318892    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-istio-podinfo\") pod \"e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6\" (UID: \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\") " pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"
Sep 05 06:43:26.319196 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.318961    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-workload-certs\") pod \"e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6\" (UID: \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\") " pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"
Sep 05 06:43:26.319196 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.318984    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-credential-socket\") pod \"e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6\" (UID: \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\") " pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"
Sep 05 06:43:26.319196 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.318997    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-workload-socket\") pod \"e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6\" (UID: \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\") " pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"
Sep 05 06:43:26.319196 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.319066    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbmwc\" (UniqueName: \"kubernetes.io/projected/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-kube-api-access-gbmwc\") pod \"e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6\" (UID: \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\") " pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"
Sep 05 06:43:26.319196 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.319067    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-istio-data\") pod \"e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6\" (UID: \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\") " pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"
Sep 05 06:43:26.319389 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.319285    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-workload-certs\") pod \"e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6\" (UID: \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\") " pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"
Sep 05 06:43:26.319389 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.319361    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-workload-socket\") pod \"e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6\" (UID: \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\") " pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"
Sep 05 06:43:26.319529 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.319508    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-istiod-ca-cert\") pod \"e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6\" (UID: \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\") " pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"
Sep 05 06:43:26.321300 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.321278    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-istio-envoy\") pod \"e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6\" (UID: \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\") " pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"
Sep 05 06:43:26.321545 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.321529    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-istio-podinfo\") pod \"e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6\" (UID: \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\") " pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"
Sep 05 06:43:26.328467 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.328438    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-istio-token\") pod \"e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6\" (UID: \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\") " pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"
Sep 05 06:43:26.328705 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.328681    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbmwc\" (UniqueName: \"kubernetes.io/projected/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-kube-api-access-gbmwc\") pod \"e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6\" (UID: \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\") " pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"
Sep 05 06:43:26.383642 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.383598    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"
Sep 05 06:43:26.663451 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.663420    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"]
Sep 05 06:43:26.665291 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:43:26.665257    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0c7f0d4_c5b0_4ac1_96b0_4735ba0dca8d.slice/crio-5a759f630e67f0b8a41e10c0af1ebfc0678893017ecfbd9a74cc31241560ae0a WatchSource:0}: Error finding container 5a759f630e67f0b8a41e10c0af1ebfc0678893017ecfbd9a74cc31241560ae0a: Status 404 returned error can't find the container with id 5a759f630e67f0b8a41e10c0af1ebfc0678893017ecfbd9a74cc31241560ae0a
Sep 05 06:43:26.667734 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.667696    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:43:26.667816 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.667780    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:43:26.667816 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.667810    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:43:26.708465 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:26.708430    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6" event={"ID":"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d","Type":"ContainerStarted","Data":"5a759f630e67f0b8a41e10c0af1ebfc0678893017ecfbd9a74cc31241560ae0a"}
Sep 05 06:43:27.715915 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:27.715878    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6" event={"ID":"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d","Type":"ContainerStarted","Data":"0b2b25779e080c8b09dcc999db80e088eef06407f6a63117c1d2fda816bf969f"}
Sep 05 06:43:27.741088 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:27.741016    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6" podStartSLOduration=1.740999607 podStartE2EDuration="1.740999607s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:43:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:43:27.739196361 +0000 UTC m=+1073.712951037" watchObservedRunningTime="2026-09-05 06:43:27.740999607 +0000 UTC m=+1073.714754282"
Sep 05 06:43:28.384237 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:28.384197    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"
Sep 05 06:43:28.389541 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:28.389514    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"
Sep 05 06:43:28.721021 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:28.720981    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"
Sep 05 06:43:28.721962 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:28.721942    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"
Sep 05 06:43:53.668372 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:53.668330    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"]
Sep 05 06:43:53.668962 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:53.668609    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6" podUID="d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d" containerName="istio-proxy" containerID="cri-o://0b2b25779e080c8b09dcc999db80e088eef06407f6a63117c1d2fda816bf969f" gracePeriod=30
Sep 05 06:43:58.722154 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:58.722114    2567 patch_prober.go:28] interesting pod/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 05 06:43:58.722562 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:58.722179    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6" podUID="d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 05 06:43:58.892143 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:58.892101    2567 generic.go:356] "Generic (PLEG): container finished" podID="d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d" containerID="0b2b25779e080c8b09dcc999db80e088eef06407f6a63117c1d2fda816bf969f" exitCode=0
Sep 05 06:43:58.892323 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:58.892166    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6" event={"ID":"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d","Type":"ContainerDied","Data":"0b2b25779e080c8b09dcc999db80e088eef06407f6a63117c1d2fda816bf969f"}
Sep 05 06:43:58.936255 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:58.936180    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"
Sep 05 06:43:58.958284 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:58.958237    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-istio-envoy\") pod \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\" (UID: \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\") "
Sep 05 06:43:58.958503 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:58.958335    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-workload-socket\") pod \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\" (UID: \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\") "
Sep 05 06:43:58.958503 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:58.958373    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbmwc\" (UniqueName: \"kubernetes.io/projected/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-kube-api-access-gbmwc\") pod \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\" (UID: \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\") "
Sep 05 06:43:58.958503 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:58.958405    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-istio-token\") pod \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\" (UID: \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\") "
Sep 05 06:43:58.958503 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:58.958482    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-workload-certs\") pod \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\" (UID: \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\") "
Sep 05 06:43:58.958730 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:58.958543    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-istio-data\") pod \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\" (UID: \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\") "
Sep 05 06:43:58.958730 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:58.958590    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-istiod-ca-cert\") pod \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\" (UID: \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\") "
Sep 05 06:43:58.958730 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:58.958616    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-istio-podinfo\") pod \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\" (UID: \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\") "
Sep 05 06:43:58.958730 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:58.958672    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-credential-socket\") pod \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\" (UID: \"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d\") "
Sep 05 06:43:58.959495 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:58.959331    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d" (UID: "d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:43:58.959495 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:58.959434    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d" (UID: "d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:43:58.959936 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:58.959545    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d" (UID: "d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:43:58.959936 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:58.959673    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-istio-data" (OuterVolumeSpecName: "istio-data") pod "d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d" (UID: "d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:43:58.959936 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:58.959737    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d" (UID: "d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:43:58.962579 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:58.962547    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-kube-api-access-gbmwc" (OuterVolumeSpecName: "kube-api-access-gbmwc") pod "d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d" (UID: "d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d"). InnerVolumeSpecName "kube-api-access-gbmwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:43:58.962753 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:58.962650    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-istio-token" (OuterVolumeSpecName: "istio-token") pod "d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d" (UID: "d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:43:58.962753 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:58.962704    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d" (UID: "d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:43:58.962911 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:58.962886    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d" (UID: "d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 05 06:43:59.060281 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:59.060241    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-workload-certs\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:43:59.060281 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:59.060276    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-istio-data\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:43:59.060281 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:59.060284    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-istiod-ca-cert\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:43:59.060281 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:59.060291    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-istio-podinfo\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:43:59.060566 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:59.060300    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-credential-socket\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:43:59.060566 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:59.060308    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-istio-envoy\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:43:59.060566 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:59.060316    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-workload-socket\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:43:59.060566 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:59.060324    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbmwc\" (UniqueName: \"kubernetes.io/projected/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-kube-api-access-gbmwc\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:43:59.060566 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:59.060332    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d-istio-token\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:43:59.898807 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:59.898775    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"
Sep 05 06:43:59.899328 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:59.898806    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6" event={"ID":"d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d","Type":"ContainerDied","Data":"5a759f630e67f0b8a41e10c0af1ebfc0678893017ecfbd9a74cc31241560ae0a"}
Sep 05 06:43:59.899328 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:59.898865    2567 scope.go:117] "RemoveContainer" containerID="0b2b25779e080c8b09dcc999db80e088eef06407f6a63117c1d2fda816bf969f"
Sep 05 06:43:59.925861 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:59.925829    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"]
Sep 05 06:43:59.932396 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:43:59.932371    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6"]
Sep 05 06:44:00.350040 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:00.349986    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf"]
Sep 05 06:44:00.475118 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:00.475081    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6efc3a-rn2hc"]
Sep 05 06:44:00.475468 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:00.475456    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61b1640f-f0b3-408b-b4f6-9399057ba641" containerName="istio-proxy"
Sep 05 06:44:00.475513 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:00.475470    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="61b1640f-f0b3-408b-b4f6-9399057ba641" containerName="istio-proxy"
Sep 05 06:44:00.475513 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:00.475494    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d" containerName="istio-proxy"
Sep 05 06:44:00.475513 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:00.475500    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d" containerName="istio-proxy"
Sep 05 06:44:00.475612 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:00.475553    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d" containerName="istio-proxy"
Sep 05 06:44:00.475612 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:00.475562    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="61b1640f-f0b3-408b-b4f6-9399057ba641" containerName="istio-proxy"
Sep 05 06:44:00.478575 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:00.478557    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6efc3a-rn2hc"
Sep 05 06:44:00.481277 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:00.481250    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 05 06:44:00.481429 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:00.481315    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tlgjj\""
Sep 05 06:44:00.486964 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:00.486939    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6efc3a-rn2hc"]
Sep 05 06:44:00.574741 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:00.574699    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d309eed4-1504-42b9-89e9-abb70f5e8fba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-6efc3a-rn2hc\" (UID: \"d309eed4-1504-42b9-89e9-abb70f5e8fba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6efc3a-rn2hc"
Sep 05 06:44:00.581365 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:00.581337    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d" path="/var/lib/kubelet/pods/d0c7f0d4-c5b0-4ac1-96b0-4735ba0dca8d/volumes"
Sep 05 06:44:00.676011 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:00.675915    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d309eed4-1504-42b9-89e9-abb70f5e8fba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-6efc3a-rn2hc\" (UID: \"d309eed4-1504-42b9-89e9-abb70f5e8fba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6efc3a-rn2hc"
Sep 05 06:44:00.676613 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:00.676589    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d309eed4-1504-42b9-89e9-abb70f5e8fba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-6efc3a-rn2hc\" (UID: \"d309eed4-1504-42b9-89e9-abb70f5e8fba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6efc3a-rn2hc"
Sep 05 06:44:00.791643 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:00.791603    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6efc3a-rn2hc"
Sep 05 06:44:01.068660 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:01.068628    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6efc3a-rn2hc"]
Sep 05 06:44:01.070778 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:44:01.070750    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd309eed4_1504_42b9_89e9_abb70f5e8fba.slice/crio-c2e2601aad132f54b24de795b241949f96c4901cb9211780316a8706626bf997 WatchSource:0}: Error finding container c2e2601aad132f54b24de795b241949f96c4901cb9211780316a8706626bf997: Status 404 returned error can't find the container with id c2e2601aad132f54b24de795b241949f96c4901cb9211780316a8706626bf997
Sep 05 06:44:01.912686 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:01.912646    2567 generic.go:356] "Generic (PLEG): container finished" podID="d309eed4-1504-42b9-89e9-abb70f5e8fba" containerID="ec938d2cf64a6594d5cfb28b974315f98264d4ed7bb80ba19e93ac8bc9434a2f" exitCode=0
Sep 05 06:44:01.912881 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:01.912727    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6efc3a-rn2hc" event={"ID":"d309eed4-1504-42b9-89e9-abb70f5e8fba","Type":"ContainerDied","Data":"ec938d2cf64a6594d5cfb28b974315f98264d4ed7bb80ba19e93ac8bc9434a2f"}
Sep 05 06:44:01.912881 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:01.912803    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6efc3a-rn2hc" event={"ID":"d309eed4-1504-42b9-89e9-abb70f5e8fba","Type":"ContainerStarted","Data":"c2e2601aad132f54b24de795b241949f96c4901cb9211780316a8706626bf997"}
Sep 05 06:44:03.055899 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:03.055871    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6efc3a-rn2hc"
Sep 05 06:44:03.099703 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:03.099664    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d309eed4-1504-42b9-89e9-abb70f5e8fba-maas-api-service-ca\") pod \"d309eed4-1504-42b9-89e9-abb70f5e8fba\" (UID: \"d309eed4-1504-42b9-89e9-abb70f5e8fba\") "
Sep 05 06:44:03.100104 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:03.100077    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d309eed4-1504-42b9-89e9-abb70f5e8fba-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d309eed4-1504-42b9-89e9-abb70f5e8fba" (UID: "d309eed4-1504-42b9-89e9-abb70f5e8fba"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:44:03.201446 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:03.201400    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d309eed4-1504-42b9-89e9-abb70f5e8fba-maas-api-service-ca\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:44:03.927952 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:03.927856    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6efc3a-rn2hc" event={"ID":"d309eed4-1504-42b9-89e9-abb70f5e8fba","Type":"ContainerDied","Data":"c2e2601aad132f54b24de795b241949f96c4901cb9211780316a8706626bf997"}
Sep 05 06:44:03.927952 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:03.927901    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6efc3a-rn2hc"
Sep 05 06:44:03.927952 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:03.927925    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2e2601aad132f54b24de795b241949f96c4901cb9211780316a8706626bf997"
Sep 05 06:44:11.284947 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:11.284907    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6efc3a-rn2hc"]
Sep 05 06:44:11.289204 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:11.289176    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6efc3a-rn2hc"]
Sep 05 06:44:12.581089 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:12.581052    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d309eed4-1504-42b9-89e9-abb70f5e8fba" path="/var/lib/kubelet/pods/d309eed4-1504-42b9-89e9-abb70f5e8fba/volumes"
Sep 05 06:44:15.370881 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:15.370837    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf" podUID="3a8841c6-ed23-4ff9-993b-0c378ccaaf0f" containerName="main" containerID="cri-o://6e824a425889c5e1d89955e21b5b16cdf8a0fa1ac0ef727e554127d6183638fe" gracePeriod=45
Sep 05 06:44:15.634365 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:15.634288    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf"
Sep 05 06:44:15.731867 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:15.731819    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a8841c6-ed23-4ff9-993b-0c378ccaaf0f-tmp-dir\") pod \"3a8841c6-ed23-4ff9-993b-0c378ccaaf0f\" (UID: \"3a8841c6-ed23-4ff9-993b-0c378ccaaf0f\") "
Sep 05 06:44:15.731867 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:15.731871    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hq8s9\" (UniqueName: \"kubernetes.io/projected/3a8841c6-ed23-4ff9-993b-0c378ccaaf0f-kube-api-access-hq8s9\") pod \"3a8841c6-ed23-4ff9-993b-0c378ccaaf0f\" (UID: \"3a8841c6-ed23-4ff9-993b-0c378ccaaf0f\") "
Sep 05 06:44:15.732119 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:15.731917    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a8841c6-ed23-4ff9-993b-0c378ccaaf0f-model-cache\") pod \"3a8841c6-ed23-4ff9-993b-0c378ccaaf0f\" (UID: \"3a8841c6-ed23-4ff9-993b-0c378ccaaf0f\") "
Sep 05 06:44:15.732119 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:15.732079    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a8841c6-ed23-4ff9-993b-0c378ccaaf0f-dshm\") pod \"3a8841c6-ed23-4ff9-993b-0c378ccaaf0f\" (UID: \"3a8841c6-ed23-4ff9-993b-0c378ccaaf0f\") "
Sep 05 06:44:15.732200 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:15.732148    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a8841c6-ed23-4ff9-993b-0c378ccaaf0f-home\") pod \"3a8841c6-ed23-4ff9-993b-0c378ccaaf0f\" (UID: \"3a8841c6-ed23-4ff9-993b-0c378ccaaf0f\") "
Sep 05 06:44:15.732200 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:15.732183    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a8841c6-ed23-4ff9-993b-0c378ccaaf0f-tls-certs\") pod \"3a8841c6-ed23-4ff9-993b-0c378ccaaf0f\" (UID: \"3a8841c6-ed23-4ff9-993b-0c378ccaaf0f\") "
Sep 05 06:44:15.732278 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:15.732201    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a8841c6-ed23-4ff9-993b-0c378ccaaf0f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3a8841c6-ed23-4ff9-993b-0c378ccaaf0f" (UID: "3a8841c6-ed23-4ff9-993b-0c378ccaaf0f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:44:15.732278 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:15.732213    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a8841c6-ed23-4ff9-993b-0c378ccaaf0f-model-cache" (OuterVolumeSpecName: "model-cache") pod "3a8841c6-ed23-4ff9-993b-0c378ccaaf0f" (UID: "3a8841c6-ed23-4ff9-993b-0c378ccaaf0f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:44:15.732430 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:15.732410    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a8841c6-ed23-4ff9-993b-0c378ccaaf0f-home" (OuterVolumeSpecName: "home") pod "3a8841c6-ed23-4ff9-993b-0c378ccaaf0f" (UID: "3a8841c6-ed23-4ff9-993b-0c378ccaaf0f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:44:15.732519 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:15.732504    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a8841c6-ed23-4ff9-993b-0c378ccaaf0f-tmp-dir\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:44:15.732576 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:15.732521    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a8841c6-ed23-4ff9-993b-0c378ccaaf0f-model-cache\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:44:15.732576 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:15.732534    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a8841c6-ed23-4ff9-993b-0c378ccaaf0f-home\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:44:15.734544 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:15.734510    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a8841c6-ed23-4ff9-993b-0c378ccaaf0f-dshm" (OuterVolumeSpecName: "dshm") pod "3a8841c6-ed23-4ff9-993b-0c378ccaaf0f" (UID: "3a8841c6-ed23-4ff9-993b-0c378ccaaf0f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:44:15.734544 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:15.734510    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a8841c6-ed23-4ff9-993b-0c378ccaaf0f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3a8841c6-ed23-4ff9-993b-0c378ccaaf0f" (UID: "3a8841c6-ed23-4ff9-993b-0c378ccaaf0f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 05 06:44:15.734707 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:15.734565    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a8841c6-ed23-4ff9-993b-0c378ccaaf0f-kube-api-access-hq8s9" (OuterVolumeSpecName: "kube-api-access-hq8s9") pod "3a8841c6-ed23-4ff9-993b-0c378ccaaf0f" (UID: "3a8841c6-ed23-4ff9-993b-0c378ccaaf0f"). InnerVolumeSpecName "kube-api-access-hq8s9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:44:15.833555 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:15.833506    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a8841c6-ed23-4ff9-993b-0c378ccaaf0f-dshm\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:44:15.833555 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:15.833544    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a8841c6-ed23-4ff9-993b-0c378ccaaf0f-tls-certs\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:44:15.833555 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:15.833555    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hq8s9\" (UniqueName: \"kubernetes.io/projected/3a8841c6-ed23-4ff9-993b-0c378ccaaf0f-kube-api-access-hq8s9\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:44:15.992619 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:15.992584    2567 generic.go:356] "Generic (PLEG): container finished" podID="3a8841c6-ed23-4ff9-993b-0c378ccaaf0f" containerID="6e824a425889c5e1d89955e21b5b16cdf8a0fa1ac0ef727e554127d6183638fe" exitCode=0
Sep 05 06:44:15.992819 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:15.992653    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf"
Sep 05 06:44:15.992819 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:15.992665    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf" event={"ID":"3a8841c6-ed23-4ff9-993b-0c378ccaaf0f","Type":"ContainerDied","Data":"6e824a425889c5e1d89955e21b5b16cdf8a0fa1ac0ef727e554127d6183638fe"}
Sep 05 06:44:15.992819 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:15.992715    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf" event={"ID":"3a8841c6-ed23-4ff9-993b-0c378ccaaf0f","Type":"ContainerDied","Data":"3458d58835f3439fcbd97fcfbaf58d4dc9bf287df59ebb8d61fe2837887b7aa4"}
Sep 05 06:44:15.992819 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:15.992741    2567 scope.go:117] "RemoveContainer" containerID="6e824a425889c5e1d89955e21b5b16cdf8a0fa1ac0ef727e554127d6183638fe"
Sep 05 06:44:16.002789 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:16.002767    2567 scope.go:117] "RemoveContainer" containerID="6e824a425889c5e1d89955e21b5b16cdf8a0fa1ac0ef727e554127d6183638fe"
Sep 05 06:44:16.003191 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:44:16.003169    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e824a425889c5e1d89955e21b5b16cdf8a0fa1ac0ef727e554127d6183638fe\": container with ID starting with 6e824a425889c5e1d89955e21b5b16cdf8a0fa1ac0ef727e554127d6183638fe not found: ID does not exist" containerID="6e824a425889c5e1d89955e21b5b16cdf8a0fa1ac0ef727e554127d6183638fe"
Sep 05 06:44:16.003255 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:16.003201    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e824a425889c5e1d89955e21b5b16cdf8a0fa1ac0ef727e554127d6183638fe"} err="failed to get container status \"6e824a425889c5e1d89955e21b5b16cdf8a0fa1ac0ef727e554127d6183638fe\": rpc error: code = NotFound desc = could not find container \"6e824a425889c5e1d89955e21b5b16cdf8a0fa1ac0ef727e554127d6183638fe\": container with ID starting with 6e824a425889c5e1d89955e21b5b16cdf8a0fa1ac0ef727e554127d6183638fe not found: ID does not exist"
Sep 05 06:44:16.015201 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:16.015166    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf"]
Sep 05 06:44:16.022253 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:16.022217    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-5d5f17/test-model-5d5f17-kserve-6bf7ffcf97-vbpsf"]
Sep 05 06:44:16.581564 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:16.581528    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a8841c6-ed23-4ff9-993b-0c378ccaaf0f" path="/var/lib/kubelet/pods/3a8841c6-ed23-4ff9-993b-0c378ccaaf0f/volumes"
Sep 05 06:44:18.515193 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:18.515160    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"]
Sep 05 06:44:18.515616 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:18.515381    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm" podUID="5034f8c0-a2dc-42cd-8691-d4dd18f38604" containerName="istio-proxy" containerID="cri-o://64b2a092014102970072e7b591d4f55bab1d7cfecc4e5bdd09e1abc06e00c17c" gracePeriod=30
Sep 05 06:44:18.874957 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:18.874867    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d5f17-gr5np"]
Sep 05 06:44:18.875279 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:18.875265    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a8841c6-ed23-4ff9-993b-0c378ccaaf0f" containerName="main"
Sep 05 06:44:18.875336 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:18.875282    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a8841c6-ed23-4ff9-993b-0c378ccaaf0f" containerName="main"
Sep 05 06:44:18.875336 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:18.875296    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d309eed4-1504-42b9-89e9-abb70f5e8fba" containerName="revoke-keys"
Sep 05 06:44:18.875336 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:18.875302    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d309eed4-1504-42b9-89e9-abb70f5e8fba" containerName="revoke-keys"
Sep 05 06:44:18.875435 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:18.875365    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d309eed4-1504-42b9-89e9-abb70f5e8fba" containerName="revoke-keys"
Sep 05 06:44:18.875435 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:18.875375    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a8841c6-ed23-4ff9-993b-0c378ccaaf0f" containerName="main"
Sep 05 06:44:18.879497 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:18.879480    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d5f17-gr5np"
Sep 05 06:44:18.882177 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:18.882153    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 05 06:44:18.882309 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:18.882187    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tlgjj\""
Sep 05 06:44:18.887232 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:18.887210    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d5f17-gr5np"]
Sep 05 06:44:18.966788 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:18.966749    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ce2b446-7220-4246-9fdf-5287450767f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-5d5f17-gr5np\" (UID: \"1ce2b446-7220-4246-9fdf-5287450767f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d5f17-gr5np"
Sep 05 06:44:19.067795 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:19.067756    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ce2b446-7220-4246-9fdf-5287450767f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-5d5f17-gr5np\" (UID: \"1ce2b446-7220-4246-9fdf-5287450767f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d5f17-gr5np"
Sep 05 06:44:19.068565 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:19.068535    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ce2b446-7220-4246-9fdf-5287450767f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-5d5f17-gr5np\" (UID: \"1ce2b446-7220-4246-9fdf-5287450767f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d5f17-gr5np"
Sep 05 06:44:19.190804 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:19.190688    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d5f17-gr5np"
Sep 05 06:44:19.466958 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:19.466931    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d5f17-gr5np"]
Sep 05 06:44:19.469371 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:44:19.469329    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ce2b446_7220_4246_9fdf_5287450767f6.slice/crio-031c3db9cf9276851db2f6cbaa77760580fa705b959f82c87b8778ae333aec43 WatchSource:0}: Error finding container 031c3db9cf9276851db2f6cbaa77760580fa705b959f82c87b8778ae333aec43: Status 404 returned error can't find the container with id 031c3db9cf9276851db2f6cbaa77760580fa705b959f82c87b8778ae333aec43
Sep 05 06:44:20.015536 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:20.015498    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d5f17-gr5np" event={"ID":"1ce2b446-7220-4246-9fdf-5287450767f6","Type":"ContainerStarted","Data":"9a23e37108a265293f6b9a5b9a12dc3b07d8a20a3d6e73be8f78fd877b86c675"}
Sep 05 06:44:20.015964 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:20.015550    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d5f17-gr5np" event={"ID":"1ce2b446-7220-4246-9fdf-5287450767f6","Type":"ContainerStarted","Data":"031c3db9cf9276851db2f6cbaa77760580fa705b959f82c87b8778ae333aec43"}
Sep 05 06:44:20.033941 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:20.033888    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d5f17-gr5np" podStartSLOduration=2.033872123 podStartE2EDuration="2.033872123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:44:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:44:20.031213903 +0000 UTC m=+1126.004968602" watchObservedRunningTime="2026-09-05 06:44:20.033872123 +0000 UTC m=+1126.007626829"
Sep 05 06:44:21.022183 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:21.022136    2567 generic.go:356] "Generic (PLEG): container finished" podID="1ce2b446-7220-4246-9fdf-5287450767f6" containerID="9a23e37108a265293f6b9a5b9a12dc3b07d8a20a3d6e73be8f78fd877b86c675" exitCode=0
Sep 05 06:44:21.022596 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:21.022237    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d5f17-gr5np" event={"ID":"1ce2b446-7220-4246-9fdf-5287450767f6","Type":"ContainerDied","Data":"9a23e37108a265293f6b9a5b9a12dc3b07d8a20a3d6e73be8f78fd877b86c675"}
Sep 05 06:44:22.163095 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:22.163059    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d5f17-gr5np"
Sep 05 06:44:22.300307 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:22.300190    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ce2b446-7220-4246-9fdf-5287450767f6-maas-api-service-ca\") pod \"1ce2b446-7220-4246-9fdf-5287450767f6\" (UID: \"1ce2b446-7220-4246-9fdf-5287450767f6\") "
Sep 05 06:44:22.300610 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:22.300585    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ce2b446-7220-4246-9fdf-5287450767f6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1ce2b446-7220-4246-9fdf-5287450767f6" (UID: "1ce2b446-7220-4246-9fdf-5287450767f6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:44:22.401774 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:22.401730    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ce2b446-7220-4246-9fdf-5287450767f6-maas-api-service-ca\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:44:23.037207 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:23.037156    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d5f17-gr5np" event={"ID":"1ce2b446-7220-4246-9fdf-5287450767f6","Type":"ContainerDied","Data":"031c3db9cf9276851db2f6cbaa77760580fa705b959f82c87b8778ae333aec43"}
Sep 05 06:44:23.037207 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:23.037189    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d5f17-gr5np"
Sep 05 06:44:23.037453 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:23.037222    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="031c3db9cf9276851db2f6cbaa77760580fa705b959f82c87b8778ae333aec43"
Sep 05 06:44:23.780983 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:23.780901    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:44:23.916368 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:23.916310    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5034f8c0-a2dc-42cd-8691-d4dd18f38604-istio-token\") pod \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\" (UID: \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\") "
Sep 05 06:44:23.916368 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:23.916377    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5034f8c0-a2dc-42cd-8691-d4dd18f38604-credential-socket\") pod \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\" (UID: \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\") "
Sep 05 06:44:23.916665 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:23.916398    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5034f8c0-a2dc-42cd-8691-d4dd18f38604-istio-podinfo\") pod \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\" (UID: \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\") "
Sep 05 06:44:23.916665 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:23.916448    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5034f8c0-a2dc-42cd-8691-d4dd18f38604-workload-socket\") pod \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\" (UID: \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\") "
Sep 05 06:44:23.916665 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:23.916583    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5034f8c0-a2dc-42cd-8691-d4dd18f38604-workload-certs\") pod \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\" (UID: \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\") "
Sep 05 06:44:23.916665 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:23.916625    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rw5lv\" (UniqueName: \"kubernetes.io/projected/5034f8c0-a2dc-42cd-8691-d4dd18f38604-kube-api-access-rw5lv\") pod \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\" (UID: \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\") "
Sep 05 06:44:23.916665 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:23.916657    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5034f8c0-a2dc-42cd-8691-d4dd18f38604-istiod-ca-cert\") pod \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\" (UID: \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\") "
Sep 05 06:44:23.916941 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:23.916696    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5034f8c0-a2dc-42cd-8691-d4dd18f38604-istio-data\") pod \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\" (UID: \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\") "
Sep 05 06:44:23.916941 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:23.916724    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5034f8c0-a2dc-42cd-8691-d4dd18f38604-istio-envoy\") pod \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\" (UID: \"5034f8c0-a2dc-42cd-8691-d4dd18f38604\") "
Sep 05 06:44:23.916941 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:23.916743    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5034f8c0-a2dc-42cd-8691-d4dd18f38604-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5034f8c0-a2dc-42cd-8691-d4dd18f38604" (UID: "5034f8c0-a2dc-42cd-8691-d4dd18f38604"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:44:23.916941 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:23.916763    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5034f8c0-a2dc-42cd-8691-d4dd18f38604-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5034f8c0-a2dc-42cd-8691-d4dd18f38604" (UID: "5034f8c0-a2dc-42cd-8691-d4dd18f38604"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:44:23.916941 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:23.916825    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5034f8c0-a2dc-42cd-8691-d4dd18f38604-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5034f8c0-a2dc-42cd-8691-d4dd18f38604" (UID: "5034f8c0-a2dc-42cd-8691-d4dd18f38604"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:44:23.917240 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:23.916979    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5034f8c0-a2dc-42cd-8691-d4dd18f38604-istio-data" (OuterVolumeSpecName: "istio-data") pod "5034f8c0-a2dc-42cd-8691-d4dd18f38604" (UID: "5034f8c0-a2dc-42cd-8691-d4dd18f38604"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:44:23.917240 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:23.917091    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5034f8c0-a2dc-42cd-8691-d4dd18f38604-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5034f8c0-a2dc-42cd-8691-d4dd18f38604" (UID: "5034f8c0-a2dc-42cd-8691-d4dd18f38604"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:44:23.917240 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:23.917171    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5034f8c0-a2dc-42cd-8691-d4dd18f38604-credential-socket\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:44:23.917240 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:23.917194    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5034f8c0-a2dc-42cd-8691-d4dd18f38604-workload-socket\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:44:23.917240 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:23.917209    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5034f8c0-a2dc-42cd-8691-d4dd18f38604-workload-certs\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:44:23.917240 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:23.917222    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5034f8c0-a2dc-42cd-8691-d4dd18f38604-istiod-ca-cert\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:44:23.917240 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:23.917235    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5034f8c0-a2dc-42cd-8691-d4dd18f38604-istio-data\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:44:23.918827 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:23.918795    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5034f8c0-a2dc-42cd-8691-d4dd18f38604-istio-token" (OuterVolumeSpecName: "istio-token") pod "5034f8c0-a2dc-42cd-8691-d4dd18f38604" (UID: "5034f8c0-a2dc-42cd-8691-d4dd18f38604"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:44:23.919060 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:23.919041    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5034f8c0-a2dc-42cd-8691-d4dd18f38604-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5034f8c0-a2dc-42cd-8691-d4dd18f38604" (UID: "5034f8c0-a2dc-42cd-8691-d4dd18f38604"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:44:23.919321 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:23.919289    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5034f8c0-a2dc-42cd-8691-d4dd18f38604-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5034f8c0-a2dc-42cd-8691-d4dd18f38604" (UID: "5034f8c0-a2dc-42cd-8691-d4dd18f38604"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 05 06:44:23.919432 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:23.919352    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5034f8c0-a2dc-42cd-8691-d4dd18f38604-kube-api-access-rw5lv" (OuterVolumeSpecName: "kube-api-access-rw5lv") pod "5034f8c0-a2dc-42cd-8691-d4dd18f38604" (UID: "5034f8c0-a2dc-42cd-8691-d4dd18f38604"). InnerVolumeSpecName "kube-api-access-rw5lv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:44:24.018301 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:24.018257    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5034f8c0-a2dc-42cd-8691-d4dd18f38604-istio-token\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:44:24.018301 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:24.018293    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5034f8c0-a2dc-42cd-8691-d4dd18f38604-istio-podinfo\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:44:24.018301 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:24.018308    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rw5lv\" (UniqueName: \"kubernetes.io/projected/5034f8c0-a2dc-42cd-8691-d4dd18f38604-kube-api-access-rw5lv\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:44:24.018562 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:24.018321    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5034f8c0-a2dc-42cd-8691-d4dd18f38604-istio-envoy\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:44:24.045605 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:24.045494    2567 generic.go:356] "Generic (PLEG): container finished" podID="5034f8c0-a2dc-42cd-8691-d4dd18f38604" containerID="64b2a092014102970072e7b591d4f55bab1d7cfecc4e5bdd09e1abc06e00c17c" exitCode=0
Sep 05 06:44:24.045605 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:24.045549    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"
Sep 05 06:44:24.045605 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:24.045583    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm" event={"ID":"5034f8c0-a2dc-42cd-8691-d4dd18f38604","Type":"ContainerDied","Data":"64b2a092014102970072e7b591d4f55bab1d7cfecc4e5bdd09e1abc06e00c17c"}
Sep 05 06:44:24.045924 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:24.045649    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm" event={"ID":"5034f8c0-a2dc-42cd-8691-d4dd18f38604","Type":"ContainerDied","Data":"1fc298a6f4b2c4a26116fe053e0eb50661f0f617f47a0e97b5b76067116c789b"}
Sep 05 06:44:24.045924 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:24.045681    2567 scope.go:117] "RemoveContainer" containerID="64b2a092014102970072e7b591d4f55bab1d7cfecc4e5bdd09e1abc06e00c17c"
Sep 05 06:44:24.056310 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:24.056288    2567 scope.go:117] "RemoveContainer" containerID="2c03b632010b53004b419e1ae6fce49e99a5daac8fb0ccc21fdcc938d6634d6e"
Sep 05 06:44:24.065682 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:24.065658    2567 scope.go:117] "RemoveContainer" containerID="64b2a092014102970072e7b591d4f55bab1d7cfecc4e5bdd09e1abc06e00c17c"
Sep 05 06:44:24.066431 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:44:24.066370    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64b2a092014102970072e7b591d4f55bab1d7cfecc4e5bdd09e1abc06e00c17c\": container with ID starting with 64b2a092014102970072e7b591d4f55bab1d7cfecc4e5bdd09e1abc06e00c17c not found: ID does not exist" containerID="64b2a092014102970072e7b591d4f55bab1d7cfecc4e5bdd09e1abc06e00c17c"
Sep 05 06:44:24.066431 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:24.066425    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64b2a092014102970072e7b591d4f55bab1d7cfecc4e5bdd09e1abc06e00c17c"} err="failed to get container status \"64b2a092014102970072e7b591d4f55bab1d7cfecc4e5bdd09e1abc06e00c17c\": rpc error: code = NotFound desc = could not find container \"64b2a092014102970072e7b591d4f55bab1d7cfecc4e5bdd09e1abc06e00c17c\": container with ID starting with 64b2a092014102970072e7b591d4f55bab1d7cfecc4e5bdd09e1abc06e00c17c not found: ID does not exist"
Sep 05 06:44:24.066672 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:24.066451    2567 scope.go:117] "RemoveContainer" containerID="2c03b632010b53004b419e1ae6fce49e99a5daac8fb0ccc21fdcc938d6634d6e"
Sep 05 06:44:24.067006 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:44:24.066972    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c03b632010b53004b419e1ae6fce49e99a5daac8fb0ccc21fdcc938d6634d6e\": container with ID starting with 2c03b632010b53004b419e1ae6fce49e99a5daac8fb0ccc21fdcc938d6634d6e not found: ID does not exist" containerID="2c03b632010b53004b419e1ae6fce49e99a5daac8fb0ccc21fdcc938d6634d6e"
Sep 05 06:44:24.067160 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:24.067005    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c03b632010b53004b419e1ae6fce49e99a5daac8fb0ccc21fdcc938d6634d6e"} err="failed to get container status \"2c03b632010b53004b419e1ae6fce49e99a5daac8fb0ccc21fdcc938d6634d6e\": rpc error: code = NotFound desc = could not find container \"2c03b632010b53004b419e1ae6fce49e99a5daac8fb0ccc21fdcc938d6634d6e\": container with ID starting with 2c03b632010b53004b419e1ae6fce49e99a5daac8fb0ccc21fdcc938d6634d6e not found: ID does not exist"
Sep 05 06:44:24.068917 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:24.068892    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"]
Sep 05 06:44:24.074916 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:24.074880    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm"]
Sep 05 06:44:24.580795 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:24.580760    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5034f8c0-a2dc-42cd-8691-d4dd18f38604" path="/var/lib/kubelet/pods/5034f8c0-a2dc-42cd-8691-d4dd18f38604/volumes"
Sep 05 06:44:29.728174 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:29.728133    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d5f17-gr5np"]
Sep 05 06:44:29.729783 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:29.729759    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d5f17-gr5np"]
Sep 05 06:44:30.581331 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:30.581296    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ce2b446-7220-4246-9fdf-5287450767f6" path="/var/lib/kubelet/pods/1ce2b446-7220-4246-9fdf-5287450767f6/volumes"
Sep 05 06:44:36.846756 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:36.846717    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"]
Sep 05 06:44:36.847267 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:36.847007    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22" podUID="d52ee6af-272e-46cb-9b7b-f7160fdcc0c9" containerName="istio-proxy" containerID="cri-o://7464664f4d676af24c80a997352f199860633a87d5d315179abd6b25a75e18ef" gracePeriod=30
Sep 05 06:44:37.750405 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.750366    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"]
Sep 05 06:44:37.750946 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.750922    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ce2b446-7220-4246-9fdf-5287450767f6" containerName="revoke-keys"
Sep 05 06:44:37.750946 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.750948    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ce2b446-7220-4246-9fdf-5287450767f6" containerName="revoke-keys"
Sep 05 06:44:37.751205 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.750963    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5034f8c0-a2dc-42cd-8691-d4dd18f38604" containerName="istio-proxy"
Sep 05 06:44:37.751205 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.750972    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5034f8c0-a2dc-42cd-8691-d4dd18f38604" containerName="istio-proxy"
Sep 05 06:44:37.751205 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.751119    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ce2b446-7220-4246-9fdf-5287450767f6" containerName="revoke-keys"
Sep 05 06:44:37.751205 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.751136    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5034f8c0-a2dc-42cd-8691-d4dd18f38604" containerName="istio-proxy"
Sep 05 06:44:37.751205 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.751150    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5034f8c0-a2dc-42cd-8691-d4dd18f38604" containerName="istio-proxy"
Sep 05 06:44:37.756116 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.756087    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:44:37.759107 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.759079    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-ef54fd-openshift-default-dockercfg-lpjzp\""
Sep 05 06:44:37.769146 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.766746    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"]
Sep 05 06:44:37.852646 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.852596    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d59b88ec-7e33-41d4-801b-4d031787634d-credential-socket\") pod \"e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg\" (UID: \"d59b88ec-7e33-41d4-801b-4d031787634d\") " pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:44:37.853152 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.852714    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d59b88ec-7e33-41d4-801b-4d031787634d-workload-socket\") pod \"e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg\" (UID: \"d59b88ec-7e33-41d4-801b-4d031787634d\") " pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:44:37.853152 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.852752    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d59b88ec-7e33-41d4-801b-4d031787634d-istiod-ca-cert\") pod \"e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg\" (UID: \"d59b88ec-7e33-41d4-801b-4d031787634d\") " pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:44:37.853152 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.852836    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d59b88ec-7e33-41d4-801b-4d031787634d-istio-token\") pod \"e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg\" (UID: \"d59b88ec-7e33-41d4-801b-4d031787634d\") " pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:44:37.853152 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.852916    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf7sq\" (UniqueName: \"kubernetes.io/projected/d59b88ec-7e33-41d4-801b-4d031787634d-kube-api-access-gf7sq\") pod \"e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg\" (UID: \"d59b88ec-7e33-41d4-801b-4d031787634d\") " pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:44:37.853152 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.852951    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d59b88ec-7e33-41d4-801b-4d031787634d-istio-podinfo\") pod \"e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg\" (UID: \"d59b88ec-7e33-41d4-801b-4d031787634d\") " pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:44:37.853152 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.853004    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d59b88ec-7e33-41d4-801b-4d031787634d-istio-envoy\") pod \"e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg\" (UID: \"d59b88ec-7e33-41d4-801b-4d031787634d\") " pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:44:37.853152 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.853085    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d59b88ec-7e33-41d4-801b-4d031787634d-workload-certs\") pod \"e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg\" (UID: \"d59b88ec-7e33-41d4-801b-4d031787634d\") " pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:44:37.853152 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.853130    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d59b88ec-7e33-41d4-801b-4d031787634d-istio-data\") pod \"e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg\" (UID: \"d59b88ec-7e33-41d4-801b-4d031787634d\") " pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:44:37.954436 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.954386    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf7sq\" (UniqueName: \"kubernetes.io/projected/d59b88ec-7e33-41d4-801b-4d031787634d-kube-api-access-gf7sq\") pod \"e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg\" (UID: \"d59b88ec-7e33-41d4-801b-4d031787634d\") " pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:44:37.954436 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.954435    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d59b88ec-7e33-41d4-801b-4d031787634d-istio-podinfo\") pod \"e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg\" (UID: \"d59b88ec-7e33-41d4-801b-4d031787634d\") " pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:44:37.954690 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.954482    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d59b88ec-7e33-41d4-801b-4d031787634d-istio-envoy\") pod \"e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg\" (UID: \"d59b88ec-7e33-41d4-801b-4d031787634d\") " pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:44:37.954690 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.954510    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d59b88ec-7e33-41d4-801b-4d031787634d-workload-certs\") pod \"e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg\" (UID: \"d59b88ec-7e33-41d4-801b-4d031787634d\") " pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:44:37.954690 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.954544    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d59b88ec-7e33-41d4-801b-4d031787634d-istio-data\") pod \"e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg\" (UID: \"d59b88ec-7e33-41d4-801b-4d031787634d\") " pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:44:37.954690 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.954590    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d59b88ec-7e33-41d4-801b-4d031787634d-credential-socket\") pod \"e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg\" (UID: \"d59b88ec-7e33-41d4-801b-4d031787634d\") " pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:44:37.954690 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.954628    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d59b88ec-7e33-41d4-801b-4d031787634d-workload-socket\") pod \"e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg\" (UID: \"d59b88ec-7e33-41d4-801b-4d031787634d\") " pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:44:37.954690 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.954651    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d59b88ec-7e33-41d4-801b-4d031787634d-istiod-ca-cert\") pod \"e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg\" (UID: \"d59b88ec-7e33-41d4-801b-4d031787634d\") " pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:44:37.955016 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.954720    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d59b88ec-7e33-41d4-801b-4d031787634d-istio-token\") pod \"e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg\" (UID: \"d59b88ec-7e33-41d4-801b-4d031787634d\") " pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:44:37.955111 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.955005    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d59b88ec-7e33-41d4-801b-4d031787634d-workload-certs\") pod \"e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg\" (UID: \"d59b88ec-7e33-41d4-801b-4d031787634d\") " pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:44:37.955170 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.955113    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d59b88ec-7e33-41d4-801b-4d031787634d-credential-socket\") pod \"e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg\" (UID: \"d59b88ec-7e33-41d4-801b-4d031787634d\") " pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:44:37.955269 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.955246    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d59b88ec-7e33-41d4-801b-4d031787634d-istio-data\") pod \"e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg\" (UID: \"d59b88ec-7e33-41d4-801b-4d031787634d\") " pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:44:37.955338 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.955260    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d59b88ec-7e33-41d4-801b-4d031787634d-workload-socket\") pod \"e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg\" (UID: \"d59b88ec-7e33-41d4-801b-4d031787634d\") " pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:44:37.955495 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.955475    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d59b88ec-7e33-41d4-801b-4d031787634d-istiod-ca-cert\") pod \"e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg\" (UID: \"d59b88ec-7e33-41d4-801b-4d031787634d\") " pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:44:37.957428 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.957402    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d59b88ec-7e33-41d4-801b-4d031787634d-istio-podinfo\") pod \"e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg\" (UID: \"d59b88ec-7e33-41d4-801b-4d031787634d\") " pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:44:37.957566 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.957548    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d59b88ec-7e33-41d4-801b-4d031787634d-istio-envoy\") pod \"e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg\" (UID: \"d59b88ec-7e33-41d4-801b-4d031787634d\") " pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:44:37.964106 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.964082    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d59b88ec-7e33-41d4-801b-4d031787634d-istio-token\") pod \"e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg\" (UID: \"d59b88ec-7e33-41d4-801b-4d031787634d\") " pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:44:37.964339 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:37.964315    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf7sq\" (UniqueName: \"kubernetes.io/projected/d59b88ec-7e33-41d4-801b-4d031787634d-kube-api-access-gf7sq\") pod \"e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg\" (UID: \"d59b88ec-7e33-41d4-801b-4d031787634d\") " pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:44:38.073217 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:38.073117    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:44:38.350536 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:38.350504    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"]
Sep 05 06:44:38.351739 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:44:38.351704    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd59b88ec_7e33_41d4_801b_4d031787634d.slice/crio-3414cd466067e6c0581a4bc67ca551bdbc2bf127a82e50606b088362dda10fee WatchSource:0}: Error finding container 3414cd466067e6c0581a4bc67ca551bdbc2bf127a82e50606b088362dda10fee: Status 404 returned error can't find the container with id 3414cd466067e6c0581a4bc67ca551bdbc2bf127a82e50606b088362dda10fee
Sep 05 06:44:38.354128 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:38.354086    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:44:38.354205 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:38.354177    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:44:38.354244 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:38.354219    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:44:39.126284 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:39.126245    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg" event={"ID":"d59b88ec-7e33-41d4-801b-4d031787634d","Type":"ContainerStarted","Data":"80c9bbd3ae32e9953ca7ba1dda67ee71e1d06439728a9acd0287cb323efc47b0"}
Sep 05 06:44:39.126694 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:39.126301    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg" event={"ID":"d59b88ec-7e33-41d4-801b-4d031787634d","Type":"ContainerStarted","Data":"3414cd466067e6c0581a4bc67ca551bdbc2bf127a82e50606b088362dda10fee"}
Sep 05 06:44:39.152051 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:39.151980    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg" podStartSLOduration=2.151962531 podStartE2EDuration="2.151962531s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:44:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:44:39.149862169 +0000 UTC m=+1145.123616844" watchObservedRunningTime="2026-09-05 06:44:39.151962531 +0000 UTC m=+1145.125717206"
Sep 05 06:44:40.073548 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:40.073505    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:44:40.078756 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:40.078731    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:44:40.132090 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:40.132062    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:44:40.133075 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:40.133058    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:44:42.104212 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.104186    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:44:42.143604 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.143511    2567 generic.go:356] "Generic (PLEG): container finished" podID="d52ee6af-272e-46cb-9b7b-f7160fdcc0c9" containerID="7464664f4d676af24c80a997352f199860633a87d5d315179abd6b25a75e18ef" exitCode=0
Sep 05 06:44:42.143604 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.143584    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"
Sep 05 06:44:42.143843 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.143623    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22" event={"ID":"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9","Type":"ContainerDied","Data":"7464664f4d676af24c80a997352f199860633a87d5d315179abd6b25a75e18ef"}
Sep 05 06:44:42.143843 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.143681    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22" event={"ID":"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9","Type":"ContainerDied","Data":"411c1302735adc67cbaa5c94f1580633a3becf480638ef0747f7c23ad85a3270"}
Sep 05 06:44:42.143843 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.143706    2567 scope.go:117] "RemoveContainer" containerID="7464664f4d676af24c80a997352f199860633a87d5d315179abd6b25a75e18ef"
Sep 05 06:44:42.153659 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.153640    2567 scope.go:117] "RemoveContainer" containerID="4f2effc90675dd66ed4fa22e0b9a1328d0c0b3d435fe7aa457e5175e2d6b2838"
Sep 05 06:44:42.163679 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.163656    2567 scope.go:117] "RemoveContainer" containerID="7464664f4d676af24c80a997352f199860633a87d5d315179abd6b25a75e18ef"
Sep 05 06:44:42.164055 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:44:42.164017    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7464664f4d676af24c80a997352f199860633a87d5d315179abd6b25a75e18ef\": container with ID starting with 7464664f4d676af24c80a997352f199860633a87d5d315179abd6b25a75e18ef not found: ID does not exist" containerID="7464664f4d676af24c80a997352f199860633a87d5d315179abd6b25a75e18ef"
Sep 05 06:44:42.164132 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.164064    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7464664f4d676af24c80a997352f199860633a87d5d315179abd6b25a75e18ef"} err="failed to get container status \"7464664f4d676af24c80a997352f199860633a87d5d315179abd6b25a75e18ef\": rpc error: code = NotFound desc = could not find container \"7464664f4d676af24c80a997352f199860633a87d5d315179abd6b25a75e18ef\": container with ID starting with 7464664f4d676af24c80a997352f199860633a87d5d315179abd6b25a75e18ef not found: ID does not exist"
Sep 05 06:44:42.164132 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.164084    2567 scope.go:117] "RemoveContainer" containerID="4f2effc90675dd66ed4fa22e0b9a1328d0c0b3d435fe7aa457e5175e2d6b2838"
Sep 05 06:44:42.164369 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:44:42.164352    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f2effc90675dd66ed4fa22e0b9a1328d0c0b3d435fe7aa457e5175e2d6b2838\": container with ID starting with 4f2effc90675dd66ed4fa22e0b9a1328d0c0b3d435fe7aa457e5175e2d6b2838 not found: ID does not exist" containerID="4f2effc90675dd66ed4fa22e0b9a1328d0c0b3d435fe7aa457e5175e2d6b2838"
Sep 05 06:44:42.164414 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.164377    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f2effc90675dd66ed4fa22e0b9a1328d0c0b3d435fe7aa457e5175e2d6b2838"} err="failed to get container status \"4f2effc90675dd66ed4fa22e0b9a1328d0c0b3d435fe7aa457e5175e2d6b2838\": rpc error: code = NotFound desc = could not find container \"4f2effc90675dd66ed4fa22e0b9a1328d0c0b3d435fe7aa457e5175e2d6b2838\": container with ID starting with 4f2effc90675dd66ed4fa22e0b9a1328d0c0b3d435fe7aa457e5175e2d6b2838 not found: ID does not exist"
Sep 05 06:44:42.201119 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.201090    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-istio-envoy\") pod \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\" (UID: \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\") "
Sep 05 06:44:42.201307 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.201139    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-credential-socket\") pod \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\" (UID: \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\") "
Sep 05 06:44:42.201307 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.201158    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-istio-data\") pod \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\" (UID: \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\") "
Sep 05 06:44:42.201307 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.201184    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-istio-token\") pod \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\" (UID: \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\") "
Sep 05 06:44:42.201307 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.201208    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-workload-certs\") pod \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\" (UID: \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\") "
Sep 05 06:44:42.201307 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.201227    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrmt9\" (UniqueName: \"kubernetes.io/projected/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-kube-api-access-wrmt9\") pod \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\" (UID: \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\") "
Sep 05 06:44:42.201307 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.201269    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-istiod-ca-cert\") pod \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\" (UID: \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\") "
Sep 05 06:44:42.201699 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.201316    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-istio-podinfo\") pod \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\" (UID: \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\") "
Sep 05 06:44:42.201699 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.201366    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-workload-socket\") pod \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\" (UID: \"d52ee6af-272e-46cb-9b7b-f7160fdcc0c9\") "
Sep 05 06:44:42.201699 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.201389    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d52ee6af-272e-46cb-9b7b-f7160fdcc0c9" (UID: "d52ee6af-272e-46cb-9b7b-f7160fdcc0c9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:44:42.201699 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.201613    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-istio-data" (OuterVolumeSpecName: "istio-data") pod "d52ee6af-272e-46cb-9b7b-f7160fdcc0c9" (UID: "d52ee6af-272e-46cb-9b7b-f7160fdcc0c9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:44:42.201699 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.201673    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d52ee6af-272e-46cb-9b7b-f7160fdcc0c9" (UID: "d52ee6af-272e-46cb-9b7b-f7160fdcc0c9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:44:42.201977 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.201774    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-credential-socket\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:44:42.201977 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.201802    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-istio-data\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:44:42.201977 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.201818    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-workload-certs\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:44:42.201977 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.201774    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d52ee6af-272e-46cb-9b7b-f7160fdcc0c9" (UID: "d52ee6af-272e-46cb-9b7b-f7160fdcc0c9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:44:42.201977 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.201939    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d52ee6af-272e-46cb-9b7b-f7160fdcc0c9" (UID: "d52ee6af-272e-46cb-9b7b-f7160fdcc0c9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:44:42.203808 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.203783    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-istio-token" (OuterVolumeSpecName: "istio-token") pod "d52ee6af-272e-46cb-9b7b-f7160fdcc0c9" (UID: "d52ee6af-272e-46cb-9b7b-f7160fdcc0c9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:44:42.203946 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.203815    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d52ee6af-272e-46cb-9b7b-f7160fdcc0c9" (UID: "d52ee6af-272e-46cb-9b7b-f7160fdcc0c9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 05 06:44:42.203946 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.203833    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-kube-api-access-wrmt9" (OuterVolumeSpecName: "kube-api-access-wrmt9") pod "d52ee6af-272e-46cb-9b7b-f7160fdcc0c9" (UID: "d52ee6af-272e-46cb-9b7b-f7160fdcc0c9"). InnerVolumeSpecName "kube-api-access-wrmt9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:44:42.204127 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.204071    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d52ee6af-272e-46cb-9b7b-f7160fdcc0c9" (UID: "d52ee6af-272e-46cb-9b7b-f7160fdcc0c9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:44:42.302334 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.302298    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-istio-envoy\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:44:42.302334 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.302330    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-istio-token\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:44:42.302596 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.302346    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrmt9\" (UniqueName: \"kubernetes.io/projected/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-kube-api-access-wrmt9\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:44:42.302596 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.302357    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-istiod-ca-cert\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:44:42.302596 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.302369    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-istio-podinfo\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:44:42.302596 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.302379    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9-workload-socket\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:44:42.469331 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.469293    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"]
Sep 05 06:44:42.474776 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.474750    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22"]
Sep 05 06:44:42.580976 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.580938    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d52ee6af-272e-46cb-9b7b-f7160fdcc0c9" path="/var/lib/kubelet/pods/d52ee6af-272e-46cb-9b7b-f7160fdcc0c9/volumes"
Sep 05 06:44:42.951560 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.951530    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth"]
Sep 05 06:44:42.951896 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.951885    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d52ee6af-272e-46cb-9b7b-f7160fdcc0c9" containerName="istio-proxy"
Sep 05 06:44:42.951942 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.951898    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d52ee6af-272e-46cb-9b7b-f7160fdcc0c9" containerName="istio-proxy"
Sep 05 06:44:42.951942 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.951911    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5034f8c0-a2dc-42cd-8691-d4dd18f38604" containerName="istio-proxy"
Sep 05 06:44:42.951942 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.951917    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5034f8c0-a2dc-42cd-8691-d4dd18f38604" containerName="istio-proxy"
Sep 05 06:44:42.952073 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.951985    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d52ee6af-272e-46cb-9b7b-f7160fdcc0c9" containerName="istio-proxy"
Sep 05 06:44:42.956468 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.956447    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth"
Sep 05 06:44:42.959210 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.959191    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-ef54fd\""
Sep 05 06:44:42.967707 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:42.967682    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth"]
Sep 05 06:44:43.009914 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:43.009880    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmslg\" (UniqueName: \"kubernetes.io/projected/aa3b6f9f-631d-4967-9209-adbd0c127225-kube-api-access-zmslg\") pod \"payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth\" (UID: \"aa3b6f9f-631d-4967-9209-adbd0c127225\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth"
Sep 05 06:44:43.009914 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:43.009925    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa3b6f9f-631d-4967-9209-adbd0c127225-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth\" (UID: \"aa3b6f9f-631d-4967-9209-adbd0c127225\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth"
Sep 05 06:44:43.110841 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:43.110802    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmslg\" (UniqueName: \"kubernetes.io/projected/aa3b6f9f-631d-4967-9209-adbd0c127225-kube-api-access-zmslg\") pod \"payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth\" (UID: \"aa3b6f9f-631d-4967-9209-adbd0c127225\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth"
Sep 05 06:44:43.111302 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:43.110852    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa3b6f9f-631d-4967-9209-adbd0c127225-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth\" (UID: \"aa3b6f9f-631d-4967-9209-adbd0c127225\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth"
Sep 05 06:44:43.111638 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:43.111610    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa3b6f9f-631d-4967-9209-adbd0c127225-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth\" (UID: \"aa3b6f9f-631d-4967-9209-adbd0c127225\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth"
Sep 05 06:44:43.119871 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:43.119849    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmslg\" (UniqueName: \"kubernetes.io/projected/aa3b6f9f-631d-4967-9209-adbd0c127225-kube-api-access-zmslg\") pod \"payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth\" (UID: \"aa3b6f9f-631d-4967-9209-adbd0c127225\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth"
Sep 05 06:44:43.268228 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:43.268143    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth"
Sep 05 06:44:43.541742 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:43.541715    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth"]
Sep 05 06:44:43.544010 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:44:43.543980    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa3b6f9f_631d_4967_9209_adbd0c127225.slice/crio-aa13ef0e23628261a56e86c07b25bddc27440940dbb75324bffc44a26d715c05 WatchSource:0}: Error finding container aa13ef0e23628261a56e86c07b25bddc27440940dbb75324bffc44a26d715c05: Status 404 returned error can't find the container with id aa13ef0e23628261a56e86c07b25bddc27440940dbb75324bffc44a26d715c05
Sep 05 06:44:44.158859 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:44.158821    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth" event={"ID":"aa3b6f9f-631d-4967-9209-adbd0c127225","Type":"ContainerStarted","Data":"b97d20aad0846d3820f0d24cffa3df5bcacdded8da29fccd8b73b265648e9e72"}
Sep 05 06:44:44.159379 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:44.158885    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth" event={"ID":"aa3b6f9f-631d-4967-9209-adbd0c127225","Type":"ContainerStarted","Data":"aa13ef0e23628261a56e86c07b25bddc27440940dbb75324bffc44a26d715c05"}
Sep 05 06:44:44.159379 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:44.159001    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth"
Sep 05 06:44:44.180078 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:44.180010    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth" podStartSLOduration=2.179993335 podStartE2EDuration="2.179993335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:44:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:44:44.178876425 +0000 UTC m=+1150.152631102" watchObservedRunningTime="2026-09-05 06:44:44.179993335 +0000 UTC m=+1150.153748010"
Sep 05 06:44:49.219076 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.219043    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"]
Sep 05 06:44:49.219551 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.219423    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d52ee6af-272e-46cb-9b7b-f7160fdcc0c9" containerName="istio-proxy"
Sep 05 06:44:49.219551 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.219436    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d52ee6af-272e-46cb-9b7b-f7160fdcc0c9" containerName="istio-proxy"
Sep 05 06:44:49.219551 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.219488    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d52ee6af-272e-46cb-9b7b-f7160fdcc0c9" containerName="istio-proxy"
Sep 05 06:44:49.222586 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.222568    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:44:49.225291 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.225270    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-01e18c68-openshift-default-dockercfg-f624m\""
Sep 05 06:44:49.248050 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.242354    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"]
Sep 05 06:44:49.378617 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.378573    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51f3ac52-dff8-4f19-a940-9d0bf62d665a-istio-data\") pod \"e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2\" (UID: \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\") " pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:44:49.378617 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.378624    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51f3ac52-dff8-4f19-a940-9d0bf62d665a-istio-token\") pod \"e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2\" (UID: \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\") " pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:44:49.378885 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.378698    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51f3ac52-dff8-4f19-a940-9d0bf62d665a-istio-podinfo\") pod \"e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2\" (UID: \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\") " pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:44:49.378885 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.378766    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51f3ac52-dff8-4f19-a940-9d0bf62d665a-istio-envoy\") pod \"e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2\" (UID: \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\") " pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:44:49.378885 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.378789    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51f3ac52-dff8-4f19-a940-9d0bf62d665a-credential-socket\") pod \"e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2\" (UID: \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\") " pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:44:49.378885 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.378830    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51f3ac52-dff8-4f19-a940-9d0bf62d665a-workload-socket\") pod \"e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2\" (UID: \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\") " pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:44:49.378885 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.378853    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51f3ac52-dff8-4f19-a940-9d0bf62d665a-workload-certs\") pod \"e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2\" (UID: \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\") " pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:44:49.379111 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.378901    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51f3ac52-dff8-4f19-a940-9d0bf62d665a-istiod-ca-cert\") pod \"e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2\" (UID: \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\") " pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:44:49.379111 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.378925    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfhww\" (UniqueName: \"kubernetes.io/projected/51f3ac52-dff8-4f19-a940-9d0bf62d665a-kube-api-access-rfhww\") pod \"e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2\" (UID: \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\") " pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:44:49.479753 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.479660    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51f3ac52-dff8-4f19-a940-9d0bf62d665a-istiod-ca-cert\") pod \"e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2\" (UID: \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\") " pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:44:49.479753 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.479704    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfhww\" (UniqueName: \"kubernetes.io/projected/51f3ac52-dff8-4f19-a940-9d0bf62d665a-kube-api-access-rfhww\") pod \"e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2\" (UID: \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\") " pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:44:49.479753 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.479744    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51f3ac52-dff8-4f19-a940-9d0bf62d665a-istio-data\") pod \"e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2\" (UID: \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\") " pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:44:49.480085 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.479783    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51f3ac52-dff8-4f19-a940-9d0bf62d665a-istio-token\") pod \"e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2\" (UID: \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\") " pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:44:49.480085 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.479815    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51f3ac52-dff8-4f19-a940-9d0bf62d665a-istio-podinfo\") pod \"e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2\" (UID: \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\") " pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:44:49.480085 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.479868    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51f3ac52-dff8-4f19-a940-9d0bf62d665a-istio-envoy\") pod \"e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2\" (UID: \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\") " pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:44:49.480085 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.479896    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51f3ac52-dff8-4f19-a940-9d0bf62d665a-credential-socket\") pod \"e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2\" (UID: \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\") " pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:44:49.480085 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.479939    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51f3ac52-dff8-4f19-a940-9d0bf62d665a-workload-socket\") pod \"e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2\" (UID: \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\") " pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:44:49.480085 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.479978    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51f3ac52-dff8-4f19-a940-9d0bf62d665a-workload-certs\") pod \"e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2\" (UID: \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\") " pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:44:49.480410 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.480299    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51f3ac52-dff8-4f19-a940-9d0bf62d665a-credential-socket\") pod \"e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2\" (UID: \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\") " pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:44:49.480410 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.480357    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51f3ac52-dff8-4f19-a940-9d0bf62d665a-workload-certs\") pod \"e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2\" (UID: \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\") " pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:44:49.480410 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.480372    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51f3ac52-dff8-4f19-a940-9d0bf62d665a-workload-socket\") pod \"e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2\" (UID: \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\") " pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:44:49.480540 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.480446    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51f3ac52-dff8-4f19-a940-9d0bf62d665a-istio-data\") pod \"e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2\" (UID: \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\") " pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:44:49.480578 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.480542    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51f3ac52-dff8-4f19-a940-9d0bf62d665a-istiod-ca-cert\") pod \"e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2\" (UID: \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\") " pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:44:49.482367 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.482342    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51f3ac52-dff8-4f19-a940-9d0bf62d665a-istio-envoy\") pod \"e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2\" (UID: \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\") " pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:44:49.482596 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.482572    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51f3ac52-dff8-4f19-a940-9d0bf62d665a-istio-podinfo\") pod \"e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2\" (UID: \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\") " pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:44:49.491690 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.491658    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfhww\" (UniqueName: \"kubernetes.io/projected/51f3ac52-dff8-4f19-a940-9d0bf62d665a-kube-api-access-rfhww\") pod \"e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2\" (UID: \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\") " pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:44:49.491898 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.491878    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51f3ac52-dff8-4f19-a940-9d0bf62d665a-istio-token\") pod \"e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2\" (UID: \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\") " pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:44:49.543832 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.543787    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:44:49.829520 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.829425    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"]
Sep 05 06:44:49.850182 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.850130    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:44:49.850324 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.850235    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:44:49.850324 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:49.850278    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:44:50.192658 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:50.192561    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2" event={"ID":"51f3ac52-dff8-4f19-a940-9d0bf62d665a","Type":"ContainerStarted","Data":"58ba0eb0e2a7ad2ddae7e74faa02d29b4cdef79d3acbad121d902975684da419"}
Sep 05 06:44:50.192658 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:50.192624    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2" event={"ID":"51f3ac52-dff8-4f19-a940-9d0bf62d665a","Type":"ContainerStarted","Data":"8361b31c5c380c900824c993c9cfe64696c6f42674f151ec8d4ef1797b1541f0"}
Sep 05 06:44:50.215462 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:50.215413    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2" podStartSLOduration=1.215395802 podStartE2EDuration="1.215395802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:44:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:44:50.214043241 +0000 UTC m=+1156.187797917" watchObservedRunningTime="2026-09-05 06:44:50.215395802 +0000 UTC m=+1156.189150476"
Sep 05 06:44:50.547348 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:50.547304    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:44:50.555124 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:50.555087    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:44:51.198495 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:51.198462    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:44:51.199770 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:51.199750    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:44:54.294711 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:54.294674    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv"]
Sep 05 06:44:54.298492 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:54.298473    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv"
Sep 05 06:44:54.301158 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:54.301135    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-01e18c68\""
Sep 05 06:44:54.301273 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:54.301171    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-01e18c68-dockercfg-khnk2\""
Sep 05 06:44:54.309586 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:54.309560    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv"]
Sep 05 06:44:54.431634 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:54.431596    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4g5f\" (UniqueName: \"kubernetes.io/projected/fbfff294-7c5f-48b6-92db-ce15292c4e83-kube-api-access-n4g5f\") pod \"payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv\" (UID: \"fbfff294-7c5f-48b6-92db-ce15292c4e83\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv"
Sep 05 06:44:54.431816 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:54.431714    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fbfff294-7c5f-48b6-92db-ce15292c4e83-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv\" (UID: \"fbfff294-7c5f-48b6-92db-ce15292c4e83\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv"
Sep 05 06:44:54.533175 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:54.533134    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fbfff294-7c5f-48b6-92db-ce15292c4e83-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv\" (UID: \"fbfff294-7c5f-48b6-92db-ce15292c4e83\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv"
Sep 05 06:44:54.533355 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:54.533253    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4g5f\" (UniqueName: \"kubernetes.io/projected/fbfff294-7c5f-48b6-92db-ce15292c4e83-kube-api-access-n4g5f\") pod \"payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv\" (UID: \"fbfff294-7c5f-48b6-92db-ce15292c4e83\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv"
Sep 05 06:44:54.533947 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:54.533927    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fbfff294-7c5f-48b6-92db-ce15292c4e83-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv\" (UID: \"fbfff294-7c5f-48b6-92db-ce15292c4e83\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv"
Sep 05 06:44:54.541930 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:54.541900    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4g5f\" (UniqueName: \"kubernetes.io/projected/fbfff294-7c5f-48b6-92db-ce15292c4e83-kube-api-access-n4g5f\") pod \"payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv\" (UID: \"fbfff294-7c5f-48b6-92db-ce15292c4e83\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv"
Sep 05 06:44:54.610130 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:54.610018    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv"
Sep 05 06:44:54.884875 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:54.884852    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv"]
Sep 05 06:44:54.886637 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:44:54.886607    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbfff294_7c5f_48b6_92db_ce15292c4e83.slice/crio-f66a9e64afd695b2948ddf1bd4573b4f01b4db08e6b3434b354666803fddfbf3 WatchSource:0}: Error finding container f66a9e64afd695b2948ddf1bd4573b4f01b4db08e6b3434b354666803fddfbf3: Status 404 returned error can't find the container with id f66a9e64afd695b2948ddf1bd4573b4f01b4db08e6b3434b354666803fddfbf3
Sep 05 06:44:55.167001 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:55.166974    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth"
Sep 05 06:44:55.228237 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:55.228197    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv" event={"ID":"fbfff294-7c5f-48b6-92db-ce15292c4e83","Type":"ContainerStarted","Data":"8e14f3f279656b39f87ecab1cd5ecfa3467c989648b8b51e5e22653738bd9bac"}
Sep 05 06:44:55.228425 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:55.228265    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv" event={"ID":"fbfff294-7c5f-48b6-92db-ce15292c4e83","Type":"ContainerStarted","Data":"f66a9e64afd695b2948ddf1bd4573b4f01b4db08e6b3434b354666803fddfbf3"}
Sep 05 06:44:55.228425 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:55.228397    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv"
Sep 05 06:44:55.245631 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:55.245417    2567 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": read tcp 10.134.0.2:45350->10.134.0.55:15021: read: connection reset by peer" start-of-body=
Sep 05 06:44:55.245631 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:55.245474    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg" podUID="d59b88ec-7e33-41d4-801b-4d031787634d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": read tcp 10.134.0.2:45350->10.134.0.55:15021: read: connection reset by peer"
Sep 05 06:44:55.246973 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:55.246929    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv" podStartSLOduration=1.246914503 podStartE2EDuration="1.246914503s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:44:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:44:55.245344204 +0000 UTC m=+1161.219098880" watchObservedRunningTime="2026-09-05 06:44:55.246914503 +0000 UTC m=+1161.220669177"
Sep 05 06:44:56.236597 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:56.236562    2567 generic.go:356] "Generic (PLEG): container finished" podID="d59b88ec-7e33-41d4-801b-4d031787634d" containerID="80c9bbd3ae32e9953ca7ba1dda67ee71e1d06439728a9acd0287cb323efc47b0" exitCode=0
Sep 05 06:44:56.237121 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:56.236634    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg" event={"ID":"d59b88ec-7e33-41d4-801b-4d031787634d","Type":"ContainerDied","Data":"80c9bbd3ae32e9953ca7ba1dda67ee71e1d06439728a9acd0287cb323efc47b0"}
Sep 05 06:44:56.237121 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:56.237091    2567 scope.go:117] "RemoveContainer" containerID="80c9bbd3ae32e9953ca7ba1dda67ee71e1d06439728a9acd0287cb323efc47b0"
Sep 05 06:44:56.238136 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:56.238107    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:44:56.238210 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:56.238177    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:44:56.238264 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:56.238214    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:44:57.250008 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:57.249954    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg" event={"ID":"d59b88ec-7e33-41d4-801b-4d031787634d","Type":"ContainerStarted","Data":"9a4babed4bb946a91c7ef45a2b6d2f22c58be2745b03833f947ac6c08bb757f0"}
Sep 05 06:44:58.074293 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:58.074243    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:44:58.074514 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:58.074461    2567 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 05 06:44:58.074578 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:58.074509    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg" podUID="d59b88ec-7e33-41d4-801b-4d031787634d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 05 06:44:59.074080 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:59.074017    2567 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 05 06:44:59.074491 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:44:59.074101    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg" podUID="d59b88ec-7e33-41d4-801b-4d031787634d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 05 06:45:00.074157 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:00.074101    2567 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 05 06:45:00.074707 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:00.074179    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg" podUID="d59b88ec-7e33-41d4-801b-4d031787634d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 05 06:45:00.141076 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:00.141005    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ef54fd-29809845-dkk6q"]
Sep 05 06:45:00.144270 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:00.144237    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ef54fd-29809845-dkk6q"
Sep 05 06:45:00.147056 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:00.147002    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tlgjj\""
Sep 05 06:45:00.158018 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:00.157982    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ef54fd-29809845-dkk6q"]
Sep 05 06:45:00.162784 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:00.162753    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ef54fd-29809845-dkk6q"
Sep 05 06:45:00.496354 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:00.496326    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ef54fd-29809845-dkk6q"]
Sep 05 06:45:00.497899 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:45:00.497874    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9edc8826_8a38_4dcd_9553_6d19dac175fa.slice/crio-c20c739d9b2c00a1731b257725bf733aa3d9e8e5b3db8a345c08b1ed141b0757 WatchSource:0}: Error finding container c20c739d9b2c00a1731b257725bf733aa3d9e8e5b3db8a345c08b1ed141b0757: Status 404 returned error can't find the container with id c20c739d9b2c00a1731b257725bf733aa3d9e8e5b3db8a345c08b1ed141b0757
Sep 05 06:45:01.074077 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:01.073946    2567 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 05 06:45:01.074280 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:01.074110    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg" podUID="d59b88ec-7e33-41d4-801b-4d031787634d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 05 06:45:01.281866 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:01.281824    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ef54fd-29809845-dkk6q" event={"ID":"9edc8826-8a38-4dcd-9553-6d19dac175fa","Type":"ContainerStarted","Data":"0bcd1cb3578c77c2019e77497822c918a5ded34c62f0459971d07330c8f0cf72"}
Sep 05 06:45:01.282073 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:01.281887    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ef54fd-29809845-dkk6q" event={"ID":"9edc8826-8a38-4dcd-9553-6d19dac175fa","Type":"ContainerStarted","Data":"c20c739d9b2c00a1731b257725bf733aa3d9e8e5b3db8a345c08b1ed141b0757"}
Sep 05 06:45:01.300585 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:01.300532    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ef54fd-29809845-dkk6q" podStartSLOduration=1.300515627 podStartE2EDuration="1.300515627s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:45:01.299127714 +0000 UTC m=+1167.272882391" watchObservedRunningTime="2026-09-05 06:45:01.300515627 +0000 UTC m=+1167.274270301"
Sep 05 06:45:02.073944 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:02.073892    2567 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 05 06:45:02.074198 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:02.073968    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg" podUID="d59b88ec-7e33-41d4-801b-4d031787634d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 05 06:45:02.289259 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:02.289175    2567 generic.go:356] "Generic (PLEG): container finished" podID="9edc8826-8a38-4dcd-9553-6d19dac175fa" containerID="0bcd1cb3578c77c2019e77497822c918a5ded34c62f0459971d07330c8f0cf72" exitCode=0
Sep 05 06:45:02.289693 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:02.289675    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ef54fd-29809845-dkk6q" event={"ID":"9edc8826-8a38-4dcd-9553-6d19dac175fa","Type":"ContainerDied","Data":"0bcd1cb3578c77c2019e77497822c918a5ded34c62f0459971d07330c8f0cf72"}
Sep 05 06:45:03.077646 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:03.077610    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:45:03.077953 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:03.077925    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:45:03.078600 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:03.078584    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:45:03.464948 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:03.464923    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ef54fd-29809845-dkk6q"
Sep 05 06:45:04.302063 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:04.302015    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ef54fd-29809845-dkk6q"
Sep 05 06:45:04.302272 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:04.302069    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ef54fd-29809845-dkk6q" event={"ID":"9edc8826-8a38-4dcd-9553-6d19dac175fa","Type":"ContainerDied","Data":"c20c739d9b2c00a1731b257725bf733aa3d9e8e5b3db8a345c08b1ed141b0757"}
Sep 05 06:45:04.302272 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:04.302118    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c20c739d9b2c00a1731b257725bf733aa3d9e8e5b3db8a345c08b1ed141b0757"
Sep 05 06:45:06.239088 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:06.239052    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv"
Sep 05 06:45:07.239213 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:07.239170    2567 patch_prober.go:28] interesting pod/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 05 06:45:07.239632 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:07.239230    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2" podUID="51f3ac52-dff8-4f19-a940-9d0bf62d665a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 05 06:45:08.021020 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:45:08.017427    2567 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51f3ac52_dff8_4f19_a940_9d0bf62d665a.slice/crio-conmon-58ba0eb0e2a7ad2ddae7e74faa02d29b4cdef79d3acbad121d902975684da419.scope\": RecentStats: unable to find data in memory cache], [\"/system.slice/system-systemd\\\\x2dcoredump.slice/systemd-coredump@8-19253-0.service\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51f3ac52_dff8_4f19_a940_9d0bf62d665a.slice/crio-58ba0eb0e2a7ad2ddae7e74faa02d29b4cdef79d3acbad121d902975684da419.scope\": RecentStats: unable to find data in memory cache]"
Sep 05 06:45:08.325372 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:08.325285    2567 generic.go:356] "Generic (PLEG): container finished" podID="51f3ac52-dff8-4f19-a940-9d0bf62d665a" containerID="58ba0eb0e2a7ad2ddae7e74faa02d29b4cdef79d3acbad121d902975684da419" exitCode=0
Sep 05 06:45:08.325770 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:08.325363    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2" event={"ID":"51f3ac52-dff8-4f19-a940-9d0bf62d665a","Type":"ContainerDied","Data":"58ba0eb0e2a7ad2ddae7e74faa02d29b4cdef79d3acbad121d902975684da419"}
Sep 05 06:45:08.325828 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:08.325819    2567 scope.go:117] "RemoveContainer" containerID="58ba0eb0e2a7ad2ddae7e74faa02d29b4cdef79d3acbad121d902975684da419"
Sep 05 06:45:08.327077 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:08.327047    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:45:08.327151 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:08.327132    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:45:08.327193 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:08.327168    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:45:09.336283 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:09.336239    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2" event={"ID":"51f3ac52-dff8-4f19-a940-9d0bf62d665a","Type":"ContainerStarted","Data":"300d3685f043effd2c4e00e068ebbd669ea37b5a13bd185dc97350f04e2d7529"}
Sep 05 06:45:09.544278 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:09.544222    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:45:09.544586 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:09.544556    2567 patch_prober.go:28] interesting pod/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 05 06:45:09.544668 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:09.544626    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2" podUID="51f3ac52-dff8-4f19-a940-9d0bf62d665a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 05 06:45:10.544548 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:10.544496    2567 patch_prober.go:28] interesting pod/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 05 06:45:10.545096 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:10.544573    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2" podUID="51f3ac52-dff8-4f19-a940-9d0bf62d665a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 05 06:45:11.547103 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:11.545555    2567 patch_prober.go:28] interesting pod/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 05 06:45:11.547103 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:11.545638    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2" podUID="51f3ac52-dff8-4f19-a940-9d0bf62d665a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 05 06:45:12.173264 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:12.173222    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb"]
Sep 05 06:45:12.173722 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:12.173701    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9edc8826-8a38-4dcd-9553-6d19dac175fa" containerName="cleanup"
Sep 05 06:45:12.173830 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:12.173724    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9edc8826-8a38-4dcd-9553-6d19dac175fa" containerName="cleanup"
Sep 05 06:45:12.173830 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:12.173817    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9edc8826-8a38-4dcd-9553-6d19dac175fa" containerName="cleanup"
Sep 05 06:45:12.175965 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:12.175941    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb"
Sep 05 06:45:12.178605 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:12.178577    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-5b1d24\""
Sep 05 06:45:12.178796 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:12.178782    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-5b1d24-dockercfg-z656v\""
Sep 05 06:45:12.187219 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:12.187198    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb"]
Sep 05 06:45:12.189365 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:12.189339    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp"]
Sep 05 06:45:12.191594 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:12.191575    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp"
Sep 05 06:45:12.201179 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:12.201157    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp"]
Sep 05 06:45:12.246054 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:12.245572    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7f04b4a-e437-4db1-8784-2ea00175252b-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp\" (UID: \"a7f04b4a-e437-4db1-8784-2ea00175252b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp"
Sep 05 06:45:12.246054 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:12.245656    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wbtt\" (UniqueName: \"kubernetes.io/projected/a7f04b4a-e437-4db1-8784-2ea00175252b-kube-api-access-6wbtt\") pod \"payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp\" (UID: \"a7f04b4a-e437-4db1-8784-2ea00175252b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp"
Sep 05 06:45:12.246054 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:12.245715    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rbgl\" (UniqueName: \"kubernetes.io/projected/b39b60f3-0390-461b-97c2-d2370151b96d-kube-api-access-6rbgl\") pod \"payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb\" (UID: \"b39b60f3-0390-461b-97c2-d2370151b96d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb"
Sep 05 06:45:12.246054 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:12.245830    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b39b60f3-0390-461b-97c2-d2370151b96d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb\" (UID: \"b39b60f3-0390-461b-97c2-d2370151b96d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb"
Sep 05 06:45:12.346627 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:12.346581    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7f04b4a-e437-4db1-8784-2ea00175252b-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp\" (UID: \"a7f04b4a-e437-4db1-8784-2ea00175252b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp"
Sep 05 06:45:12.347851 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:12.347763    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7f04b4a-e437-4db1-8784-2ea00175252b-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp\" (UID: \"a7f04b4a-e437-4db1-8784-2ea00175252b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp"
Sep 05 06:45:12.348428 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:12.348053    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wbtt\" (UniqueName: \"kubernetes.io/projected/a7f04b4a-e437-4db1-8784-2ea00175252b-kube-api-access-6wbtt\") pod \"payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp\" (UID: \"a7f04b4a-e437-4db1-8784-2ea00175252b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp"
Sep 05 06:45:12.348642 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:12.348621    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rbgl\" (UniqueName: \"kubernetes.io/projected/b39b60f3-0390-461b-97c2-d2370151b96d-kube-api-access-6rbgl\") pod \"payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb\" (UID: \"b39b60f3-0390-461b-97c2-d2370151b96d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb"
Sep 05 06:45:12.349156 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:12.349137    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b39b60f3-0390-461b-97c2-d2370151b96d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb\" (UID: \"b39b60f3-0390-461b-97c2-d2370151b96d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb"
Sep 05 06:45:12.352208 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:12.350086    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b39b60f3-0390-461b-97c2-d2370151b96d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb\" (UID: \"b39b60f3-0390-461b-97c2-d2370151b96d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb"
Sep 05 06:45:12.362911 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:12.362883    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rbgl\" (UniqueName: \"kubernetes.io/projected/b39b60f3-0390-461b-97c2-d2370151b96d-kube-api-access-6rbgl\") pod \"payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb\" (UID: \"b39b60f3-0390-461b-97c2-d2370151b96d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb"
Sep 05 06:45:12.363357 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:12.363336    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wbtt\" (UniqueName: \"kubernetes.io/projected/a7f04b4a-e437-4db1-8784-2ea00175252b-kube-api-access-6wbtt\") pod \"payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp\" (UID: \"a7f04b4a-e437-4db1-8784-2ea00175252b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp"
Sep 05 06:45:12.490541 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:12.490496    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb"
Sep 05 06:45:12.503609 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:12.503584    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp"
Sep 05 06:45:12.547966 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:12.547485    2567 patch_prober.go:28] interesting pod/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 05 06:45:12.547966 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:12.547551    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2" podUID="51f3ac52-dff8-4f19-a940-9d0bf62d665a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 05 06:45:12.793042 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:12.792995    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb"]
Sep 05 06:45:12.794409 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:45:12.794381    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb39b60f3_0390_461b_97c2_d2370151b96d.slice/crio-7fa91efa84195b2350844687b039c0f071d7822d4359d9e72f530d5318fe03b2 WatchSource:0}: Error finding container 7fa91efa84195b2350844687b039c0f071d7822d4359d9e72f530d5318fe03b2: Status 404 returned error can't find the container with id 7fa91efa84195b2350844687b039c0f071d7822d4359d9e72f530d5318fe03b2
Sep 05 06:45:12.806401 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:12.806379    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp"]
Sep 05 06:45:12.808653 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:45:12.808625    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7f04b4a_e437_4db1_8784_2ea00175252b.slice/crio-830c6fe80e9bf52fa55f462050fef27ebe7f5feca631b1de75bfb060a1845d11 WatchSource:0}: Error finding container 830c6fe80e9bf52fa55f462050fef27ebe7f5feca631b1de75bfb060a1845d11: Status 404 returned error can't find the container with id 830c6fe80e9bf52fa55f462050fef27ebe7f5feca631b1de75bfb060a1845d11
Sep 05 06:45:13.373306 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:13.373271    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp" event={"ID":"a7f04b4a-e437-4db1-8784-2ea00175252b","Type":"ContainerStarted","Data":"1eabeb0b00a915000ee986198e80091ca4ccd97c9f3a1f49a0017f4eedc68c35"}
Sep 05 06:45:13.373585 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:13.373561    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp" event={"ID":"a7f04b4a-e437-4db1-8784-2ea00175252b","Type":"ContainerStarted","Data":"830c6fe80e9bf52fa55f462050fef27ebe7f5feca631b1de75bfb060a1845d11"}
Sep 05 06:45:13.373757 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:13.373718    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp"
Sep 05 06:45:13.375273 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:13.375249    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb" event={"ID":"b39b60f3-0390-461b-97c2-d2370151b96d","Type":"ContainerStarted","Data":"79960363023c4775abac463d3a96cf233682b04ae5aaa96b9c82dac8308304e8"}
Sep 05 06:45:13.375386 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:13.375286    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb" event={"ID":"b39b60f3-0390-461b-97c2-d2370151b96d","Type":"ContainerStarted","Data":"7fa91efa84195b2350844687b039c0f071d7822d4359d9e72f530d5318fe03b2"}
Sep 05 06:45:13.375386 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:13.375317    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb"
Sep 05 06:45:13.392427 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:13.392367    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp" podStartSLOduration=1.392346692 podStartE2EDuration="1.392346692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:45:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:45:13.390294801 +0000 UTC m=+1179.364049479" watchObservedRunningTime="2026-09-05 06:45:13.392346692 +0000 UTC m=+1179.366101368"
Sep 05 06:45:13.408194 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:13.408141    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb" podStartSLOduration=1.40812498 podStartE2EDuration="1.40812498s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:45:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:45:13.406393599 +0000 UTC m=+1179.380148279" watchObservedRunningTime="2026-09-05 06:45:13.40812498 +0000 UTC m=+1179.381879677"
Sep 05 06:45:13.545494 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:13.545453    2567 patch_prober.go:28] interesting pod/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 05 06:45:13.545869 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:13.545828    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2" podUID="51f3ac52-dff8-4f19-a940-9d0bf62d665a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 05 06:45:14.565287 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:14.565250    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:45:14.565802 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:14.565540    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:45:14.566518 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:14.566493    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:45:24.385455 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:24.385422    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp"
Sep 05 06:45:24.385920 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:24.385579    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb"
Sep 05 06:45:34.552517 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:34.552493    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bb4_7f8a8f16-2422-4c01-a619-1f17fe10cd4c/ovn-acl-logging/0.log"
Sep 05 06:45:34.553852 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:34.553832    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bb4_7f8a8f16-2422-4c01-a619-1f17fe10cd4c/ovn-acl-logging/0.log"
Sep 05 06:45:35.733789 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:35.733754    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv"]
Sep 05 06:45:35.734356 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:35.733994    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv" podUID="fbfff294-7c5f-48b6-92db-ce15292c4e83" containerName="payload-pre-processing" containerID="cri-o://8e14f3f279656b39f87ecab1cd5ecfa3467c989648b8b51e5e22653738bd9bac" gracePeriod=30
Sep 05 06:45:35.998418 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:35.998349    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv"
Sep 05 06:45:36.078755 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:36.078722    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fbfff294-7c5f-48b6-92db-ce15292c4e83-plugins-config-volume\") pod \"fbfff294-7c5f-48b6-92db-ce15292c4e83\" (UID: \"fbfff294-7c5f-48b6-92db-ce15292c4e83\") "
Sep 05 06:45:36.078967 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:36.078837    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4g5f\" (UniqueName: \"kubernetes.io/projected/fbfff294-7c5f-48b6-92db-ce15292c4e83-kube-api-access-n4g5f\") pod \"fbfff294-7c5f-48b6-92db-ce15292c4e83\" (UID: \"fbfff294-7c5f-48b6-92db-ce15292c4e83\") "
Sep 05 06:45:36.079248 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:36.079219    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbfff294-7c5f-48b6-92db-ce15292c4e83-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fbfff294-7c5f-48b6-92db-ce15292c4e83" (UID: "fbfff294-7c5f-48b6-92db-ce15292c4e83"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:45:36.081851 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:36.081809    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbfff294-7c5f-48b6-92db-ce15292c4e83-kube-api-access-n4g5f" (OuterVolumeSpecName: "kube-api-access-n4g5f") pod "fbfff294-7c5f-48b6-92db-ce15292c4e83" (UID: "fbfff294-7c5f-48b6-92db-ce15292c4e83"). InnerVolumeSpecName "kube-api-access-n4g5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:45:36.180648 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:36.180605    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fbfff294-7c5f-48b6-92db-ce15292c4e83-plugins-config-volume\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:45:36.180648 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:36.180643    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4g5f\" (UniqueName: \"kubernetes.io/projected/fbfff294-7c5f-48b6-92db-ce15292c4e83-kube-api-access-n4g5f\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:45:36.510858 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:36.510817    2567 generic.go:356] "Generic (PLEG): container finished" podID="fbfff294-7c5f-48b6-92db-ce15292c4e83" containerID="8e14f3f279656b39f87ecab1cd5ecfa3467c989648b8b51e5e22653738bd9bac" exitCode=0
Sep 05 06:45:36.511077 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:36.510865    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv"
Sep 05 06:45:36.511077 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:36.510898    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv" event={"ID":"fbfff294-7c5f-48b6-92db-ce15292c4e83","Type":"ContainerDied","Data":"8e14f3f279656b39f87ecab1cd5ecfa3467c989648b8b51e5e22653738bd9bac"}
Sep 05 06:45:36.511077 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:36.510954    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv" event={"ID":"fbfff294-7c5f-48b6-92db-ce15292c4e83","Type":"ContainerDied","Data":"f66a9e64afd695b2948ddf1bd4573b4f01b4db08e6b3434b354666803fddfbf3"}
Sep 05 06:45:36.511077 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:36.510978    2567 scope.go:117] "RemoveContainer" containerID="8e14f3f279656b39f87ecab1cd5ecfa3467c989648b8b51e5e22653738bd9bac"
Sep 05 06:45:36.520180 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:36.520164    2567 scope.go:117] "RemoveContainer" containerID="8e14f3f279656b39f87ecab1cd5ecfa3467c989648b8b51e5e22653738bd9bac"
Sep 05 06:45:36.520452 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:45:36.520429    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e14f3f279656b39f87ecab1cd5ecfa3467c989648b8b51e5e22653738bd9bac\": container with ID starting with 8e14f3f279656b39f87ecab1cd5ecfa3467c989648b8b51e5e22653738bd9bac not found: ID does not exist" containerID="8e14f3f279656b39f87ecab1cd5ecfa3467c989648b8b51e5e22653738bd9bac"
Sep 05 06:45:36.520544 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:36.520454    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e14f3f279656b39f87ecab1cd5ecfa3467c989648b8b51e5e22653738bd9bac"} err="failed to get container status \"8e14f3f279656b39f87ecab1cd5ecfa3467c989648b8b51e5e22653738bd9bac\": rpc error: code = NotFound desc = could not find container \"8e14f3f279656b39f87ecab1cd5ecfa3467c989648b8b51e5e22653738bd9bac\": container with ID starting with 8e14f3f279656b39f87ecab1cd5ecfa3467c989648b8b51e5e22653738bd9bac not found: ID does not exist"
Sep 05 06:45:36.540607 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:36.534528    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv"]
Sep 05 06:45:36.540607 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:36.539992    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv"]
Sep 05 06:45:36.580907 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:36.580870    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbfff294-7c5f-48b6-92db-ce15292c4e83" path="/var/lib/kubelet/pods/fbfff294-7c5f-48b6-92db-ce15292c4e83/volumes"
Sep 05 06:45:42.534766 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:42.534732    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"]
Sep 05 06:45:42.535306 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:42.534992    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2" podUID="51f3ac52-dff8-4f19-a940-9d0bf62d665a" containerName="istio-proxy" containerID="cri-o://300d3685f043effd2c4e00e068ebbd669ea37b5a13bd185dc97350f04e2d7529" gracePeriod=30
Sep 05 06:45:44.568396 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:44.568358    2567 patch_prober.go:28] interesting pod/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 05 06:45:44.568837 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:44.568435    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2" podUID="51f3ac52-dff8-4f19-a940-9d0bf62d665a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 05 06:45:47.783083 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:47.783061    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:45:47.897178 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:47.897105    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51f3ac52-dff8-4f19-a940-9d0bf62d665a-workload-socket\") pod \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\" (UID: \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\") "
Sep 05 06:45:47.897178 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:47.897139    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51f3ac52-dff8-4f19-a940-9d0bf62d665a-istio-podinfo\") pod \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\" (UID: \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\") "
Sep 05 06:45:47.897178 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:47.897169    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51f3ac52-dff8-4f19-a940-9d0bf62d665a-istiod-ca-cert\") pod \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\" (UID: \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\") "
Sep 05 06:45:47.897430 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:47.897206    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51f3ac52-dff8-4f19-a940-9d0bf62d665a-istio-envoy\") pod \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\" (UID: \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\") "
Sep 05 06:45:47.897430 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:47.897221    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51f3ac52-dff8-4f19-a940-9d0bf62d665a-credential-socket\") pod \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\" (UID: \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\") "
Sep 05 06:45:47.897430 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:47.897251    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51f3ac52-dff8-4f19-a940-9d0bf62d665a-istio-data\") pod \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\" (UID: \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\") "
Sep 05 06:45:47.897430 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:47.897270    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfhww\" (UniqueName: \"kubernetes.io/projected/51f3ac52-dff8-4f19-a940-9d0bf62d665a-kube-api-access-rfhww\") pod \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\" (UID: \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\") "
Sep 05 06:45:47.897430 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:47.897313    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51f3ac52-dff8-4f19-a940-9d0bf62d665a-istio-token\") pod \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\" (UID: \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\") "
Sep 05 06:45:47.897430 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:47.897350    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51f3ac52-dff8-4f19-a940-9d0bf62d665a-workload-certs\") pod \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\" (UID: \"51f3ac52-dff8-4f19-a940-9d0bf62d665a\") "
Sep 05 06:45:47.897430 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:47.897399    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51f3ac52-dff8-4f19-a940-9d0bf62d665a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "51f3ac52-dff8-4f19-a940-9d0bf62d665a" (UID: "51f3ac52-dff8-4f19-a940-9d0bf62d665a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:45:47.897759 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:47.897544    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51f3ac52-dff8-4f19-a940-9d0bf62d665a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "51f3ac52-dff8-4f19-a940-9d0bf62d665a" (UID: "51f3ac52-dff8-4f19-a940-9d0bf62d665a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:45:47.897759 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:47.897590    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51f3ac52-dff8-4f19-a940-9d0bf62d665a-istio-data" (OuterVolumeSpecName: "istio-data") pod "51f3ac52-dff8-4f19-a940-9d0bf62d665a" (UID: "51f3ac52-dff8-4f19-a940-9d0bf62d665a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:45:47.897759 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:47.897748    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51f3ac52-dff8-4f19-a940-9d0bf62d665a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "51f3ac52-dff8-4f19-a940-9d0bf62d665a" (UID: "51f3ac52-dff8-4f19-a940-9d0bf62d665a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:45:47.897759 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:47.897756    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51f3ac52-dff8-4f19-a940-9d0bf62d665a-credential-socket\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:45:47.897928 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:47.897774    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51f3ac52-dff8-4f19-a940-9d0bf62d665a-istio-data\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:45:47.897928 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:47.897787    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51f3ac52-dff8-4f19-a940-9d0bf62d665a-workload-socket\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:45:47.898216 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:47.898191    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51f3ac52-dff8-4f19-a940-9d0bf62d665a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "51f3ac52-dff8-4f19-a940-9d0bf62d665a" (UID: "51f3ac52-dff8-4f19-a940-9d0bf62d665a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:45:47.899651 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:47.899626    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51f3ac52-dff8-4f19-a940-9d0bf62d665a-kube-api-access-rfhww" (OuterVolumeSpecName: "kube-api-access-rfhww") pod "51f3ac52-dff8-4f19-a940-9d0bf62d665a" (UID: "51f3ac52-dff8-4f19-a940-9d0bf62d665a"). InnerVolumeSpecName "kube-api-access-rfhww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:45:47.899651 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:47.899636    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/51f3ac52-dff8-4f19-a940-9d0bf62d665a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "51f3ac52-dff8-4f19-a940-9d0bf62d665a" (UID: "51f3ac52-dff8-4f19-a940-9d0bf62d665a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 05 06:45:47.899803 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:47.899613    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51f3ac52-dff8-4f19-a940-9d0bf62d665a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "51f3ac52-dff8-4f19-a940-9d0bf62d665a" (UID: "51f3ac52-dff8-4f19-a940-9d0bf62d665a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:45:47.899959 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:47.899943    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51f3ac52-dff8-4f19-a940-9d0bf62d665a-istio-token" (OuterVolumeSpecName: "istio-token") pod "51f3ac52-dff8-4f19-a940-9d0bf62d665a" (UID: "51f3ac52-dff8-4f19-a940-9d0bf62d665a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:45:47.998798 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:47.998772    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51f3ac52-dff8-4f19-a940-9d0bf62d665a-istio-token\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:45:47.998798 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:47.998794    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51f3ac52-dff8-4f19-a940-9d0bf62d665a-workload-certs\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:45:47.998928 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:47.998804    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51f3ac52-dff8-4f19-a940-9d0bf62d665a-istio-podinfo\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:45:47.998928 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:47.998811    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51f3ac52-dff8-4f19-a940-9d0bf62d665a-istiod-ca-cert\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:45:47.998928 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:47.998820    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51f3ac52-dff8-4f19-a940-9d0bf62d665a-istio-envoy\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:45:47.998928 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:47.998827    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfhww\" (UniqueName: \"kubernetes.io/projected/51f3ac52-dff8-4f19-a940-9d0bf62d665a-kube-api-access-rfhww\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:45:48.600834 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:48.600804    2567 generic.go:356] "Generic (PLEG): container finished" podID="51f3ac52-dff8-4f19-a940-9d0bf62d665a" containerID="300d3685f043effd2c4e00e068ebbd669ea37b5a13bd185dc97350f04e2d7529" exitCode=0
Sep 05 06:45:48.600959 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:48.600857    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"
Sep 05 06:45:48.600959 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:48.600887    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2" event={"ID":"51f3ac52-dff8-4f19-a940-9d0bf62d665a","Type":"ContainerDied","Data":"300d3685f043effd2c4e00e068ebbd669ea37b5a13bd185dc97350f04e2d7529"}
Sep 05 06:45:48.600959 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:48.600943    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2" event={"ID":"51f3ac52-dff8-4f19-a940-9d0bf62d665a","Type":"ContainerDied","Data":"8361b31c5c380c900824c993c9cfe64696c6f42674f151ec8d4ef1797b1541f0"}
Sep 05 06:45:48.601090 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:48.600965    2567 scope.go:117] "RemoveContainer" containerID="300d3685f043effd2c4e00e068ebbd669ea37b5a13bd185dc97350f04e2d7529"
Sep 05 06:45:48.610182 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:48.610159    2567 scope.go:117] "RemoveContainer" containerID="58ba0eb0e2a7ad2ddae7e74faa02d29b4cdef79d3acbad121d902975684da419"
Sep 05 06:45:48.618394 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:48.618377    2567 scope.go:117] "RemoveContainer" containerID="300d3685f043effd2c4e00e068ebbd669ea37b5a13bd185dc97350f04e2d7529"
Sep 05 06:45:48.618745 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:45:48.618715    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"300d3685f043effd2c4e00e068ebbd669ea37b5a13bd185dc97350f04e2d7529\": container with ID starting with 300d3685f043effd2c4e00e068ebbd669ea37b5a13bd185dc97350f04e2d7529 not found: ID does not exist" containerID="300d3685f043effd2c4e00e068ebbd669ea37b5a13bd185dc97350f04e2d7529"
Sep 05 06:45:48.618889 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:48.618755    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"300d3685f043effd2c4e00e068ebbd669ea37b5a13bd185dc97350f04e2d7529"} err="failed to get container status \"300d3685f043effd2c4e00e068ebbd669ea37b5a13bd185dc97350f04e2d7529\": rpc error: code = NotFound desc = could not find container \"300d3685f043effd2c4e00e068ebbd669ea37b5a13bd185dc97350f04e2d7529\": container with ID starting with 300d3685f043effd2c4e00e068ebbd669ea37b5a13bd185dc97350f04e2d7529 not found: ID does not exist"
Sep 05 06:45:48.618889 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:48.618780    2567 scope.go:117] "RemoveContainer" containerID="58ba0eb0e2a7ad2ddae7e74faa02d29b4cdef79d3acbad121d902975684da419"
Sep 05 06:45:48.619191 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:45:48.619166    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58ba0eb0e2a7ad2ddae7e74faa02d29b4cdef79d3acbad121d902975684da419\": container with ID starting with 58ba0eb0e2a7ad2ddae7e74faa02d29b4cdef79d3acbad121d902975684da419 not found: ID does not exist" containerID="58ba0eb0e2a7ad2ddae7e74faa02d29b4cdef79d3acbad121d902975684da419"
Sep 05 06:45:48.619293 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:48.619200    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58ba0eb0e2a7ad2ddae7e74faa02d29b4cdef79d3acbad121d902975684da419"} err="failed to get container status \"58ba0eb0e2a7ad2ddae7e74faa02d29b4cdef79d3acbad121d902975684da419\": rpc error: code = NotFound desc = could not find container \"58ba0eb0e2a7ad2ddae7e74faa02d29b4cdef79d3acbad121d902975684da419\": container with ID starting with 58ba0eb0e2a7ad2ddae7e74faa02d29b4cdef79d3acbad121d902975684da419 not found: ID does not exist"
Sep 05 06:45:48.621260 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:48.621239    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"]
Sep 05 06:45:48.627231 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:48.627209    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2"]
Sep 05 06:45:50.580849 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:50.580816    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51f3ac52-dff8-4f19-a940-9d0bf62d665a" path="/var/lib/kubelet/pods/51f3ac52-dff8-4f19-a940-9d0bf62d665a/volumes"
Sep 05 06:45:57.860368 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.860325    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"]
Sep 05 06:45:57.860860 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.860718    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbfff294-7c5f-48b6-92db-ce15292c4e83" containerName="payload-pre-processing"
Sep 05 06:45:57.860860 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.860730    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbfff294-7c5f-48b6-92db-ce15292c4e83" containerName="payload-pre-processing"
Sep 05 06:45:57.860860 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.860741    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51f3ac52-dff8-4f19-a940-9d0bf62d665a" containerName="istio-proxy"
Sep 05 06:45:57.860860 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.860749    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="51f3ac52-dff8-4f19-a940-9d0bf62d665a" containerName="istio-proxy"
Sep 05 06:45:57.860860 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.860772    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51f3ac52-dff8-4f19-a940-9d0bf62d665a" containerName="istio-proxy"
Sep 05 06:45:57.860860 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.860778    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="51f3ac52-dff8-4f19-a940-9d0bf62d665a" containerName="istio-proxy"
Sep 05 06:45:57.860860 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.860846    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="51f3ac52-dff8-4f19-a940-9d0bf62d665a" containerName="istio-proxy"
Sep 05 06:45:57.860860 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.860854    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbfff294-7c5f-48b6-92db-ce15292c4e83" containerName="payload-pre-processing"
Sep 05 06:45:57.860860 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.860860    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="51f3ac52-dff8-4f19-a940-9d0bf62d665a" containerName="istio-proxy"
Sep 05 06:45:57.863749 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.863728    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:45:57.866430 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.866412    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-eac764-openshift-default-dockercfg-cp7fb\""
Sep 05 06:45:57.876234 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.876211    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"]
Sep 05 06:45:57.877478 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.877332    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46aaab82-0224-49e8-863a-bd51488416cf-istio-envoy\") pod \"e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd\" (UID: \"46aaab82-0224-49e8-863a-bd51488416cf\") " pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:45:57.877478 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.877385    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46aaab82-0224-49e8-863a-bd51488416cf-credential-socket\") pod \"e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd\" (UID: \"46aaab82-0224-49e8-863a-bd51488416cf\") " pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:45:57.877478 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.877461    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46aaab82-0224-49e8-863a-bd51488416cf-istio-token\") pod \"e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd\" (UID: \"46aaab82-0224-49e8-863a-bd51488416cf\") " pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:45:57.877727 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.877488    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s2fj\" (UniqueName: \"kubernetes.io/projected/46aaab82-0224-49e8-863a-bd51488416cf-kube-api-access-9s2fj\") pod \"e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd\" (UID: \"46aaab82-0224-49e8-863a-bd51488416cf\") " pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:45:57.877727 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.877567    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46aaab82-0224-49e8-863a-bd51488416cf-workload-socket\") pod \"e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd\" (UID: \"46aaab82-0224-49e8-863a-bd51488416cf\") " pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:45:57.877727 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.877656    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46aaab82-0224-49e8-863a-bd51488416cf-workload-certs\") pod \"e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd\" (UID: \"46aaab82-0224-49e8-863a-bd51488416cf\") " pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:45:57.877727 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.877692    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46aaab82-0224-49e8-863a-bd51488416cf-istio-data\") pod \"e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd\" (UID: \"46aaab82-0224-49e8-863a-bd51488416cf\") " pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:45:57.877727 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.877718    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46aaab82-0224-49e8-863a-bd51488416cf-istio-podinfo\") pod \"e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd\" (UID: \"46aaab82-0224-49e8-863a-bd51488416cf\") " pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:45:57.877967 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.877788    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46aaab82-0224-49e8-863a-bd51488416cf-istiod-ca-cert\") pod \"e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd\" (UID: \"46aaab82-0224-49e8-863a-bd51488416cf\") " pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:45:57.978439 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.978404    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46aaab82-0224-49e8-863a-bd51488416cf-istio-data\") pod \"e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd\" (UID: \"46aaab82-0224-49e8-863a-bd51488416cf\") " pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:45:57.978439 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.978443    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46aaab82-0224-49e8-863a-bd51488416cf-istio-podinfo\") pod \"e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd\" (UID: \"46aaab82-0224-49e8-863a-bd51488416cf\") " pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:45:57.978710 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.978466    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46aaab82-0224-49e8-863a-bd51488416cf-istiod-ca-cert\") pod \"e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd\" (UID: \"46aaab82-0224-49e8-863a-bd51488416cf\") " pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:45:57.978710 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.978512    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46aaab82-0224-49e8-863a-bd51488416cf-istio-envoy\") pod \"e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd\" (UID: \"46aaab82-0224-49e8-863a-bd51488416cf\") " pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:45:57.978710 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.978547    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46aaab82-0224-49e8-863a-bd51488416cf-credential-socket\") pod \"e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd\" (UID: \"46aaab82-0224-49e8-863a-bd51488416cf\") " pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:45:57.978710 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.978638    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46aaab82-0224-49e8-863a-bd51488416cf-istio-token\") pod \"e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd\" (UID: \"46aaab82-0224-49e8-863a-bd51488416cf\") " pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:45:57.979203 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.978980    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46aaab82-0224-49e8-863a-bd51488416cf-credential-socket\") pod \"e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd\" (UID: \"46aaab82-0224-49e8-863a-bd51488416cf\") " pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:45:57.979203 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.979007    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s2fj\" (UniqueName: \"kubernetes.io/projected/46aaab82-0224-49e8-863a-bd51488416cf-kube-api-access-9s2fj\") pod \"e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd\" (UID: \"46aaab82-0224-49e8-863a-bd51488416cf\") " pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:45:57.979203 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.979085    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46aaab82-0224-49e8-863a-bd51488416cf-workload-socket\") pod \"e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd\" (UID: \"46aaab82-0224-49e8-863a-bd51488416cf\") " pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:45:57.979203 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.979144    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46aaab82-0224-49e8-863a-bd51488416cf-istio-data\") pod \"e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd\" (UID: \"46aaab82-0224-49e8-863a-bd51488416cf\") " pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:45:57.979505 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.979423    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46aaab82-0224-49e8-863a-bd51488416cf-workload-socket\") pod \"e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd\" (UID: \"46aaab82-0224-49e8-863a-bd51488416cf\") " pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:45:57.979565 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.979507    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46aaab82-0224-49e8-863a-bd51488416cf-workload-certs\") pod \"e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd\" (UID: \"46aaab82-0224-49e8-863a-bd51488416cf\") " pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:45:57.979837 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.979818    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46aaab82-0224-49e8-863a-bd51488416cf-workload-certs\") pod \"e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd\" (UID: \"46aaab82-0224-49e8-863a-bd51488416cf\") " pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:45:57.979915 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.979838    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46aaab82-0224-49e8-863a-bd51488416cf-istiod-ca-cert\") pod \"e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd\" (UID: \"46aaab82-0224-49e8-863a-bd51488416cf\") " pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:45:57.981692 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.981657    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46aaab82-0224-49e8-863a-bd51488416cf-istio-envoy\") pod \"e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd\" (UID: \"46aaab82-0224-49e8-863a-bd51488416cf\") " pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:45:57.981873 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.981854    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46aaab82-0224-49e8-863a-bd51488416cf-istio-podinfo\") pod \"e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd\" (UID: \"46aaab82-0224-49e8-863a-bd51488416cf\") " pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:45:57.989009 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.988988    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46aaab82-0224-49e8-863a-bd51488416cf-istio-token\") pod \"e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd\" (UID: \"46aaab82-0224-49e8-863a-bd51488416cf\") " pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:45:57.989405 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:57.989357    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s2fj\" (UniqueName: \"kubernetes.io/projected/46aaab82-0224-49e8-863a-bd51488416cf-kube-api-access-9s2fj\") pod \"e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd\" (UID: \"46aaab82-0224-49e8-863a-bd51488416cf\") " pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:45:58.174175 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:58.174095    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:45:58.464542 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:58.464515    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"]
Sep 05 06:45:58.465215 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:45:58.465192    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46aaab82_0224_49e8_863a_bd51488416cf.slice/crio-aa46c49be93f51a4e9c0c0aa0a782bcd1c093b2d8015493adba0839a3175c593 WatchSource:0}: Error finding container aa46c49be93f51a4e9c0c0aa0a782bcd1c093b2d8015493adba0839a3175c593: Status 404 returned error can't find the container with id aa46c49be93f51a4e9c0c0aa0a782bcd1c093b2d8015493adba0839a3175c593
Sep 05 06:45:58.467866 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:58.467831    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:45:58.467943 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:58.467895    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:45:58.467943 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:58.467935    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:45:58.653352 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:58.653316    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd" event={"ID":"46aaab82-0224-49e8-863a-bd51488416cf","Type":"ContainerStarted","Data":"9a91306e82f6411c131999d72d57d32b70acf1f00473ea0d142338f0a9cedad5"}
Sep 05 06:45:58.653506 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:58.653375    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd" event={"ID":"46aaab82-0224-49e8-863a-bd51488416cf","Type":"ContainerStarted","Data":"aa46c49be93f51a4e9c0c0aa0a782bcd1c093b2d8015493adba0839a3175c593"}
Sep 05 06:45:58.674983 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:58.674930    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd" podStartSLOduration=1.6749141889999999 podStartE2EDuration="1.674914189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:45:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:45:58.673787168 +0000 UTC m=+1224.647541844" watchObservedRunningTime="2026-09-05 06:45:58.674914189 +0000 UTC m=+1224.648668865"
Sep 05 06:45:59.175357 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:59.175324    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:45:59.180923 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:59.180892    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:45:59.659198 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:59.659069    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:45:59.660185 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:45:59.660168    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:46:02.571243 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:02.571205    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh"]
Sep 05 06:46:02.574938 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:02.574917    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh"
Sep 05 06:46:02.577792 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:02.577759    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-eac764\""
Sep 05 06:46:02.577931 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:02.577863    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-eac764-dockercfg-n8r7d\""
Sep 05 06:46:02.587813 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:02.587786    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh"]
Sep 05 06:46:02.624131 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:02.624098    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6949f799-fe1a-4171-8c05-4bd4c1e4d654-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh\" (UID: \"6949f799-fe1a-4171-8c05-4bd4c1e4d654\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh"
Sep 05 06:46:02.624291 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:02.624209    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfzkk\" (UniqueName: \"kubernetes.io/projected/6949f799-fe1a-4171-8c05-4bd4c1e4d654-kube-api-access-gfzkk\") pod \"payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh\" (UID: \"6949f799-fe1a-4171-8c05-4bd4c1e4d654\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh"
Sep 05 06:46:02.725465 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:02.725423    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6949f799-fe1a-4171-8c05-4bd4c1e4d654-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh\" (UID: \"6949f799-fe1a-4171-8c05-4bd4c1e4d654\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh"
Sep 05 06:46:02.725465 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:02.725463    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfzkk\" (UniqueName: \"kubernetes.io/projected/6949f799-fe1a-4171-8c05-4bd4c1e4d654-kube-api-access-gfzkk\") pod \"payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh\" (UID: \"6949f799-fe1a-4171-8c05-4bd4c1e4d654\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh"
Sep 05 06:46:02.726251 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:02.726226    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6949f799-fe1a-4171-8c05-4bd4c1e4d654-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh\" (UID: \"6949f799-fe1a-4171-8c05-4bd4c1e4d654\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh"
Sep 05 06:46:02.735757 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:02.735724    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfzkk\" (UniqueName: \"kubernetes.io/projected/6949f799-fe1a-4171-8c05-4bd4c1e4d654-kube-api-access-gfzkk\") pod \"payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh\" (UID: \"6949f799-fe1a-4171-8c05-4bd4c1e4d654\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh"
Sep 05 06:46:02.886567 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:02.886477    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh"
Sep 05 06:46:03.179501 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:03.179471    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh"]
Sep 05 06:46:03.181460 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:46:03.181435    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6949f799_fe1a_4171_8c05_4bd4c1e4d654.slice/crio-86f084bf94310f75f5898c418c1c9d7bb87ce949a46cc2e5f5c33ae4c0a96cf2 WatchSource:0}: Error finding container 86f084bf94310f75f5898c418c1c9d7bb87ce949a46cc2e5f5c33ae4c0a96cf2: Status 404 returned error can't find the container with id 86f084bf94310f75f5898c418c1c9d7bb87ce949a46cc2e5f5c33ae4c0a96cf2
Sep 05 06:46:03.688710 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:03.688666    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh" event={"ID":"6949f799-fe1a-4171-8c05-4bd4c1e4d654","Type":"ContainerStarted","Data":"af99f5f6efdf0107942b75e264106468a65c349b49f5f77430e8913fef310485"}
Sep 05 06:46:03.689199 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:03.688770    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh" event={"ID":"6949f799-fe1a-4171-8c05-4bd4c1e4d654","Type":"ContainerStarted","Data":"86f084bf94310f75f5898c418c1c9d7bb87ce949a46cc2e5f5c33ae4c0a96cf2"}
Sep 05 06:46:03.689199 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:03.688801    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh"
Sep 05 06:46:03.710730 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:03.710672    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh" podStartSLOduration=1.710651133 podStartE2EDuration="1.710651133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:46:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:46:03.707210914 +0000 UTC m=+1229.680965588" watchObservedRunningTime="2026-09-05 06:46:03.710651133 +0000 UTC m=+1229.684405814"
Sep 05 06:46:14.695913 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:14.695823    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh"
Sep 05 06:46:15.701234 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:15.701188    2567 patch_prober.go:28] interesting pod/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 05 06:46:15.701625 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:15.701264    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd" podUID="46aaab82-0224-49e8-863a-bd51488416cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 05 06:46:17.773934 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:17.773901    2567 generic.go:356] "Generic (PLEG): container finished" podID="46aaab82-0224-49e8-863a-bd51488416cf" containerID="9a91306e82f6411c131999d72d57d32b70acf1f00473ea0d142338f0a9cedad5" exitCode=0
Sep 05 06:46:17.774376 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:17.773962    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd" event={"ID":"46aaab82-0224-49e8-863a-bd51488416cf","Type":"ContainerDied","Data":"9a91306e82f6411c131999d72d57d32b70acf1f00473ea0d142338f0a9cedad5"}
Sep 05 06:46:17.774376 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:17.774355    2567 scope.go:117] "RemoveContainer" containerID="9a91306e82f6411c131999d72d57d32b70acf1f00473ea0d142338f0a9cedad5"
Sep 05 06:46:17.775407 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:17.775369    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:46:17.775473 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:17.775460    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:46:17.775512 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:17.775492    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:46:18.781675 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:18.781645    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd" event={"ID":"46aaab82-0224-49e8-863a-bd51488416cf","Type":"ContainerStarted","Data":"45139d0c9498d46f554a416833e90c51d4bb1e1ad485f573e44e205b29bb1f6d"}
Sep 05 06:46:19.174810 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:19.174720    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:46:19.174967 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:19.174934    2567 patch_prober.go:28] interesting pod/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 05 06:46:19.175009 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:19.174980    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd" podUID="46aaab82-0224-49e8-863a-bd51488416cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 05 06:46:20.175256 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:20.175223    2567 patch_prober.go:28] interesting pod/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 05 06:46:20.175651 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:20.175277    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd" podUID="46aaab82-0224-49e8-863a-bd51488416cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 05 06:46:21.174854 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:21.174818    2567 patch_prober.go:28] interesting pod/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 05 06:46:21.175017 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:21.174870    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd" podUID="46aaab82-0224-49e8-863a-bd51488416cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 05 06:46:22.175304 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:22.175257    2567 patch_prober.go:28] interesting pod/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 05 06:46:22.175786 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:22.175324    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd" podUID="46aaab82-0224-49e8-863a-bd51488416cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 05 06:46:23.174612 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:23.174574    2567 patch_prober.go:28] interesting pod/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 05 06:46:23.174820 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:23.174634    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd" podUID="46aaab82-0224-49e8-863a-bd51488416cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 05 06:46:24.178268 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:24.178239    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:46:24.178633 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:24.178578    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:46:24.179188 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:24.179167    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:46:26.375679 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:26.375601    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"]
Sep 05 06:46:26.378143 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:26.378125    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:46:26.380923 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:26.380904    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-32e859-openshift-default-dockercfg-snhn8\""
Sep 05 06:46:26.398917 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:26.398890    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"]
Sep 05 06:46:26.448798 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:26.448767    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04f1c5e9-cec3-42e8-b025-1498acfa621c-workload-certs\") pod \"e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9\" (UID: \"04f1c5e9-cec3-42e8-b025-1498acfa621c\") " pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:46:26.448957 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:26.448809    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04f1c5e9-cec3-42e8-b025-1498acfa621c-istio-data\") pod \"e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9\" (UID: \"04f1c5e9-cec3-42e8-b025-1498acfa621c\") " pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:46:26.448957 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:26.448831    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwkhp\" (UniqueName: \"kubernetes.io/projected/04f1c5e9-cec3-42e8-b025-1498acfa621c-kube-api-access-pwkhp\") pod \"e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9\" (UID: \"04f1c5e9-cec3-42e8-b025-1498acfa621c\") " pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:46:26.448957 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:26.448858    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04f1c5e9-cec3-42e8-b025-1498acfa621c-istio-token\") pod \"e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9\" (UID: \"04f1c5e9-cec3-42e8-b025-1498acfa621c\") " pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:46:26.448957 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:26.448885    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04f1c5e9-cec3-42e8-b025-1498acfa621c-istio-podinfo\") pod \"e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9\" (UID: \"04f1c5e9-cec3-42e8-b025-1498acfa621c\") " pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:46:26.448957 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:26.448908    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04f1c5e9-cec3-42e8-b025-1498acfa621c-workload-socket\") pod \"e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9\" (UID: \"04f1c5e9-cec3-42e8-b025-1498acfa621c\") " pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:46:26.449158 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:26.449001    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04f1c5e9-cec3-42e8-b025-1498acfa621c-istio-envoy\") pod \"e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9\" (UID: \"04f1c5e9-cec3-42e8-b025-1498acfa621c\") " pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:46:26.449158 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:26.449109    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04f1c5e9-cec3-42e8-b025-1498acfa621c-istiod-ca-cert\") pod \"e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9\" (UID: \"04f1c5e9-cec3-42e8-b025-1498acfa621c\") " pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:46:26.449158 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:26.449139    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04f1c5e9-cec3-42e8-b025-1498acfa621c-credential-socket\") pod \"e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9\" (UID: \"04f1c5e9-cec3-42e8-b025-1498acfa621c\") " pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:46:26.549977 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:26.549941    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwkhp\" (UniqueName: \"kubernetes.io/projected/04f1c5e9-cec3-42e8-b025-1498acfa621c-kube-api-access-pwkhp\") pod \"e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9\" (UID: \"04f1c5e9-cec3-42e8-b025-1498acfa621c\") " pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:46:26.549977 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:26.549977    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04f1c5e9-cec3-42e8-b025-1498acfa621c-istio-token\") pod \"e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9\" (UID: \"04f1c5e9-cec3-42e8-b025-1498acfa621c\") " pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:46:26.550204 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:26.549994    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04f1c5e9-cec3-42e8-b025-1498acfa621c-istio-podinfo\") pod \"e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9\" (UID: \"04f1c5e9-cec3-42e8-b025-1498acfa621c\") " pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:46:26.550204 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:26.550169    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04f1c5e9-cec3-42e8-b025-1498acfa621c-workload-socket\") pod \"e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9\" (UID: \"04f1c5e9-cec3-42e8-b025-1498acfa621c\") " pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:46:26.550283 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:26.550266    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04f1c5e9-cec3-42e8-b025-1498acfa621c-istio-envoy\") pod \"e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9\" (UID: \"04f1c5e9-cec3-42e8-b025-1498acfa621c\") " pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:46:26.550368 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:26.550355    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04f1c5e9-cec3-42e8-b025-1498acfa621c-istiod-ca-cert\") pod \"e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9\" (UID: \"04f1c5e9-cec3-42e8-b025-1498acfa621c\") " pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:46:26.550407 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:26.550391    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04f1c5e9-cec3-42e8-b025-1498acfa621c-credential-socket\") pod \"e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9\" (UID: \"04f1c5e9-cec3-42e8-b025-1498acfa621c\") " pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:46:26.550441 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:26.550421    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04f1c5e9-cec3-42e8-b025-1498acfa621c-workload-certs\") pod \"e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9\" (UID: \"04f1c5e9-cec3-42e8-b025-1498acfa621c\") " pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:46:26.550494 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:26.550465    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04f1c5e9-cec3-42e8-b025-1498acfa621c-istio-data\") pod \"e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9\" (UID: \"04f1c5e9-cec3-42e8-b025-1498acfa621c\") " pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:46:26.550597 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:26.550577    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04f1c5e9-cec3-42e8-b025-1498acfa621c-workload-socket\") pod \"e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9\" (UID: \"04f1c5e9-cec3-42e8-b025-1498acfa621c\") " pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:46:26.550793 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:26.550755    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04f1c5e9-cec3-42e8-b025-1498acfa621c-credential-socket\") pod \"e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9\" (UID: \"04f1c5e9-cec3-42e8-b025-1498acfa621c\") " pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:46:26.550793 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:26.550810    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04f1c5e9-cec3-42e8-b025-1498acfa621c-istio-data\") pod \"e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9\" (UID: \"04f1c5e9-cec3-42e8-b025-1498acfa621c\") " pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:46:26.551051 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:26.550921    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04f1c5e9-cec3-42e8-b025-1498acfa621c-workload-certs\") pod \"e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9\" (UID: \"04f1c5e9-cec3-42e8-b025-1498acfa621c\") " pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:46:26.551119 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:26.551099    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04f1c5e9-cec3-42e8-b025-1498acfa621c-istiod-ca-cert\") pod \"e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9\" (UID: \"04f1c5e9-cec3-42e8-b025-1498acfa621c\") " pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:46:26.552575 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:26.552552    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04f1c5e9-cec3-42e8-b025-1498acfa621c-istio-envoy\") pod \"e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9\" (UID: \"04f1c5e9-cec3-42e8-b025-1498acfa621c\") " pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:46:26.552785 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:26.552766    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04f1c5e9-cec3-42e8-b025-1498acfa621c-istio-podinfo\") pod \"e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9\" (UID: \"04f1c5e9-cec3-42e8-b025-1498acfa621c\") " pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:46:26.558569 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:26.558546    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04f1c5e9-cec3-42e8-b025-1498acfa621c-istio-token\") pod \"e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9\" (UID: \"04f1c5e9-cec3-42e8-b025-1498acfa621c\") " pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:46:26.558912 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:26.558890    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwkhp\" (UniqueName: \"kubernetes.io/projected/04f1c5e9-cec3-42e8-b025-1498acfa621c-kube-api-access-pwkhp\") pod \"e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9\" (UID: \"04f1c5e9-cec3-42e8-b025-1498acfa621c\") " pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:46:26.688242 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:26.688162    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:46:26.964982 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:26.964951    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"]
Sep 05 06:46:26.966575 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:46:26.966546    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04f1c5e9_cec3_42e8_b025_1498acfa621c.slice/crio-edb44341ccb4dbe83ae97cc746200836b41bbdbc77bb99e365e6316f24c40e3d WatchSource:0}: Error finding container edb44341ccb4dbe83ae97cc746200836b41bbdbc77bb99e365e6316f24c40e3d: Status 404 returned error can't find the container with id edb44341ccb4dbe83ae97cc746200836b41bbdbc77bb99e365e6316f24c40e3d
Sep 05 06:46:26.968702 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:26.968668    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:46:26.968771 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:26.968735    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:46:26.968771 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:26.968764    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:46:27.833294 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:27.833262    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9" event={"ID":"04f1c5e9-cec3-42e8-b025-1498acfa621c","Type":"ContainerStarted","Data":"595878aec984d82e2b318ce6383d1517794ff3138e00c28aece4278f399395f5"}
Sep 05 06:46:27.833722 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:27.833316    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9" event={"ID":"04f1c5e9-cec3-42e8-b025-1498acfa621c","Type":"ContainerStarted","Data":"edb44341ccb4dbe83ae97cc746200836b41bbdbc77bb99e365e6316f24c40e3d"}
Sep 05 06:46:27.856437 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:27.856388    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9" podStartSLOduration=1.856372968 podStartE2EDuration="1.856372968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:46:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:46:27.854642065 +0000 UTC m=+1253.828396753" watchObservedRunningTime="2026-09-05 06:46:27.856372968 +0000 UTC m=+1253.830127643"
Sep 05 06:46:28.688673 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:28.688635    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:46:28.693675 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:28.693646    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:46:28.839017 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:28.838990    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:46:28.840044 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:28.840011    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:46:34.711776 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:34.711739    2567 scope.go:117] "RemoveContainer" containerID="406afe0bf66b12a6eabb10d4eb8b4eaaf1f4d505d2ea34f2e04be0b9b3b2d81b"
Sep 05 06:46:34.720337 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:34.720313    2567 scope.go:117] "RemoveContainer" containerID="2d5d6758ff97d09afc9591320dadaa9759be96c1ddc397c0be5f6fc08577590f"
Sep 05 06:46:47.945695 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:47.945661    2567 generic.go:356] "Generic (PLEG): container finished" podID="04f1c5e9-cec3-42e8-b025-1498acfa621c" containerID="595878aec984d82e2b318ce6383d1517794ff3138e00c28aece4278f399395f5" exitCode=0
Sep 05 06:46:47.946017 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:47.945731    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9" event={"ID":"04f1c5e9-cec3-42e8-b025-1498acfa621c","Type":"ContainerDied","Data":"595878aec984d82e2b318ce6383d1517794ff3138e00c28aece4278f399395f5"}
Sep 05 06:46:47.946206 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:47.946191    2567 scope.go:117] "RemoveContainer" containerID="595878aec984d82e2b318ce6383d1517794ff3138e00c28aece4278f399395f5"
Sep 05 06:46:47.947352 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:47.947327    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:46:47.947421 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:47.947391    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:46:47.947458 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:47.947424    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:46:48.961309 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:48.959259    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9" event={"ID":"04f1c5e9-cec3-42e8-b025-1498acfa621c","Type":"ContainerStarted","Data":"3bd7291a24d09431aeadb52e7a703c19f081298330c0a1b6f28b982f91dd411c"}
Sep 05 06:46:49.689052 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:49.688992    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:46:49.689295 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:49.689271    2567 patch_prober.go:28] interesting pod/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 05 06:46:49.689383 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:49.689329    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9" podUID="04f1c5e9-cec3-42e8-b025-1498acfa621c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 05 06:46:50.689068 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:50.689012    2567 patch_prober.go:28] interesting pod/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 05 06:46:50.689468 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:50.689091    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9" podUID="04f1c5e9-cec3-42e8-b025-1498acfa621c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 05 06:46:51.688871 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:51.688832    2567 patch_prober.go:28] interesting pod/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 05 06:46:51.689086 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:51.688893    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9" podUID="04f1c5e9-cec3-42e8-b025-1498acfa621c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 05 06:46:52.689568 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:52.689533    2567 patch_prober.go:28] interesting pod/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 05 06:46:52.690095 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:52.689608    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9" podUID="04f1c5e9-cec3-42e8-b025-1498acfa621c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 05 06:46:53.688694 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:53.688653    2567 patch_prober.go:28] interesting pod/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 05 06:46:53.689063 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:53.689001    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9" podUID="04f1c5e9-cec3-42e8-b025-1498acfa621c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 05 06:46:54.692822 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:54.692793    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:46:54.693313 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:54.693124    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:46:54.693764 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:54.693738    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:46:55.633500 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:55.633466    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8080-140404779353696"]
Sep 05 06:46:55.637105 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:55.637088    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8080-140404779353696"
Sep 05 06:46:55.639426 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:55.639412    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jntms\""
Sep 05 06:46:55.644252 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:55.644230    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8080-140404779353696"]
Sep 05 06:46:55.725471 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:55.725444    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh2w9\" (UniqueName: \"kubernetes.io/projected/3b7dc207-3735-4bd6-bba0-ee245b0f633b-kube-api-access-lh2w9\") pod \"test-curl-8080-140404779353696\" (UID: \"3b7dc207-3735-4bd6-bba0-ee245b0f633b\") " pod="opendatahub/test-curl-8080-140404779353696"
Sep 05 06:46:55.826376 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:55.826346    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh2w9\" (UniqueName: \"kubernetes.io/projected/3b7dc207-3735-4bd6-bba0-ee245b0f633b-kube-api-access-lh2w9\") pod \"test-curl-8080-140404779353696\" (UID: \"3b7dc207-3735-4bd6-bba0-ee245b0f633b\") " pod="opendatahub/test-curl-8080-140404779353696"
Sep 05 06:46:55.835047 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:55.835004    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh2w9\" (UniqueName: \"kubernetes.io/projected/3b7dc207-3735-4bd6-bba0-ee245b0f633b-kube-api-access-lh2w9\") pod \"test-curl-8080-140404779353696\" (UID: \"3b7dc207-3735-4bd6-bba0-ee245b0f633b\") " pod="opendatahub/test-curl-8080-140404779353696"
Sep 05 06:46:55.947576 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:55.947556    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8080-140404779353696"
Sep 05 06:46:56.219547 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:56.219519    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8080-140404779353696"]
Sep 05 06:46:56.221589 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:46:56.221566    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b7dc207_3735_4bd6_bba0_ee245b0f633b.slice/crio-f6b3fc389498bb9b1f3f9ecd0850075765d3efcaa21c2693e891cfb8ad91c0a7 WatchSource:0}: Error finding container f6b3fc389498bb9b1f3f9ecd0850075765d3efcaa21c2693e891cfb8ad91c0a7: Status 404 returned error can't find the container with id f6b3fc389498bb9b1f3f9ecd0850075765d3efcaa21c2693e891cfb8ad91c0a7
Sep 05 06:46:56.223329 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:56.223306    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 05 06:46:57.006446 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:57.006416    2567 generic.go:356] "Generic (PLEG): container finished" podID="3b7dc207-3735-4bd6-bba0-ee245b0f633b" containerID="50e114ab70a794ea55596fe3d31fac4f7b5b51d396b0b3057bc9ac1a191d53dc" exitCode=0
Sep 05 06:46:57.006896 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:57.006463    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8080-140404779353696" event={"ID":"3b7dc207-3735-4bd6-bba0-ee245b0f633b","Type":"ContainerDied","Data":"50e114ab70a794ea55596fe3d31fac4f7b5b51d396b0b3057bc9ac1a191d53dc"}
Sep 05 06:46:57.006896 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:57.006489    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8080-140404779353696" event={"ID":"3b7dc207-3735-4bd6-bba0-ee245b0f633b","Type":"ContainerStarted","Data":"f6b3fc389498bb9b1f3f9ecd0850075765d3efcaa21c2693e891cfb8ad91c0a7"}
Sep 05 06:46:58.142337 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:58.142316    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8080-140404779353696"
Sep 05 06:46:58.180929 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:58.180900    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-8080-140404779353696_3b7dc207-3735-4bd6-bba0-ee245b0f633b/test-curl-8080-140404779353696/0.log"
Sep 05 06:46:58.218888 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:58.218858    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8080-140404779353696"]
Sep 05 06:46:58.223001 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:58.222964    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8080-140404779353696"]
Sep 05 06:46:58.252098 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:58.252079    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lh2w9\" (UniqueName: \"kubernetes.io/projected/3b7dc207-3735-4bd6-bba0-ee245b0f633b-kube-api-access-lh2w9\") pod \"3b7dc207-3735-4bd6-bba0-ee245b0f633b\" (UID: \"3b7dc207-3735-4bd6-bba0-ee245b0f633b\") "
Sep 05 06:46:58.254296 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:58.254270    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b7dc207-3735-4bd6-bba0-ee245b0f633b-kube-api-access-lh2w9" (OuterVolumeSpecName: "kube-api-access-lh2w9") pod "3b7dc207-3735-4bd6-bba0-ee245b0f633b" (UID: "3b7dc207-3735-4bd6-bba0-ee245b0f633b"). InnerVolumeSpecName "kube-api-access-lh2w9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:46:58.352753 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:58.352683    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lh2w9\" (UniqueName: \"kubernetes.io/projected/3b7dc207-3735-4bd6-bba0-ee245b0f633b-kube-api-access-lh2w9\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:46:58.360321 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:58.360298    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8080-140404779353696"]
Sep 05 06:46:58.360724 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:58.360707    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b7dc207-3735-4bd6-bba0-ee245b0f633b" containerName="test-curl-8080-140404779353696"
Sep 05 06:46:58.360805 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:58.360726    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b7dc207-3735-4bd6-bba0-ee245b0f633b" containerName="test-curl-8080-140404779353696"
Sep 05 06:46:58.360860 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:58.360812    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b7dc207-3735-4bd6-bba0-ee245b0f633b" containerName="test-curl-8080-140404779353696"
Sep 05 06:46:58.364002 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:58.363978    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8080-140404779353696"
Sep 05 06:46:58.371896 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:58.371869    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8080-140404779353696"]
Sep 05 06:46:58.453688 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:58.453664    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nskhh\" (UniqueName: \"kubernetes.io/projected/6b1c017f-6fbb-49c5-ae37-a4c6ffceb0a2-kube-api-access-nskhh\") pod \"test-curl-8080-140404779353696\" (UID: \"6b1c017f-6fbb-49c5-ae37-a4c6ffceb0a2\") " pod="opendatahub/test-curl-8080-140404779353696"
Sep 05 06:46:58.555048 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:58.554998    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nskhh\" (UniqueName: \"kubernetes.io/projected/6b1c017f-6fbb-49c5-ae37-a4c6ffceb0a2-kube-api-access-nskhh\") pod \"test-curl-8080-140404779353696\" (UID: \"6b1c017f-6fbb-49c5-ae37-a4c6ffceb0a2\") " pod="opendatahub/test-curl-8080-140404779353696"
Sep 05 06:46:58.564625 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:58.564599    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nskhh\" (UniqueName: \"kubernetes.io/projected/6b1c017f-6fbb-49c5-ae37-a4c6ffceb0a2-kube-api-access-nskhh\") pod \"test-curl-8080-140404779353696\" (UID: \"6b1c017f-6fbb-49c5-ae37-a4c6ffceb0a2\") " pod="opendatahub/test-curl-8080-140404779353696"
Sep 05 06:46:58.580797 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:58.580767    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b7dc207-3735-4bd6-bba0-ee245b0f633b" path="/var/lib/kubelet/pods/3b7dc207-3735-4bd6-bba0-ee245b0f633b/volumes"
Sep 05 06:46:58.683417 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:58.683360    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8080-140404779353696"
Sep 05 06:46:58.953445 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:58.953407    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8080-140404779353696"]
Sep 05 06:46:58.954998 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:46:58.954973    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b1c017f_6fbb_49c5_ae37_a4c6ffceb0a2.slice/crio-031f4f3ca79de6944a6f53fdbd337d54bb42d4eeae2b634a400d042ab5432150 WatchSource:0}: Error finding container 031f4f3ca79de6944a6f53fdbd337d54bb42d4eeae2b634a400d042ab5432150: Status 404 returned error can't find the container with id 031f4f3ca79de6944a6f53fdbd337d54bb42d4eeae2b634a400d042ab5432150
Sep 05 06:46:59.018611 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:59.018587    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8080-140404779353696"
Sep 05 06:46:59.018717 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:59.018630    2567 scope.go:117] "RemoveContainer" containerID="50e114ab70a794ea55596fe3d31fac4f7b5b51d396b0b3057bc9ac1a191d53dc"
Sep 05 06:46:59.020008 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:46:59.019981    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8080-140404779353696" event={"ID":"6b1c017f-6fbb-49c5-ae37-a4c6ffceb0a2","Type":"ContainerStarted","Data":"031f4f3ca79de6944a6f53fdbd337d54bb42d4eeae2b634a400d042ab5432150"}
Sep 05 06:47:00.027960 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:00.027926    2567 generic.go:356] "Generic (PLEG): container finished" podID="6b1c017f-6fbb-49c5-ae37-a4c6ffceb0a2" containerID="9f15ccfca2ed0fcab7f771de09679a1a7ad10fc240c2a74260c4881d2b319b76" exitCode=0
Sep 05 06:47:00.028416 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:00.027967    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8080-140404779353696" event={"ID":"6b1c017f-6fbb-49c5-ae37-a4c6ffceb0a2","Type":"ContainerDied","Data":"9f15ccfca2ed0fcab7f771de09679a1a7ad10fc240c2a74260c4881d2b319b76"}
Sep 05 06:47:01.161728 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:01.161705    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8080-140404779353696"
Sep 05 06:47:01.181330 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:01.181306    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-8080-140404779353696_6b1c017f-6fbb-49c5-ae37-a4c6ffceb0a2/test-curl-8080-140404779353696/0.log"
Sep 05 06:47:01.204820 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:01.204795    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8080-140404779353696"]
Sep 05 06:47:01.206556 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:01.206537    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8080-140404779353696"]
Sep 05 06:47:01.279467 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:01.279444    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nskhh\" (UniqueName: \"kubernetes.io/projected/6b1c017f-6fbb-49c5-ae37-a4c6ffceb0a2-kube-api-access-nskhh\") pod \"6b1c017f-6fbb-49c5-ae37-a4c6ffceb0a2\" (UID: \"6b1c017f-6fbb-49c5-ae37-a4c6ffceb0a2\") "
Sep 05 06:47:01.281657 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:01.281635    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b1c017f-6fbb-49c5-ae37-a4c6ffceb0a2-kube-api-access-nskhh" (OuterVolumeSpecName: "kube-api-access-nskhh") pod "6b1c017f-6fbb-49c5-ae37-a4c6ffceb0a2" (UID: "6b1c017f-6fbb-49c5-ae37-a4c6ffceb0a2"). InnerVolumeSpecName "kube-api-access-nskhh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:47:01.358124 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:01.358098    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8080-140404779354272"]
Sep 05 06:47:01.358485 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:01.358471    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b1c017f-6fbb-49c5-ae37-a4c6ffceb0a2" containerName="test-curl-8080-140404779353696"
Sep 05 06:47:01.358531 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:01.358486    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b1c017f-6fbb-49c5-ae37-a4c6ffceb0a2" containerName="test-curl-8080-140404779353696"
Sep 05 06:47:01.358573 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:01.358564    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b1c017f-6fbb-49c5-ae37-a4c6ffceb0a2" containerName="test-curl-8080-140404779353696"
Sep 05 06:47:01.361425 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:01.361409    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8080-140404779354272"
Sep 05 06:47:01.368159 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:01.368134    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8080-140404779354272"]
Sep 05 06:47:01.380835 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:01.380808    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nskhh\" (UniqueName: \"kubernetes.io/projected/6b1c017f-6fbb-49c5-ae37-a4c6ffceb0a2-kube-api-access-nskhh\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:47:01.481491 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:01.481458    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npt69\" (UniqueName: \"kubernetes.io/projected/af11e68d-0ab1-45c0-9f51-0da3c9cd7c2d-kube-api-access-npt69\") pod \"test-curl-8080-140404779354272\" (UID: \"af11e68d-0ab1-45c0-9f51-0da3c9cd7c2d\") " pod="opendatahub/test-curl-8080-140404779354272"
Sep 05 06:47:01.583269 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:01.583173    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npt69\" (UniqueName: \"kubernetes.io/projected/af11e68d-0ab1-45c0-9f51-0da3c9cd7c2d-kube-api-access-npt69\") pod \"test-curl-8080-140404779354272\" (UID: \"af11e68d-0ab1-45c0-9f51-0da3c9cd7c2d\") " pod="opendatahub/test-curl-8080-140404779354272"
Sep 05 06:47:01.594333 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:01.594309    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npt69\" (UniqueName: \"kubernetes.io/projected/af11e68d-0ab1-45c0-9f51-0da3c9cd7c2d-kube-api-access-npt69\") pod \"test-curl-8080-140404779354272\" (UID: \"af11e68d-0ab1-45c0-9f51-0da3c9cd7c2d\") " pod="opendatahub/test-curl-8080-140404779354272"
Sep 05 06:47:01.672061 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:01.672010    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8080-140404779354272"
Sep 05 06:47:01.942529 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:01.942502    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8080-140404779354272"]
Sep 05 06:47:01.944565 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:47:01.944541    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf11e68d_0ab1_45c0_9f51_0da3c9cd7c2d.slice/crio-f59e55823f908d3e90b9cc3be2699a78ee6c66cd98cd28503df1b30259f181af WatchSource:0}: Error finding container f59e55823f908d3e90b9cc3be2699a78ee6c66cd98cd28503df1b30259f181af: Status 404 returned error can't find the container with id f59e55823f908d3e90b9cc3be2699a78ee6c66cd98cd28503df1b30259f181af
Sep 05 06:47:02.039667 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:02.039630    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8080-140404779354272" event={"ID":"af11e68d-0ab1-45c0-9f51-0da3c9cd7c2d","Type":"ContainerStarted","Data":"f59e55823f908d3e90b9cc3be2699a78ee6c66cd98cd28503df1b30259f181af"}
Sep 05 06:47:02.040916 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:02.040896    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="031f4f3ca79de6944a6f53fdbd337d54bb42d4eeae2b634a400d042ab5432150"
Sep 05 06:47:02.040916 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:02.040915    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8080-140404779353696"
Sep 05 06:47:02.052429 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:47:02.052392    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8080-140404779353696\" is forbidden: User \"system:node:ip-10-0-141-49.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-49.ec2.internal' and this object" podUID="6b1c017f-6fbb-49c5-ae37-a4c6ffceb0a2" pod="opendatahub/test-curl-8080-140404779353696"
Sep 05 06:47:02.581690 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:02.581662    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b1c017f-6fbb-49c5-ae37-a4c6ffceb0a2" path="/var/lib/kubelet/pods/6b1c017f-6fbb-49c5-ae37-a4c6ffceb0a2/volumes"
Sep 05 06:47:03.048898 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:03.048862    2567 generic.go:356] "Generic (PLEG): container finished" podID="af11e68d-0ab1-45c0-9f51-0da3c9cd7c2d" containerID="a64f8f99ba60efd638f668acf4e7b991e54195118dd1c3c3aae6d474d09b12e3" exitCode=0
Sep 05 06:47:03.049110 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:03.048918    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8080-140404779354272" event={"ID":"af11e68d-0ab1-45c0-9f51-0da3c9cd7c2d","Type":"ContainerDied","Data":"a64f8f99ba60efd638f668acf4e7b991e54195118dd1c3c3aae6d474d09b12e3"}
Sep 05 06:47:04.189933 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:04.189910    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8080-140404779354272"
Sep 05 06:47:04.210743 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:04.210715    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-8080-140404779354272_af11e68d-0ab1-45c0-9f51-0da3c9cd7c2d/test-curl-8080-140404779354272/0.log"
Sep 05 06:47:04.233287 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:04.233261    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8080-140404779354272"]
Sep 05 06:47:04.238789 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:04.238769    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8080-140404779354272"]
Sep 05 06:47:04.310384 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:04.310323    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npt69\" (UniqueName: \"kubernetes.io/projected/af11e68d-0ab1-45c0-9f51-0da3c9cd7c2d-kube-api-access-npt69\") pod \"af11e68d-0ab1-45c0-9f51-0da3c9cd7c2d\" (UID: \"af11e68d-0ab1-45c0-9f51-0da3c9cd7c2d\") "
Sep 05 06:47:04.312454 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:04.312433    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af11e68d-0ab1-45c0-9f51-0da3c9cd7c2d-kube-api-access-npt69" (OuterVolumeSpecName: "kube-api-access-npt69") pod "af11e68d-0ab1-45c0-9f51-0da3c9cd7c2d" (UID: "af11e68d-0ab1-45c0-9f51-0da3c9cd7c2d"). InnerVolumeSpecName "kube-api-access-npt69". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:47:04.366659 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:04.366627    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8080-140404779354272"]
Sep 05 06:47:04.367100 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:04.367082    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af11e68d-0ab1-45c0-9f51-0da3c9cd7c2d" containerName="test-curl-8080-140404779354272"
Sep 05 06:47:04.367193 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:04.367103    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="af11e68d-0ab1-45c0-9f51-0da3c9cd7c2d" containerName="test-curl-8080-140404779354272"
Sep 05 06:47:04.367252 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:04.367232    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="af11e68d-0ab1-45c0-9f51-0da3c9cd7c2d" containerName="test-curl-8080-140404779354272"
Sep 05 06:47:04.370748 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:04.370730    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8080-140404779354272"
Sep 05 06:47:04.376268 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:04.376245    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8080-140404779354272"]
Sep 05 06:47:04.410956 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:04.410926    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npt69\" (UniqueName: \"kubernetes.io/projected/af11e68d-0ab1-45c0-9f51-0da3c9cd7c2d-kube-api-access-npt69\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:47:04.512129 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:04.512099    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvzww\" (UniqueName: \"kubernetes.io/projected/60adfd21-9dd4-45e3-b40c-d7cc132a31b0-kube-api-access-qvzww\") pod \"test-curl-8080-140404779354272\" (UID: \"60adfd21-9dd4-45e3-b40c-d7cc132a31b0\") " pod="opendatahub/test-curl-8080-140404779354272"
Sep 05 06:47:04.581275 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:04.581219    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af11e68d-0ab1-45c0-9f51-0da3c9cd7c2d" path="/var/lib/kubelet/pods/af11e68d-0ab1-45c0-9f51-0da3c9cd7c2d/volumes"
Sep 05 06:47:04.613107 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:04.613082    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvzww\" (UniqueName: \"kubernetes.io/projected/60adfd21-9dd4-45e3-b40c-d7cc132a31b0-kube-api-access-qvzww\") pod \"test-curl-8080-140404779354272\" (UID: \"60adfd21-9dd4-45e3-b40c-d7cc132a31b0\") " pod="opendatahub/test-curl-8080-140404779354272"
Sep 05 06:47:04.622332 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:04.622309    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvzww\" (UniqueName: \"kubernetes.io/projected/60adfd21-9dd4-45e3-b40c-d7cc132a31b0-kube-api-access-qvzww\") pod \"test-curl-8080-140404779354272\" (UID: \"60adfd21-9dd4-45e3-b40c-d7cc132a31b0\") " pod="opendatahub/test-curl-8080-140404779354272"
Sep 05 06:47:04.680809 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:04.680787    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8080-140404779354272"
Sep 05 06:47:04.953666 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:04.953644    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8080-140404779354272"]
Sep 05 06:47:04.954767 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:47:04.954745    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60adfd21_9dd4_45e3_b40c_d7cc132a31b0.slice/crio-4f70a8a00e664d28be757122446136dc9cb38a705108489530e376c3b77c2bc8 WatchSource:0}: Error finding container 4f70a8a00e664d28be757122446136dc9cb38a705108489530e376c3b77c2bc8: Status 404 returned error can't find the container with id 4f70a8a00e664d28be757122446136dc9cb38a705108489530e376c3b77c2bc8
Sep 05 06:47:05.062388 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:05.062356    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8080-140404779354272" event={"ID":"60adfd21-9dd4-45e3-b40c-d7cc132a31b0","Type":"ContainerStarted","Data":"4f70a8a00e664d28be757122446136dc9cb38a705108489530e376c3b77c2bc8"}
Sep 05 06:47:05.063623 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:05.063600    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8080-140404779354272"
Sep 05 06:47:05.063739 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:05.063659    2567 scope.go:117] "RemoveContainer" containerID="a64f8f99ba60efd638f668acf4e7b991e54195118dd1c3c3aae6d474d09b12e3"
Sep 05 06:47:06.069974 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:06.069946    2567 generic.go:356] "Generic (PLEG): container finished" podID="60adfd21-9dd4-45e3-b40c-d7cc132a31b0" containerID="16b76b846e0940eac8088b76e4db9950c5079818b98b616bc12f60bc27276c08" exitCode=0
Sep 05 06:47:06.070419 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:06.070041    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8080-140404779354272" event={"ID":"60adfd21-9dd4-45e3-b40c-d7cc132a31b0","Type":"ContainerDied","Data":"16b76b846e0940eac8088b76e4db9950c5079818b98b616bc12f60bc27276c08"}
Sep 05 06:47:07.214106 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:07.214085    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8080-140404779354272"
Sep 05 06:47:07.234167 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:07.234137    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-8080-140404779354272_60adfd21-9dd4-45e3-b40c-d7cc132a31b0/test-curl-8080-140404779354272/0.log"
Sep 05 06:47:07.256470 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:07.256441    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8080-140404779354272"]
Sep 05 06:47:07.260098 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:07.260067    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8080-140404779354272"]
Sep 05 06:47:07.336965 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:07.336914    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvzww\" (UniqueName: \"kubernetes.io/projected/60adfd21-9dd4-45e3-b40c-d7cc132a31b0-kube-api-access-qvzww\") pod \"60adfd21-9dd4-45e3-b40c-d7cc132a31b0\" (UID: \"60adfd21-9dd4-45e3-b40c-d7cc132a31b0\") "
Sep 05 06:47:07.339123 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:07.339094    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60adfd21-9dd4-45e3-b40c-d7cc132a31b0-kube-api-access-qvzww" (OuterVolumeSpecName: "kube-api-access-qvzww") pod "60adfd21-9dd4-45e3-b40c-d7cc132a31b0" (UID: "60adfd21-9dd4-45e3-b40c-d7cc132a31b0"). InnerVolumeSpecName "kube-api-access-qvzww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:47:07.438473 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:07.438446    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvzww\" (UniqueName: \"kubernetes.io/projected/60adfd21-9dd4-45e3-b40c-d7cc132a31b0-kube-api-access-qvzww\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:47:08.088351 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.088317    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f70a8a00e664d28be757122446136dc9cb38a705108489530e376c3b77c2bc8"
Sep 05 06:47:08.088555 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.088363    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8080-140404779354272"
Sep 05 06:47:08.103146 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:47:08.103113    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8080-140404779354272\" is forbidden: User \"system:node:ip-10-0-141-49.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-49.ec2.internal' and this object" podUID="60adfd21-9dd4-45e3-b40c-d7cc132a31b0" pod="opendatahub/test-curl-8080-140404779354272"
Sep 05 06:47:08.202457 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.202427    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"]
Sep 05 06:47:08.202859 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.202847    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60adfd21-9dd4-45e3-b40c-d7cc132a31b0" containerName="test-curl-8080-140404779354272"
Sep 05 06:47:08.202910 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.202861    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="60adfd21-9dd4-45e3-b40c-d7cc132a31b0" containerName="test-curl-8080-140404779354272"
Sep 05 06:47:08.202950 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.202920    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="60adfd21-9dd4-45e3-b40c-d7cc132a31b0" containerName="test-curl-8080-140404779354272"
Sep 05 06:47:08.206186 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.206170    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:47:08.208926 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.208908    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-c36aacf1-openshift-default-dockercfg-5xbvt\""
Sep 05 06:47:08.217114 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.217086    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"]
Sep 05 06:47:08.240371 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:47:08.240340    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8080-140404779354272\" is forbidden: User \"system:node:ip-10-0-141-49.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-49.ec2.internal' and this object" podUID="60adfd21-9dd4-45e3-b40c-d7cc132a31b0" pod="opendatahub/test-curl-8080-140404779354272"
Sep 05 06:47:08.347972 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.347867    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxdrn\" (UniqueName: \"kubernetes.io/projected/4979ff3f-cff1-4c33-9b06-1aeea6927965-kube-api-access-mxdrn\") pod \"e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz\" (UID: \"4979ff3f-cff1-4c33-9b06-1aeea6927965\") " pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:47:08.347972 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.347951    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4979ff3f-cff1-4c33-9b06-1aeea6927965-istio-podinfo\") pod \"e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz\" (UID: \"4979ff3f-cff1-4c33-9b06-1aeea6927965\") " pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:47:08.348239 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.347980    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4979ff3f-cff1-4c33-9b06-1aeea6927965-workload-socket\") pod \"e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz\" (UID: \"4979ff3f-cff1-4c33-9b06-1aeea6927965\") " pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:47:08.348239 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.348105    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4979ff3f-cff1-4c33-9b06-1aeea6927965-istio-envoy\") pod \"e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz\" (UID: \"4979ff3f-cff1-4c33-9b06-1aeea6927965\") " pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:47:08.348239 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.348147    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4979ff3f-cff1-4c33-9b06-1aeea6927965-istio-token\") pod \"e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz\" (UID: \"4979ff3f-cff1-4c33-9b06-1aeea6927965\") " pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:47:08.348239 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.348166    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4979ff3f-cff1-4c33-9b06-1aeea6927965-istiod-ca-cert\") pod \"e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz\" (UID: \"4979ff3f-cff1-4c33-9b06-1aeea6927965\") " pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:47:08.348239 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.348184    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4979ff3f-cff1-4c33-9b06-1aeea6927965-credential-socket\") pod \"e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz\" (UID: \"4979ff3f-cff1-4c33-9b06-1aeea6927965\") " pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:47:08.348239 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.348198    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4979ff3f-cff1-4c33-9b06-1aeea6927965-istio-data\") pod \"e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz\" (UID: \"4979ff3f-cff1-4c33-9b06-1aeea6927965\") " pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:47:08.348441 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.348279    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4979ff3f-cff1-4c33-9b06-1aeea6927965-workload-certs\") pod \"e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz\" (UID: \"4979ff3f-cff1-4c33-9b06-1aeea6927965\") " pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:47:08.448948 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.448918    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4979ff3f-cff1-4c33-9b06-1aeea6927965-istio-podinfo\") pod \"e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz\" (UID: \"4979ff3f-cff1-4c33-9b06-1aeea6927965\") " pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:47:08.448948 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.448952    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4979ff3f-cff1-4c33-9b06-1aeea6927965-workload-socket\") pod \"e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz\" (UID: \"4979ff3f-cff1-4c33-9b06-1aeea6927965\") " pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:47:08.449194 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.449154    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4979ff3f-cff1-4c33-9b06-1aeea6927965-istio-envoy\") pod \"e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz\" (UID: \"4979ff3f-cff1-4c33-9b06-1aeea6927965\") " pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:47:08.449260 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.449201    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4979ff3f-cff1-4c33-9b06-1aeea6927965-istio-token\") pod \"e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz\" (UID: \"4979ff3f-cff1-4c33-9b06-1aeea6927965\") " pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:47:08.449260 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.449233    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4979ff3f-cff1-4c33-9b06-1aeea6927965-istiod-ca-cert\") pod \"e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz\" (UID: \"4979ff3f-cff1-4c33-9b06-1aeea6927965\") " pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:47:08.449368 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.449260    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4979ff3f-cff1-4c33-9b06-1aeea6927965-credential-socket\") pod \"e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz\" (UID: \"4979ff3f-cff1-4c33-9b06-1aeea6927965\") " pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:47:08.449368 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.449284    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4979ff3f-cff1-4c33-9b06-1aeea6927965-istio-data\") pod \"e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz\" (UID: \"4979ff3f-cff1-4c33-9b06-1aeea6927965\") " pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:47:08.449368 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.449336    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4979ff3f-cff1-4c33-9b06-1aeea6927965-workload-socket\") pod \"e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz\" (UID: \"4979ff3f-cff1-4c33-9b06-1aeea6927965\") " pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:47:08.449513 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.449365    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4979ff3f-cff1-4c33-9b06-1aeea6927965-workload-certs\") pod \"e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz\" (UID: \"4979ff3f-cff1-4c33-9b06-1aeea6927965\") " pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:47:08.449513 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.449428    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxdrn\" (UniqueName: \"kubernetes.io/projected/4979ff3f-cff1-4c33-9b06-1aeea6927965-kube-api-access-mxdrn\") pod \"e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz\" (UID: \"4979ff3f-cff1-4c33-9b06-1aeea6927965\") " pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:47:08.449630 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.449604    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4979ff3f-cff1-4c33-9b06-1aeea6927965-credential-socket\") pod \"e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz\" (UID: \"4979ff3f-cff1-4c33-9b06-1aeea6927965\") " pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:47:08.449717 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.449695    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4979ff3f-cff1-4c33-9b06-1aeea6927965-istio-data\") pod \"e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz\" (UID: \"4979ff3f-cff1-4c33-9b06-1aeea6927965\") " pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:47:08.449914 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.449894    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4979ff3f-cff1-4c33-9b06-1aeea6927965-istiod-ca-cert\") pod \"e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz\" (UID: \"4979ff3f-cff1-4c33-9b06-1aeea6927965\") " pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:47:08.450078 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.450056    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4979ff3f-cff1-4c33-9b06-1aeea6927965-workload-certs\") pod \"e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz\" (UID: \"4979ff3f-cff1-4c33-9b06-1aeea6927965\") " pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:47:08.451472 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.451448    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4979ff3f-cff1-4c33-9b06-1aeea6927965-istio-envoy\") pod \"e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz\" (UID: \"4979ff3f-cff1-4c33-9b06-1aeea6927965\") " pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:47:08.451590 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.451575    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4979ff3f-cff1-4c33-9b06-1aeea6927965-istio-podinfo\") pod \"e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz\" (UID: \"4979ff3f-cff1-4c33-9b06-1aeea6927965\") " pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:47:08.459268 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.459243    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4979ff3f-cff1-4c33-9b06-1aeea6927965-istio-token\") pod \"e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz\" (UID: \"4979ff3f-cff1-4c33-9b06-1aeea6927965\") " pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:47:08.459684 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.459666    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxdrn\" (UniqueName: \"kubernetes.io/projected/4979ff3f-cff1-4c33-9b06-1aeea6927965-kube-api-access-mxdrn\") pod \"e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz\" (UID: \"4979ff3f-cff1-4c33-9b06-1aeea6927965\") " pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:47:08.516631 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.516605    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:47:08.584021 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.583987    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60adfd21-9dd4-45e3-b40c-d7cc132a31b0" path="/var/lib/kubelet/pods/60adfd21-9dd4-45e3-b40c-d7cc132a31b0/volumes"
Sep 05 06:47:08.791789 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.791763    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"]
Sep 05 06:47:08.792728 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:47:08.792707    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4979ff3f_cff1_4c33_9b06_1aeea6927965.slice/crio-054237f84849717caeaa6eb2f0adec58432e3673a5037d0c3171985033aa6d24 WatchSource:0}: Error finding container 054237f84849717caeaa6eb2f0adec58432e3673a5037d0c3171985033aa6d24: Status 404 returned error can't find the container with id 054237f84849717caeaa6eb2f0adec58432e3673a5037d0c3171985033aa6d24
Sep 05 06:47:08.795050 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.794996    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:47:08.795141 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.795081    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:47:08.795141 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:08.795113    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:47:09.096643 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:09.096554    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz" event={"ID":"4979ff3f-cff1-4c33-9b06-1aeea6927965","Type":"ContainerStarted","Data":"f3c517cb85b094ae30677624cae8088a1bb3f2429c11c90f4be9cd82ecb6a339"}
Sep 05 06:47:09.096643 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:09.096619    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz" event={"ID":"4979ff3f-cff1-4c33-9b06-1aeea6927965","Type":"ContainerStarted","Data":"054237f84849717caeaa6eb2f0adec58432e3673a5037d0c3171985033aa6d24"}
Sep 05 06:47:09.120003 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:09.119957    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz" podStartSLOduration=1.119943673 podStartE2EDuration="1.119943673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:47:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:47:09.117325912 +0000 UTC m=+1295.091080589" watchObservedRunningTime="2026-09-05 06:47:09.119943673 +0000 UTC m=+1295.093698347"
Sep 05 06:47:09.517502 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:09.517470    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:47:09.522756 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:09.522734    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:47:10.102437 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:10.102401    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:47:10.103381 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:10.103362    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:47:34.756698 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:34.756659    2567 scope.go:117] "RemoveContainer" containerID="8c95133a587d5add8b279553856033e01cab94712e35bd92be6c8be372976cb0"
Sep 05 06:47:35.237491 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:35.237457    2567 generic.go:356] "Generic (PLEG): container finished" podID="4979ff3f-cff1-4c33-9b06-1aeea6927965" containerID="f3c517cb85b094ae30677624cae8088a1bb3f2429c11c90f4be9cd82ecb6a339" exitCode=0
Sep 05 06:47:35.237666 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:35.237530    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz" event={"ID":"4979ff3f-cff1-4c33-9b06-1aeea6927965","Type":"ContainerDied","Data":"f3c517cb85b094ae30677624cae8088a1bb3f2429c11c90f4be9cd82ecb6a339"}
Sep 05 06:47:35.237941 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:35.237923    2567 scope.go:117] "RemoveContainer" containerID="f3c517cb85b094ae30677624cae8088a1bb3f2429c11c90f4be9cd82ecb6a339"
Sep 05 06:47:35.239085 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:35.239060    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:47:35.239211 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:35.239127    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:47:35.239211 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:35.239159    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:47:36.247195 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:36.247153    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz" event={"ID":"4979ff3f-cff1-4c33-9b06-1aeea6927965","Type":"ContainerStarted","Data":"c1076ed4f88b01f9c6fc81222f3f2d1c0c66d263fd08c414048c8449adf57b3e"}
Sep 05 06:47:36.517190 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:36.517106    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:47:36.518351 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:36.518329    2567 patch_prober.go:28] interesting pod/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 05 06:47:36.518459 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:36.518399    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz" podUID="4979ff3f-cff1-4c33-9b06-1aeea6927965" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 05 06:47:37.517768 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:37.517731    2567 patch_prober.go:28] interesting pod/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 05 06:47:37.518197 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:37.517786    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz" podUID="4979ff3f-cff1-4c33-9b06-1aeea6927965" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 05 06:47:38.517706 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:38.517671    2567 patch_prober.go:28] interesting pod/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 05 06:47:38.517895 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:38.517722    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz" podUID="4979ff3f-cff1-4c33-9b06-1aeea6927965" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 05 06:47:39.517289 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:39.517252    2567 patch_prober.go:28] interesting pod/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 05 06:47:39.517476 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:39.517319    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz" podUID="4979ff3f-cff1-4c33-9b06-1aeea6927965" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 05 06:47:40.102499 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:40.102458    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:47:40.516959 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:40.516922    2567 patch_prober.go:28] interesting pod/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 05 06:47:40.517149 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:40.516976    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz" podUID="4979ff3f-cff1-4c33-9b06-1aeea6927965" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 05 06:47:41.517831 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:41.517785    2567 patch_prober.go:28] interesting pod/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 05 06:47:41.518260 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:41.517871    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz" podUID="4979ff3f-cff1-4c33-9b06-1aeea6927965" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 05 06:47:42.522270 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:42.522238    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:47:42.523253 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:42.523234    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:47:47.454848 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:47.454810    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2"]
Sep 05 06:47:47.457908 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:47.457884    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2"
Sep 05 06:47:47.461945 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:47.461918    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-c36aacf1\"/\"openshift-service-ca.crt\""
Sep 05 06:47:47.462092 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:47.461927    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-c36aacf1\"/\"default-dockercfg-46kf6\""
Sep 05 06:47:47.462092 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:47.461980    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-c36aacf1\"/\"e2e-lifecycle-model-c36aacf1-kserve-self-signed-certs\""
Sep 05 06:47:47.462276 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:47.462253    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-c36aacf1\"/\"kube-root-ca.crt\""
Sep 05 06:47:47.467971 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:47.467951    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2"]
Sep 05 06:47:47.535809 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:47.535779    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e-tmp-dir\") pod \"e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2\" (UID: \"4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e\") " pod="ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2"
Sep 05 06:47:47.535984 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:47.535814    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mngxg\" (UniqueName: \"kubernetes.io/projected/4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e-kube-api-access-mngxg\") pod \"e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2\" (UID: \"4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e\") " pod="ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2"
Sep 05 06:47:47.535984 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:47.535934    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e-tls-certs\") pod \"e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2\" (UID: \"4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e\") " pod="ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2"
Sep 05 06:47:47.535984 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:47.535962    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e-model-cache\") pod \"e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2\" (UID: \"4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e\") " pod="ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2"
Sep 05 06:47:47.535984 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:47.535981    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e-dshm\") pod \"e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2\" (UID: \"4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e\") " pod="ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2"
Sep 05 06:47:47.536239 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:47.536007    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e-home\") pod \"e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2\" (UID: \"4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e\") " pod="ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2"
Sep 05 06:47:47.637158 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:47.637124    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e-tls-certs\") pod \"e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2\" (UID: \"4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e\") " pod="ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2"
Sep 05 06:47:47.637347 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:47.637172    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e-model-cache\") pod \"e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2\" (UID: \"4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e\") " pod="ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2"
Sep 05 06:47:47.637347 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:47.637322    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e-dshm\") pod \"e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2\" (UID: \"4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e\") " pod="ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2"
Sep 05 06:47:47.637478 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:47.637381    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e-home\") pod \"e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2\" (UID: \"4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e\") " pod="ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2"
Sep 05 06:47:47.637478 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:47.637438    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e-tmp-dir\") pod \"e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2\" (UID: \"4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e\") " pod="ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2"
Sep 05 06:47:47.637478 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:47.637468    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mngxg\" (UniqueName: \"kubernetes.io/projected/4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e-kube-api-access-mngxg\") pod \"e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2\" (UID: \"4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e\") " pod="ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2"
Sep 05 06:47:47.637617 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:47.637533    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e-model-cache\") pod \"e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2\" (UID: \"4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e\") " pod="ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2"
Sep 05 06:47:47.637718 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:47.637698    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e-home\") pod \"e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2\" (UID: \"4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e\") " pod="ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2"
Sep 05 06:47:47.637844 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:47.637816    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e-tmp-dir\") pod \"e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2\" (UID: \"4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e\") " pod="ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2"
Sep 05 06:47:47.639827 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:47.639792    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e-dshm\") pod \"e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2\" (UID: \"4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e\") " pod="ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2"
Sep 05 06:47:47.639937 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:47.639895    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e-tls-certs\") pod \"e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2\" (UID: \"4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e\") " pod="ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2"
Sep 05 06:47:47.647223 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:47.647202    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mngxg\" (UniqueName: \"kubernetes.io/projected/4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e-kube-api-access-mngxg\") pod \"e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2\" (UID: \"4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e\") " pod="ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2"
Sep 05 06:47:47.769459 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:47.769369    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2"
Sep 05 06:47:48.039388 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:48.039365    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2"]
Sep 05 06:47:48.040885 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:47:48.040858    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a00c4e1_5b91_42a2_91d4_a41ff3b5ae1e.slice/crio-bb398d07db3f58d5e742f218295e7e2b7fad1e22c299c9dca4e3e108c5c2e21c WatchSource:0}: Error finding container bb398d07db3f58d5e742f218295e7e2b7fad1e22c299c9dca4e3e108c5c2e21c: Status 404 returned error can't find the container with id bb398d07db3f58d5e742f218295e7e2b7fad1e22c299c9dca4e3e108c5c2e21c
Sep 05 06:47:48.318322 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:48.318234    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2" event={"ID":"4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e","Type":"ContainerStarted","Data":"f31c201643487ff5e28856f0cbfb35aca9579d76c0296b84a1d22b5915415ef5"}
Sep 05 06:47:48.318322 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:48.318279    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2" event={"ID":"4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e","Type":"ContainerStarted","Data":"bb398d07db3f58d5e742f218295e7e2b7fad1e22c299c9dca4e3e108c5c2e21c"}
Sep 05 06:47:48.334595 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:48.334547    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2" podStartSLOduration=1.334529702 podStartE2EDuration="1.334529702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:47:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:47:48.3341745 +0000 UTC m=+1334.307929177" watchObservedRunningTime="2026-09-05 06:47:48.334529702 +0000 UTC m=+1334.308284380"
Sep 05 06:47:57.769922 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:57.769840    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2"
Sep 05 06:47:57.769922 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:57.769890    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2"
Sep 05 06:47:57.781988 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:57.781965    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2"
Sep 05 06:47:58.381121 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:47:58.381094    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2"
Sep 05 06:48:34.789477 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:48:34.789444    2567 scope.go:117] "RemoveContainer" containerID="12f67850e73e9669af7972274eaca709980a0244c6c7ba598abf134748862ec3"
Sep 05 06:48:34.798226 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:48:34.798198    2567 scope.go:117] "RemoveContainer" containerID="b9fc421c02e6d401bd24687ff48d4d00c94019589aba046ac44c940864e4c9ea"
Sep 05 06:48:45.113800 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:48:45.113757    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2"]
Sep 05 06:49:00.134125 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:00.134082    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2" podUID="4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e" containerName="main" containerID="cri-o://f31c201643487ff5e28856f0cbfb35aca9579d76c0296b84a1d22b5915415ef5" gracePeriod=45
Sep 05 06:49:00.383693 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:00.383670    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2"
Sep 05 06:49:00.486593 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:00.486567    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e-dshm\") pod \"4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e\" (UID: \"4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e\") "
Sep 05 06:49:00.486784 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:00.486603    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mngxg\" (UniqueName: \"kubernetes.io/projected/4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e-kube-api-access-mngxg\") pod \"4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e\" (UID: \"4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e\") "
Sep 05 06:49:00.486784 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:00.486631    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e-tls-certs\") pod \"4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e\" (UID: \"4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e\") "
Sep 05 06:49:00.486784 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:00.486656    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e-tmp-dir\") pod \"4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e\" (UID: \"4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e\") "
Sep 05 06:49:00.486784 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:00.486722    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e-home\") pod \"4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e\" (UID: \"4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e\") "
Sep 05 06:49:00.486784 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:00.486750    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e-model-cache\") pod \"4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e\" (UID: \"4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e\") "
Sep 05 06:49:00.487095 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:00.486985    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e" (UID: "4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:49:00.487095 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:00.487003    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e-home" (OuterVolumeSpecName: "home") pod "4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e" (UID: "4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:49:00.487095 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:00.487067    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e-model-cache" (OuterVolumeSpecName: "model-cache") pod "4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e" (UID: "4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:49:00.487265 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:00.487240    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e-model-cache\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:49:00.487265 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:00.487254    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e-tmp-dir\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:49:00.487265 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:00.487262    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e-home\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:49:00.488935 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:00.488911    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e-dshm" (OuterVolumeSpecName: "dshm") pod "4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e" (UID: "4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:49:00.489073 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:00.488938    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e" (UID: "4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 05 06:49:00.489073 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:00.488977    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e-kube-api-access-mngxg" (OuterVolumeSpecName: "kube-api-access-mngxg") pod "4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e" (UID: "4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e"). InnerVolumeSpecName "kube-api-access-mngxg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:49:00.588079 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:00.588019    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mngxg\" (UniqueName: \"kubernetes.io/projected/4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e-kube-api-access-mngxg\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:49:00.588231 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:00.588082    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e-tls-certs\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:49:00.588231 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:00.588098    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e-dshm\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:49:00.708383 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:00.708346    2567 generic.go:356] "Generic (PLEG): container finished" podID="4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e" containerID="f31c201643487ff5e28856f0cbfb35aca9579d76c0296b84a1d22b5915415ef5" exitCode=0
Sep 05 06:49:00.708559 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:00.708387    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2"
Sep 05 06:49:00.708559 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:00.708437    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2" event={"ID":"4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e","Type":"ContainerDied","Data":"f31c201643487ff5e28856f0cbfb35aca9579d76c0296b84a1d22b5915415ef5"}
Sep 05 06:49:00.708559 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:00.708476    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2" event={"ID":"4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e","Type":"ContainerDied","Data":"bb398d07db3f58d5e742f218295e7e2b7fad1e22c299c9dca4e3e108c5c2e21c"}
Sep 05 06:49:00.708559 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:00.708495    2567 scope.go:117] "RemoveContainer" containerID="f31c201643487ff5e28856f0cbfb35aca9579d76c0296b84a1d22b5915415ef5"
Sep 05 06:49:00.717554 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:00.717536    2567 scope.go:117] "RemoveContainer" containerID="f31c201643487ff5e28856f0cbfb35aca9579d76c0296b84a1d22b5915415ef5"
Sep 05 06:49:00.717841 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:49:00.717814    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f31c201643487ff5e28856f0cbfb35aca9579d76c0296b84a1d22b5915415ef5\": container with ID starting with f31c201643487ff5e28856f0cbfb35aca9579d76c0296b84a1d22b5915415ef5 not found: ID does not exist" containerID="f31c201643487ff5e28856f0cbfb35aca9579d76c0296b84a1d22b5915415ef5"
Sep 05 06:49:00.717900 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:00.717849    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f31c201643487ff5e28856f0cbfb35aca9579d76c0296b84a1d22b5915415ef5"} err="failed to get container status \"f31c201643487ff5e28856f0cbfb35aca9579d76c0296b84a1d22b5915415ef5\": rpc error: code = NotFound desc = could not find container \"f31c201643487ff5e28856f0cbfb35aca9579d76c0296b84a1d22b5915415ef5\": container with ID starting with f31c201643487ff5e28856f0cbfb35aca9579d76c0296b84a1d22b5915415ef5 not found: ID does not exist"
Sep 05 06:49:00.726445 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:00.726419    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2"]
Sep 05 06:49:00.730905 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:00.730878    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-c36aacf1/e2e-lifecycle-model-c36aacf1-kserve-5bc5bbd55f-5hcc2"]
Sep 05 06:49:02.580712 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:02.580674    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e" path="/var/lib/kubelet/pods/4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e/volumes"
Sep 05 06:49:30.321069 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:30.321016    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"]
Sep 05 06:49:30.321551 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:30.321237    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz" podUID="4979ff3f-cff1-4c33-9b06-1aeea6927965" containerName="istio-proxy" containerID="cri-o://c1076ed4f88b01f9c6fc81222f3f2d1c0c66d263fd08c414048c8449adf57b3e" gracePeriod=30
Sep 05 06:49:34.825453 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:34.825415    2567 scope.go:117] "RemoveContainer" containerID="064dc82fed05239da27796552101d384fb312529929de08c7af4f49fffd65aaf"
Sep 05 06:49:34.856338 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:34.856313    2567 scope.go:117] "RemoveContainer" containerID="fa2f43f7da146739c5b799c889a1caf01386a52091a774e99b5ab19c1aa138db"
Sep 05 06:49:35.593420 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.593359    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:49:35.689218 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.689174    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxdrn\" (UniqueName: \"kubernetes.io/projected/4979ff3f-cff1-4c33-9b06-1aeea6927965-kube-api-access-mxdrn\") pod \"4979ff3f-cff1-4c33-9b06-1aeea6927965\" (UID: \"4979ff3f-cff1-4c33-9b06-1aeea6927965\") "
Sep 05 06:49:35.689218 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.689224    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4979ff3f-cff1-4c33-9b06-1aeea6927965-istio-token\") pod \"4979ff3f-cff1-4c33-9b06-1aeea6927965\" (UID: \"4979ff3f-cff1-4c33-9b06-1aeea6927965\") "
Sep 05 06:49:35.689456 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.689254    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4979ff3f-cff1-4c33-9b06-1aeea6927965-workload-certs\") pod \"4979ff3f-cff1-4c33-9b06-1aeea6927965\" (UID: \"4979ff3f-cff1-4c33-9b06-1aeea6927965\") "
Sep 05 06:49:35.689456 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.689369    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4979ff3f-cff1-4c33-9b06-1aeea6927965-istio-data\") pod \"4979ff3f-cff1-4c33-9b06-1aeea6927965\" (UID: \"4979ff3f-cff1-4c33-9b06-1aeea6927965\") "
Sep 05 06:49:35.689456 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.689402    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4979ff3f-cff1-4c33-9b06-1aeea6927965-istiod-ca-cert\") pod \"4979ff3f-cff1-4c33-9b06-1aeea6927965\" (UID: \"4979ff3f-cff1-4c33-9b06-1aeea6927965\") "
Sep 05 06:49:35.689456 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.689450    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4979ff3f-cff1-4c33-9b06-1aeea6927965-istio-envoy\") pod \"4979ff3f-cff1-4c33-9b06-1aeea6927965\" (UID: \"4979ff3f-cff1-4c33-9b06-1aeea6927965\") "
Sep 05 06:49:35.689682 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.689495    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4979ff3f-cff1-4c33-9b06-1aeea6927965-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4979ff3f-cff1-4c33-9b06-1aeea6927965" (UID: "4979ff3f-cff1-4c33-9b06-1aeea6927965"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:49:35.689682 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.689500    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4979ff3f-cff1-4c33-9b06-1aeea6927965-credential-socket\") pod \"4979ff3f-cff1-4c33-9b06-1aeea6927965\" (UID: \"4979ff3f-cff1-4c33-9b06-1aeea6927965\") "
Sep 05 06:49:35.689791 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.689652    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4979ff3f-cff1-4c33-9b06-1aeea6927965-istio-data" (OuterVolumeSpecName: "istio-data") pod "4979ff3f-cff1-4c33-9b06-1aeea6927965" (UID: "4979ff3f-cff1-4c33-9b06-1aeea6927965"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:49:35.689791 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.689683    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4979ff3f-cff1-4c33-9b06-1aeea6927965-istio-podinfo\") pod \"4979ff3f-cff1-4c33-9b06-1aeea6927965\" (UID: \"4979ff3f-cff1-4c33-9b06-1aeea6927965\") "
Sep 05 06:49:35.689791 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.689702    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4979ff3f-cff1-4c33-9b06-1aeea6927965-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4979ff3f-cff1-4c33-9b06-1aeea6927965" (UID: "4979ff3f-cff1-4c33-9b06-1aeea6927965"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:49:35.689791 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.689721    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4979ff3f-cff1-4c33-9b06-1aeea6927965-workload-socket\") pod \"4979ff3f-cff1-4c33-9b06-1aeea6927965\" (UID: \"4979ff3f-cff1-4c33-9b06-1aeea6927965\") "
Sep 05 06:49:35.689791 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.689740    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4979ff3f-cff1-4c33-9b06-1aeea6927965-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4979ff3f-cff1-4c33-9b06-1aeea6927965" (UID: "4979ff3f-cff1-4c33-9b06-1aeea6927965"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:49:35.690089 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.690068    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4979ff3f-cff1-4c33-9b06-1aeea6927965-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4979ff3f-cff1-4c33-9b06-1aeea6927965" (UID: "4979ff3f-cff1-4c33-9b06-1aeea6927965"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:49:35.690354 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.690335    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4979ff3f-cff1-4c33-9b06-1aeea6927965-workload-socket\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:49:35.690408 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.690361    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4979ff3f-cff1-4c33-9b06-1aeea6927965-workload-certs\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:49:35.690408 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.690376    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4979ff3f-cff1-4c33-9b06-1aeea6927965-istio-data\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:49:35.690408 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.690389    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4979ff3f-cff1-4c33-9b06-1aeea6927965-istiod-ca-cert\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:49:35.690408 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.690404    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4979ff3f-cff1-4c33-9b06-1aeea6927965-credential-socket\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:49:35.691641 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.691618    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4979ff3f-cff1-4c33-9b06-1aeea6927965-istio-token" (OuterVolumeSpecName: "istio-token") pod "4979ff3f-cff1-4c33-9b06-1aeea6927965" (UID: "4979ff3f-cff1-4c33-9b06-1aeea6927965"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:49:35.691716 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.691697    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4979ff3f-cff1-4c33-9b06-1aeea6927965-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4979ff3f-cff1-4c33-9b06-1aeea6927965" (UID: "4979ff3f-cff1-4c33-9b06-1aeea6927965"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 05 06:49:35.692148 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.692120    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4979ff3f-cff1-4c33-9b06-1aeea6927965-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4979ff3f-cff1-4c33-9b06-1aeea6927965" (UID: "4979ff3f-cff1-4c33-9b06-1aeea6927965"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:49:35.692148 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.692131    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4979ff3f-cff1-4c33-9b06-1aeea6927965-kube-api-access-mxdrn" (OuterVolumeSpecName: "kube-api-access-mxdrn") pod "4979ff3f-cff1-4c33-9b06-1aeea6927965" (UID: "4979ff3f-cff1-4c33-9b06-1aeea6927965"). InnerVolumeSpecName "kube-api-access-mxdrn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:49:35.791882 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.791844    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxdrn\" (UniqueName: \"kubernetes.io/projected/4979ff3f-cff1-4c33-9b06-1aeea6927965-kube-api-access-mxdrn\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:49:35.791882 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.791879    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4979ff3f-cff1-4c33-9b06-1aeea6927965-istio-token\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:49:35.791882 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.791889    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4979ff3f-cff1-4c33-9b06-1aeea6927965-istio-envoy\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:49:35.791882 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.791897    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4979ff3f-cff1-4c33-9b06-1aeea6927965-istio-podinfo\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:49:35.900720 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.900639    2567 generic.go:356] "Generic (PLEG): container finished" podID="4979ff3f-cff1-4c33-9b06-1aeea6927965" containerID="c1076ed4f88b01f9c6fc81222f3f2d1c0c66d263fd08c414048c8449adf57b3e" exitCode=0
Sep 05 06:49:35.900720 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.900686    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"
Sep 05 06:49:35.901195 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.900722    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz" event={"ID":"4979ff3f-cff1-4c33-9b06-1aeea6927965","Type":"ContainerDied","Data":"c1076ed4f88b01f9c6fc81222f3f2d1c0c66d263fd08c414048c8449adf57b3e"}
Sep 05 06:49:35.901195 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.900774    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz" event={"ID":"4979ff3f-cff1-4c33-9b06-1aeea6927965","Type":"ContainerDied","Data":"054237f84849717caeaa6eb2f0adec58432e3673a5037d0c3171985033aa6d24"}
Sep 05 06:49:35.901195 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.900796    2567 scope.go:117] "RemoveContainer" containerID="c1076ed4f88b01f9c6fc81222f3f2d1c0c66d263fd08c414048c8449adf57b3e"
Sep 05 06:49:35.910566 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.910552    2567 scope.go:117] "RemoveContainer" containerID="f3c517cb85b094ae30677624cae8088a1bb3f2429c11c90f4be9cd82ecb6a339"
Sep 05 06:49:35.918662 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.918646    2567 scope.go:117] "RemoveContainer" containerID="c1076ed4f88b01f9c6fc81222f3f2d1c0c66d263fd08c414048c8449adf57b3e"
Sep 05 06:49:35.918925 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:49:35.918906    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1076ed4f88b01f9c6fc81222f3f2d1c0c66d263fd08c414048c8449adf57b3e\": container with ID starting with c1076ed4f88b01f9c6fc81222f3f2d1c0c66d263fd08c414048c8449adf57b3e not found: ID does not exist" containerID="c1076ed4f88b01f9c6fc81222f3f2d1c0c66d263fd08c414048c8449adf57b3e"
Sep 05 06:49:35.918984 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.918932    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1076ed4f88b01f9c6fc81222f3f2d1c0c66d263fd08c414048c8449adf57b3e"} err="failed to get container status \"c1076ed4f88b01f9c6fc81222f3f2d1c0c66d263fd08c414048c8449adf57b3e\": rpc error: code = NotFound desc = could not find container \"c1076ed4f88b01f9c6fc81222f3f2d1c0c66d263fd08c414048c8449adf57b3e\": container with ID starting with c1076ed4f88b01f9c6fc81222f3f2d1c0c66d263fd08c414048c8449adf57b3e not found: ID does not exist"
Sep 05 06:49:35.918984 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.918950    2567 scope.go:117] "RemoveContainer" containerID="f3c517cb85b094ae30677624cae8088a1bb3f2429c11c90f4be9cd82ecb6a339"
Sep 05 06:49:35.919201 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:49:35.919179    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3c517cb85b094ae30677624cae8088a1bb3f2429c11c90f4be9cd82ecb6a339\": container with ID starting with f3c517cb85b094ae30677624cae8088a1bb3f2429c11c90f4be9cd82ecb6a339 not found: ID does not exist" containerID="f3c517cb85b094ae30677624cae8088a1bb3f2429c11c90f4be9cd82ecb6a339"
Sep 05 06:49:35.919262 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.919209    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3c517cb85b094ae30677624cae8088a1bb3f2429c11c90f4be9cd82ecb6a339"} err="failed to get container status \"f3c517cb85b094ae30677624cae8088a1bb3f2429c11c90f4be9cd82ecb6a339\": rpc error: code = NotFound desc = could not find container \"f3c517cb85b094ae30677624cae8088a1bb3f2429c11c90f4be9cd82ecb6a339\": container with ID starting with f3c517cb85b094ae30677624cae8088a1bb3f2429c11c90f4be9cd82ecb6a339 not found: ID does not exist"
Sep 05 06:49:35.923571 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.923551    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"]
Sep 05 06:49:35.927212 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:35.927192    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz"]
Sep 05 06:49:36.581218 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:49:36.581186    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4979ff3f-cff1-4c33-9b06-1aeea6927965" path="/var/lib/kubelet/pods/4979ff3f-cff1-4c33-9b06-1aeea6927965/volumes"
Sep 05 06:50:24.529275 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.529237    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"]
Sep 05 06:50:24.529715 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.529681    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4979ff3f-cff1-4c33-9b06-1aeea6927965" containerName="istio-proxy"
Sep 05 06:50:24.529715 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.529694    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4979ff3f-cff1-4c33-9b06-1aeea6927965" containerName="istio-proxy"
Sep 05 06:50:24.529715 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.529706    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e" containerName="main"
Sep 05 06:50:24.529715 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.529712    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e" containerName="main"
Sep 05 06:50:24.529881 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.529772    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4979ff3f-cff1-4c33-9b06-1aeea6927965" containerName="istio-proxy"
Sep 05 06:50:24.529881 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.529782    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4979ff3f-cff1-4c33-9b06-1aeea6927965" containerName="istio-proxy"
Sep 05 06:50:24.529881 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.529798    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a00c4e1-5b91-42a2-91d4-a41ff3b5ae1e" containerName="main"
Sep 05 06:50:24.532879 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.532860    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:50:24.535711 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.535683    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-73c192-openshift-default-dockercfg-b6sq4\""
Sep 05 06:50:24.547769 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.547745    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"]
Sep 05 06:50:24.630229 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.630192    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/044641ba-be42-40b2-a4df-ce4abc81f84e-workload-certs\") pod \"e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr\" (UID: \"044641ba-be42-40b2-a4df-ce4abc81f84e\") " pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:50:24.630425 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.630239    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/044641ba-be42-40b2-a4df-ce4abc81f84e-istio-token\") pod \"e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr\" (UID: \"044641ba-be42-40b2-a4df-ce4abc81f84e\") " pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:50:24.630425 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.630268    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/044641ba-be42-40b2-a4df-ce4abc81f84e-istio-podinfo\") pod \"e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr\" (UID: \"044641ba-be42-40b2-a4df-ce4abc81f84e\") " pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:50:24.630425 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.630358    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk8zq\" (UniqueName: \"kubernetes.io/projected/044641ba-be42-40b2-a4df-ce4abc81f84e-kube-api-access-nk8zq\") pod \"e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr\" (UID: \"044641ba-be42-40b2-a4df-ce4abc81f84e\") " pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:50:24.630425 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.630408    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/044641ba-be42-40b2-a4df-ce4abc81f84e-istio-envoy\") pod \"e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr\" (UID: \"044641ba-be42-40b2-a4df-ce4abc81f84e\") " pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:50:24.630639 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.630437    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/044641ba-be42-40b2-a4df-ce4abc81f84e-credential-socket\") pod \"e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr\" (UID: \"044641ba-be42-40b2-a4df-ce4abc81f84e\") " pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:50:24.630639 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.630480    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/044641ba-be42-40b2-a4df-ce4abc81f84e-workload-socket\") pod \"e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr\" (UID: \"044641ba-be42-40b2-a4df-ce4abc81f84e\") " pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:50:24.630639 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.630558    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/044641ba-be42-40b2-a4df-ce4abc81f84e-istiod-ca-cert\") pod \"e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr\" (UID: \"044641ba-be42-40b2-a4df-ce4abc81f84e\") " pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:50:24.630639 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.630610    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/044641ba-be42-40b2-a4df-ce4abc81f84e-istio-data\") pod \"e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr\" (UID: \"044641ba-be42-40b2-a4df-ce4abc81f84e\") " pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:50:24.731604 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.731569    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk8zq\" (UniqueName: \"kubernetes.io/projected/044641ba-be42-40b2-a4df-ce4abc81f84e-kube-api-access-nk8zq\") pod \"e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr\" (UID: \"044641ba-be42-40b2-a4df-ce4abc81f84e\") " pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:50:24.731604 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.731608    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/044641ba-be42-40b2-a4df-ce4abc81f84e-istio-envoy\") pod \"e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr\" (UID: \"044641ba-be42-40b2-a4df-ce4abc81f84e\") " pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:50:24.731857 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.731625    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/044641ba-be42-40b2-a4df-ce4abc81f84e-credential-socket\") pod \"e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr\" (UID: \"044641ba-be42-40b2-a4df-ce4abc81f84e\") " pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:50:24.731857 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.731656    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/044641ba-be42-40b2-a4df-ce4abc81f84e-workload-socket\") pod \"e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr\" (UID: \"044641ba-be42-40b2-a4df-ce4abc81f84e\") " pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:50:24.731857 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.731711    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/044641ba-be42-40b2-a4df-ce4abc81f84e-istiod-ca-cert\") pod \"e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr\" (UID: \"044641ba-be42-40b2-a4df-ce4abc81f84e\") " pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:50:24.731857 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.731761    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/044641ba-be42-40b2-a4df-ce4abc81f84e-istio-data\") pod \"e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr\" (UID: \"044641ba-be42-40b2-a4df-ce4abc81f84e\") " pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:50:24.731857 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.731827    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/044641ba-be42-40b2-a4df-ce4abc81f84e-workload-certs\") pod \"e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr\" (UID: \"044641ba-be42-40b2-a4df-ce4abc81f84e\") " pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:50:24.731857 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.731856    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/044641ba-be42-40b2-a4df-ce4abc81f84e-istio-token\") pod \"e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr\" (UID: \"044641ba-be42-40b2-a4df-ce4abc81f84e\") " pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:50:24.732208 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.731887    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/044641ba-be42-40b2-a4df-ce4abc81f84e-istio-podinfo\") pod \"e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr\" (UID: \"044641ba-be42-40b2-a4df-ce4abc81f84e\") " pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:50:24.732208 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.732141    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/044641ba-be42-40b2-a4df-ce4abc81f84e-credential-socket\") pod \"e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr\" (UID: \"044641ba-be42-40b2-a4df-ce4abc81f84e\") " pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:50:24.732277 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.732204    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/044641ba-be42-40b2-a4df-ce4abc81f84e-workload-socket\") pod \"e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr\" (UID: \"044641ba-be42-40b2-a4df-ce4abc81f84e\") " pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:50:24.732334 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.732314    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/044641ba-be42-40b2-a4df-ce4abc81f84e-istio-data\") pod \"e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr\" (UID: \"044641ba-be42-40b2-a4df-ce4abc81f84e\") " pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:50:24.732394 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.732373    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/044641ba-be42-40b2-a4df-ce4abc81f84e-workload-certs\") pod \"e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr\" (UID: \"044641ba-be42-40b2-a4df-ce4abc81f84e\") " pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:50:24.732482 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.732465    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/044641ba-be42-40b2-a4df-ce4abc81f84e-istiod-ca-cert\") pod \"e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr\" (UID: \"044641ba-be42-40b2-a4df-ce4abc81f84e\") " pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:50:24.734199 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.734171    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/044641ba-be42-40b2-a4df-ce4abc81f84e-istio-envoy\") pod \"e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr\" (UID: \"044641ba-be42-40b2-a4df-ce4abc81f84e\") " pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:50:24.734490 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.734473    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/044641ba-be42-40b2-a4df-ce4abc81f84e-istio-podinfo\") pod \"e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr\" (UID: \"044641ba-be42-40b2-a4df-ce4abc81f84e\") " pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:50:24.740282 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.740264    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk8zq\" (UniqueName: \"kubernetes.io/projected/044641ba-be42-40b2-a4df-ce4abc81f84e-kube-api-access-nk8zq\") pod \"e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr\" (UID: \"044641ba-be42-40b2-a4df-ce4abc81f84e\") " pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:50:24.740381 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.740302    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/044641ba-be42-40b2-a4df-ce4abc81f84e-istio-token\") pod \"e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr\" (UID: \"044641ba-be42-40b2-a4df-ce4abc81f84e\") " pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:50:24.843383 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:24.843319    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:50:25.119621 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:25.119598    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"]
Sep 05 06:50:25.121378 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:50:25.121349    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod044641ba_be42_40b2_a4df_ce4abc81f84e.slice/crio-cc7c08abb03046506453a02bffdef251289c2f8d30e54b6975115f2bc972050e WatchSource:0}: Error finding container cc7c08abb03046506453a02bffdef251289c2f8d30e54b6975115f2bc972050e: Status 404 returned error can't find the container with id cc7c08abb03046506453a02bffdef251289c2f8d30e54b6975115f2bc972050e
Sep 05 06:50:25.123822 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:25.123781    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:50:25.123908 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:25.123875    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:50:25.123948 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:25.123924    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:50:25.168709 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:25.168678    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr" event={"ID":"044641ba-be42-40b2-a4df-ce4abc81f84e","Type":"ContainerStarted","Data":"cc7c08abb03046506453a02bffdef251289c2f8d30e54b6975115f2bc972050e"}
Sep 05 06:50:26.175439 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:26.175408    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr" event={"ID":"044641ba-be42-40b2-a4df-ce4abc81f84e","Type":"ContainerStarted","Data":"a4752cfabd8c8680053fb53601e01402e0d2ebe387eb19c65cadee8ef159469a"}
Sep 05 06:50:26.194804 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:26.194750    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr" podStartSLOduration=2.194733442 podStartE2EDuration="2.194733442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:50:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:50:26.193859206 +0000 UTC m=+1492.167613881" watchObservedRunningTime="2026-09-05 06:50:26.194733442 +0000 UTC m=+1492.168488116"
Sep 05 06:50:26.844549 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:26.844515    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:50:26.850654 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:26.850626    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:50:27.180847 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:27.180767    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:50:27.181668 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:27.181650    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:50:33.512265 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:33.512231    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-8083-46ca5e"]
Sep 05 06:50:33.512677 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:33.512662    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4979ff3f-cff1-4c33-9b06-1aeea6927965" containerName="istio-proxy"
Sep 05 06:50:33.512735 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:33.512678    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4979ff3f-cff1-4c33-9b06-1aeea6927965" containerName="istio-proxy"
Sep 05 06:50:33.515650 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:33.515634    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-8083-46ca5e"
Sep 05 06:50:33.518205 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:33.518184    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jntms\""
Sep 05 06:50:33.523467 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:33.523449    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-8083-46ca5e"]
Sep 05 06:50:33.606895 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:33.606863    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh8x5\" (UniqueName: \"kubernetes.io/projected/aad475c3-8ff2-49a7-8aea-2ba4d2d9447a-kube-api-access-rh8x5\") pod \"mt-curl-8083-46ca5e\" (UID: \"aad475c3-8ff2-49a7-8aea-2ba4d2d9447a\") " pod="opendatahub/mt-curl-8083-46ca5e"
Sep 05 06:50:33.707726 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:33.707699    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh8x5\" (UniqueName: \"kubernetes.io/projected/aad475c3-8ff2-49a7-8aea-2ba4d2d9447a-kube-api-access-rh8x5\") pod \"mt-curl-8083-46ca5e\" (UID: \"aad475c3-8ff2-49a7-8aea-2ba4d2d9447a\") " pod="opendatahub/mt-curl-8083-46ca5e"
Sep 05 06:50:33.716927 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:33.716906    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh8x5\" (UniqueName: \"kubernetes.io/projected/aad475c3-8ff2-49a7-8aea-2ba4d2d9447a-kube-api-access-rh8x5\") pod \"mt-curl-8083-46ca5e\" (UID: \"aad475c3-8ff2-49a7-8aea-2ba4d2d9447a\") " pod="opendatahub/mt-curl-8083-46ca5e"
Sep 05 06:50:33.826317 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:33.826237    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-8083-46ca5e"
Sep 05 06:50:34.097945 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:34.097921    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-8083-46ca5e"]
Sep 05 06:50:34.103344 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:50:34.100247    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaad475c3_8ff2_49a7_8aea_2ba4d2d9447a.slice/crio-7214a295495307386b35de72cfff1bad2a624329ab5b9b7bb706bf3348cf1b90 WatchSource:0}: Error finding container 7214a295495307386b35de72cfff1bad2a624329ab5b9b7bb706bf3348cf1b90: Status 404 returned error can't find the container with id 7214a295495307386b35de72cfff1bad2a624329ab5b9b7bb706bf3348cf1b90
Sep 05 06:50:34.216969 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:34.216924    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-8083-46ca5e" event={"ID":"aad475c3-8ff2-49a7-8aea-2ba4d2d9447a","Type":"ContainerStarted","Data":"7214a295495307386b35de72cfff1bad2a624329ab5b9b7bb706bf3348cf1b90"}
Sep 05 06:50:34.756793 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:34.756764    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bb4_7f8a8f16-2422-4c01-a619-1f17fe10cd4c/ovn-acl-logging/0.log"
Sep 05 06:50:34.757336 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:34.757318    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bb4_7f8a8f16-2422-4c01-a619-1f17fe10cd4c/ovn-acl-logging/0.log"
Sep 05 06:50:34.885289 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:34.885265    2567 scope.go:117] "RemoveContainer" containerID="ec938d2cf64a6594d5cfb28b974315f98264d4ed7bb80ba19e93ac8bc9434a2f"
Sep 05 06:50:34.933104 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:34.933070    2567 scope.go:117] "RemoveContainer" containerID="9a23e37108a265293f6b9a5b9a12dc3b07d8a20a3d6e73be8f78fd877b86c675"
Sep 05 06:50:35.223370 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:35.223334    2567 generic.go:356] "Generic (PLEG): container finished" podID="aad475c3-8ff2-49a7-8aea-2ba4d2d9447a" containerID="6d67df9bf0cb9b76fcec48e5712169762c3b8f236df109e8912f63ba1507ab41" exitCode=0
Sep 05 06:50:35.223499 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:35.223390    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-8083-46ca5e" event={"ID":"aad475c3-8ff2-49a7-8aea-2ba4d2d9447a","Type":"ContainerDied","Data":"6d67df9bf0cb9b76fcec48e5712169762c3b8f236df109e8912f63ba1507ab41"}
Sep 05 06:50:36.362992 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:36.362970    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-8083-46ca5e"
Sep 05 06:50:36.395924 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:36.395901    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-8083-46ca5e_aad475c3-8ff2-49a7-8aea-2ba4d2d9447a/mt-curl-8083-46ca5e/0.log"
Sep 05 06:50:36.419267 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:36.419240    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-8083-46ca5e"]
Sep 05 06:50:36.424615 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:36.424592    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-8083-46ca5e"]
Sep 05 06:50:36.429815 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:36.429794    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rh8x5\" (UniqueName: \"kubernetes.io/projected/aad475c3-8ff2-49a7-8aea-2ba4d2d9447a-kube-api-access-rh8x5\") pod \"aad475c3-8ff2-49a7-8aea-2ba4d2d9447a\" (UID: \"aad475c3-8ff2-49a7-8aea-2ba4d2d9447a\") "
Sep 05 06:50:36.431888 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:36.431861    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aad475c3-8ff2-49a7-8aea-2ba4d2d9447a-kube-api-access-rh8x5" (OuterVolumeSpecName: "kube-api-access-rh8x5") pod "aad475c3-8ff2-49a7-8aea-2ba4d2d9447a" (UID: "aad475c3-8ff2-49a7-8aea-2ba4d2d9447a"). InnerVolumeSpecName "kube-api-access-rh8x5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:50:36.531086 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:36.530995    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rh8x5\" (UniqueName: \"kubernetes.io/projected/aad475c3-8ff2-49a7-8aea-2ba4d2d9447a-kube-api-access-rh8x5\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:50:36.547636 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:36.547604    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-8083-f201df"]
Sep 05 06:50:36.548006 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:36.547993    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aad475c3-8ff2-49a7-8aea-2ba4d2d9447a" containerName="mt-curl-8083-46ca5e"
Sep 05 06:50:36.548074 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:36.548009    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="aad475c3-8ff2-49a7-8aea-2ba4d2d9447a" containerName="mt-curl-8083-46ca5e"
Sep 05 06:50:36.548111 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:36.548093    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="aad475c3-8ff2-49a7-8aea-2ba4d2d9447a" containerName="mt-curl-8083-46ca5e"
Sep 05 06:50:36.550957 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:36.550942    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-8083-f201df"
Sep 05 06:50:36.557606 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:36.557584    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-8083-f201df"]
Sep 05 06:50:36.589901 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:36.589873    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aad475c3-8ff2-49a7-8aea-2ba4d2d9447a" path="/var/lib/kubelet/pods/aad475c3-8ff2-49a7-8aea-2ba4d2d9447a/volumes"
Sep 05 06:50:36.632312 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:36.632281    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmgw9\" (UniqueName: \"kubernetes.io/projected/4bbb14d3-d54f-4f94-882c-7383af593820-kube-api-access-fmgw9\") pod \"mt-curl-8083-f201df\" (UID: \"4bbb14d3-d54f-4f94-882c-7383af593820\") " pod="opendatahub/mt-curl-8083-f201df"
Sep 05 06:50:36.733072 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:36.733006    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmgw9\" (UniqueName: \"kubernetes.io/projected/4bbb14d3-d54f-4f94-882c-7383af593820-kube-api-access-fmgw9\") pod \"mt-curl-8083-f201df\" (UID: \"4bbb14d3-d54f-4f94-882c-7383af593820\") " pod="opendatahub/mt-curl-8083-f201df"
Sep 05 06:50:36.741840 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:36.741818    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmgw9\" (UniqueName: \"kubernetes.io/projected/4bbb14d3-d54f-4f94-882c-7383af593820-kube-api-access-fmgw9\") pod \"mt-curl-8083-f201df\" (UID: \"4bbb14d3-d54f-4f94-882c-7383af593820\") " pod="opendatahub/mt-curl-8083-f201df"
Sep 05 06:50:36.861728 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:36.861652    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-8083-f201df"
Sep 05 06:50:37.138222 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:37.138193    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-8083-f201df"]
Sep 05 06:50:37.140988 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:50:37.140943    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4bbb14d3_d54f_4f94_882c_7383af593820.slice/crio-d44a71fdc9928906544bcbfa19ac10374e09e0ac97dc04e591a9b5bcb2d6dd36 WatchSource:0}: Error finding container d44a71fdc9928906544bcbfa19ac10374e09e0ac97dc04e591a9b5bcb2d6dd36: Status 404 returned error can't find the container with id d44a71fdc9928906544bcbfa19ac10374e09e0ac97dc04e591a9b5bcb2d6dd36
Sep 05 06:50:37.235241 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:37.235203    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-8083-f201df" event={"ID":"4bbb14d3-d54f-4f94-882c-7383af593820","Type":"ContainerStarted","Data":"d44a71fdc9928906544bcbfa19ac10374e09e0ac97dc04e591a9b5bcb2d6dd36"}
Sep 05 06:50:37.236866 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:37.236841    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-8083-46ca5e"
Sep 05 06:50:37.237054 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:37.236864    2567 scope.go:117] "RemoveContainer" containerID="6d67df9bf0cb9b76fcec48e5712169762c3b8f236df109e8912f63ba1507ab41"
Sep 05 06:50:38.244316 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:38.244284    2567 generic.go:356] "Generic (PLEG): container finished" podID="4bbb14d3-d54f-4f94-882c-7383af593820" containerID="f7b2e05e2c6b51fea8170147b6b5135837ec4c739313b259e590628d0136a626" exitCode=0
Sep 05 06:50:38.244770 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:38.244356    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-8083-f201df" event={"ID":"4bbb14d3-d54f-4f94-882c-7383af593820","Type":"ContainerDied","Data":"f7b2e05e2c6b51fea8170147b6b5135837ec4c739313b259e590628d0136a626"}
Sep 05 06:50:39.410801 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:39.410767    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-8083-f201df"
Sep 05 06:50:39.448890 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:39.448811    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-8083-f201df_4bbb14d3-d54f-4f94-882c-7383af593820/mt-curl-8083-f201df/0.log"
Sep 05 06:50:39.471938 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:39.471904    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-8083-f201df"]
Sep 05 06:50:39.475680 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:39.475653    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-8083-f201df"]
Sep 05 06:50:39.485347 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:39.485329    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmgw9\" (UniqueName: \"kubernetes.io/projected/4bbb14d3-d54f-4f94-882c-7383af593820-kube-api-access-fmgw9\") pod \"4bbb14d3-d54f-4f94-882c-7383af593820\" (UID: \"4bbb14d3-d54f-4f94-882c-7383af593820\") "
Sep 05 06:50:39.487567 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:39.487547    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bbb14d3-d54f-4f94-882c-7383af593820-kube-api-access-fmgw9" (OuterVolumeSpecName: "kube-api-access-fmgw9") pod "4bbb14d3-d54f-4f94-882c-7383af593820" (UID: "4bbb14d3-d54f-4f94-882c-7383af593820"). InnerVolumeSpecName "kube-api-access-fmgw9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:50:39.586930 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:39.586852    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmgw9\" (UniqueName: \"kubernetes.io/projected/4bbb14d3-d54f-4f94-882c-7383af593820-kube-api-access-fmgw9\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:50:40.260134 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:40.260110    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d44a71fdc9928906544bcbfa19ac10374e09e0ac97dc04e591a9b5bcb2d6dd36"
Sep 05 06:50:40.260134 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:40.260135    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-8083-f201df"
Sep 05 06:50:40.270247 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:50:40.270222    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-8083-f201df\" is forbidden: User \"system:node:ip-10-0-141-49.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-49.ec2.internal' and this object" podUID="4bbb14d3-d54f-4f94-882c-7383af593820" pod="opendatahub/mt-curl-8083-f201df"
Sep 05 06:50:40.581496 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:40.581419    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bbb14d3-d54f-4f94-882c-7383af593820" path="/var/lib/kubelet/pods/4bbb14d3-d54f-4f94-882c-7383af593820/volumes"
Sep 05 06:50:48.303395 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:48.303363    2567 generic.go:356] "Generic (PLEG): container finished" podID="044641ba-be42-40b2-a4df-ce4abc81f84e" containerID="a4752cfabd8c8680053fb53601e01402e0d2ebe387eb19c65cadee8ef159469a" exitCode=0
Sep 05 06:50:48.303937 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:48.303422    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr" event={"ID":"044641ba-be42-40b2-a4df-ce4abc81f84e","Type":"ContainerDied","Data":"a4752cfabd8c8680053fb53601e01402e0d2ebe387eb19c65cadee8ef159469a"}
Sep 05 06:50:48.304013 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:48.303935    2567 scope.go:117] "RemoveContainer" containerID="a4752cfabd8c8680053fb53601e01402e0d2ebe387eb19c65cadee8ef159469a"
Sep 05 06:50:48.305170 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:48.305141    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:50:48.305238 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:48.305209    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:50:48.305279 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:48.305240    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:50:49.310388 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:49.310355    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr" event={"ID":"044641ba-be42-40b2-a4df-ce4abc81f84e","Type":"ContainerStarted","Data":"742df382930c4eda6175569be1b6359789f7c73369f84ab5c24e1083565ee0d8"}
Sep 05 06:50:49.844211 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:49.844162    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:50:49.844433 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:49.844332    2567 patch_prober.go:28] interesting pod/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 05 06:50:49.844433 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:49.844386    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr" podUID="044641ba-be42-40b2-a4df-ce4abc81f84e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 05 06:50:50.847427 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:50.847389    2567 patch_prober.go:28] interesting pod/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 05 06:50:50.847981 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:50.847949    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr" podUID="044641ba-be42-40b2-a4df-ce4abc81f84e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 05 06:50:51.843932 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:51.843885    2567 patch_prober.go:28] interesting pod/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 05 06:50:51.844162 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:51.843970    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr" podUID="044641ba-be42-40b2-a4df-ce4abc81f84e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 05 06:50:52.844335 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:52.844292    2567 patch_prober.go:28] interesting pod/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 05 06:50:52.844837 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:52.844359    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr" podUID="044641ba-be42-40b2-a4df-ce4abc81f84e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 05 06:50:53.844365 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:53.844322    2567 patch_prober.go:28] interesting pod/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 05 06:50:53.844876 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:53.844389    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr" podUID="044641ba-be42-40b2-a4df-ce4abc81f84e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 05 06:50:53.930777 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:53.930744    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"]
Sep 05 06:50:53.935053 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:53.931632    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bbb14d3-d54f-4f94-882c-7383af593820" containerName="mt-curl-8083-f201df"
Sep 05 06:50:53.943100 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:53.943079    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bbb14d3-d54f-4f94-882c-7383af593820" containerName="mt-curl-8083-f201df"
Sep 05 06:50:53.943386 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:53.943372    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bbb14d3-d54f-4f94-882c-7383af593820" containerName="mt-curl-8083-f201df"
Sep 05 06:50:53.955929 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:53.955906    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"]
Sep 05 06:50:53.956214 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:53.956198    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:50:53.959217 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:53.959195    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-d91c81-openshift-default-dockercfg-bfzbh\""
Sep 05 06:50:54.056858 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:54.056824    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-istiod-ca-cert\") pod \"e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd\" (UID: \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\") " pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:50:54.057020 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:54.056919    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-workload-certs\") pod \"e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd\" (UID: \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\") " pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:50:54.057020 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:54.056972    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-credential-socket\") pod \"e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd\" (UID: \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\") " pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:50:54.057020 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:54.056998    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-istio-podinfo\") pod \"e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd\" (UID: \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\") " pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:50:54.057020 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:54.057016    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-istio-token\") pod \"e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd\" (UID: \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\") " pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:50:54.057192 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:54.057117    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v24zj\" (UniqueName: \"kubernetes.io/projected/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-kube-api-access-v24zj\") pod \"e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd\" (UID: \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\") " pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:50:54.057192 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:54.057154    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-workload-socket\") pod \"e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd\" (UID: \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\") " pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:50:54.057192 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:54.057169    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-istio-data\") pod \"e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd\" (UID: \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\") " pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:50:54.057192 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:54.057190    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-istio-envoy\") pod \"e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd\" (UID: \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\") " pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:50:54.158271 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:54.158170    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v24zj\" (UniqueName: \"kubernetes.io/projected/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-kube-api-access-v24zj\") pod \"e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd\" (UID: \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\") " pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:50:54.158539 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:54.158511    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-workload-socket\") pod \"e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd\" (UID: \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\") " pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:50:54.158682 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:54.158665    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-istio-data\") pod \"e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd\" (UID: \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\") " pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:50:54.158788 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:54.158775    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-istio-envoy\") pod \"e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd\" (UID: \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\") " pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:50:54.158933 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:54.158916    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-istiod-ca-cert\") pod \"e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd\" (UID: \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\") " pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:50:54.159083 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:54.159057    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-workload-socket\") pod \"e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd\" (UID: \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\") " pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:50:54.159257 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:54.159124    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-workload-certs\") pod \"e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd\" (UID: \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\") " pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:50:54.159433 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:54.159410    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-workload-certs\") pod \"e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd\" (UID: \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\") " pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:50:54.159510 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:54.159417    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-credential-socket\") pod \"e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd\" (UID: \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\") " pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:50:54.159888 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:54.159866    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-credential-socket\") pod \"e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd\" (UID: \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\") " pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:50:54.160102 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:54.160082    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-istio-podinfo\") pod \"e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd\" (UID: \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\") " pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:50:54.160242 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:54.160226    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-istio-token\") pod \"e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd\" (UID: \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\") " pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:50:54.160897 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:54.160876    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-istio-data\") pod \"e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd\" (UID: \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\") " pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:50:54.162649 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:54.162624    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-istiod-ca-cert\") pod \"e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd\" (UID: \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\") " pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:50:54.170018 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:54.169994    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v24zj\" (UniqueName: \"kubernetes.io/projected/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-kube-api-access-v24zj\") pod \"e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd\" (UID: \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\") " pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:50:54.171533 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:54.171490    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-istio-token\") pod \"e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd\" (UID: \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\") " pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:50:54.175695 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:54.175649    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-istio-envoy\") pod \"e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd\" (UID: \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\") " pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:50:54.177527 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:54.177506    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-istio-podinfo\") pod \"e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd\" (UID: \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\") " pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:50:54.269743 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:54.269707    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:50:54.549926 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:54.549893    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"]
Sep 05 06:50:54.551142 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:50:54.551093    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddadcbc13_6133_4c82_8c22_dfc4d71d4af9.slice/crio-e98d7b2e48f1f1b7fab403c29b5915dfc358bec2319542a3e1b03f8d65c80d61 WatchSource:0}: Error finding container e98d7b2e48f1f1b7fab403c29b5915dfc358bec2319542a3e1b03f8d65c80d61: Status 404 returned error can't find the container with id e98d7b2e48f1f1b7fab403c29b5915dfc358bec2319542a3e1b03f8d65c80d61
Sep 05 06:50:54.553934 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:54.553887    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:50:54.554066 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:54.553984    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:50:54.554066 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:54.554053    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:50:54.849016 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:54.848881    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:50:54.849408 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:54.849350    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:50:54.850270 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:54.850248    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:50:55.358880 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:55.358827    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd" event={"ID":"dadcbc13-6133-4c82-8c22-dfc4d71d4af9","Type":"ContainerStarted","Data":"cd6931c29036c4dd379ab6cef8d2766d6bf5752cd503b83b25e41bafbc2875ec"}
Sep 05 06:50:55.359134 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:55.358933    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd" event={"ID":"dadcbc13-6133-4c82-8c22-dfc4d71d4af9","Type":"ContainerStarted","Data":"e98d7b2e48f1f1b7fab403c29b5915dfc358bec2319542a3e1b03f8d65c80d61"}
Sep 05 06:50:55.384140 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:55.384050    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd" podStartSLOduration=2.384008113 podStartE2EDuration="2.384008113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:50:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:50:55.382215485 +0000 UTC m=+1521.355970348" watchObservedRunningTime="2026-09-05 06:50:55.384008113 +0000 UTC m=+1521.357762793"
Sep 05 06:50:56.270600 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:56.270564    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:50:56.275898 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:56.275872    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:50:56.364542 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:56.364512    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:50:56.365441 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:50:56.365419    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:51:12.407201 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:12.407154    2567 patch_prober.go:28] interesting pod/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 05 06:51:12.407589 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:12.407237    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd" podUID="dadcbc13-6133-4c82-8c22-dfc4d71d4af9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 05 06:51:14.470479 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:14.470446    2567 generic.go:356] "Generic (PLEG): container finished" podID="dadcbc13-6133-4c82-8c22-dfc4d71d4af9" containerID="cd6931c29036c4dd379ab6cef8d2766d6bf5752cd503b83b25e41bafbc2875ec" exitCode=0
Sep 05 06:51:14.470966 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:14.470518    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd" event={"ID":"dadcbc13-6133-4c82-8c22-dfc4d71d4af9","Type":"ContainerDied","Data":"cd6931c29036c4dd379ab6cef8d2766d6bf5752cd503b83b25e41bafbc2875ec"}
Sep 05 06:51:14.470966 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:14.470924    2567 scope.go:117] "RemoveContainer" containerID="cd6931c29036c4dd379ab6cef8d2766d6bf5752cd503b83b25e41bafbc2875ec"
Sep 05 06:51:14.472165 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:14.472137    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:51:14.472221 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:14.472205    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:51:14.472259 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:14.472248    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:51:15.477855 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:15.477819    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd" event={"ID":"dadcbc13-6133-4c82-8c22-dfc4d71d4af9","Type":"ContainerStarted","Data":"c252fef417ecee7911d5d97e3d0204fe1139e57c68b01756dc5a16fcf65f7530"}
Sep 05 06:51:16.270362 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:16.270327    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:51:16.270549 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:16.270521    2567 patch_prober.go:28] interesting pod/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 05 06:51:16.270604 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:16.270569    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd" podUID="dadcbc13-6133-4c82-8c22-dfc4d71d4af9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 05 06:51:17.270408 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:17.270372    2567 patch_prober.go:28] interesting pod/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 05 06:51:17.270837 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:17.270436    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd" podUID="dadcbc13-6133-4c82-8c22-dfc4d71d4af9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 05 06:51:18.270905 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:18.270871    2567 patch_prober.go:28] interesting pod/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 05 06:51:18.271306 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:18.270926    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd" podUID="dadcbc13-6133-4c82-8c22-dfc4d71d4af9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 05 06:51:19.270773 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:19.270305    2567 patch_prober.go:28] interesting pod/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 05 06:51:19.270773 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:19.270393    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd" podUID="dadcbc13-6133-4c82-8c22-dfc4d71d4af9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 05 06:51:20.271118 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:20.271083    2567 patch_prober.go:28] interesting pod/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 05 06:51:20.271493 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:20.271137    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd" podUID="dadcbc13-6133-4c82-8c22-dfc4d71d4af9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 05 06:51:21.274124 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:21.274083    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:51:21.274629 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:21.274499    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:51:21.275147 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:21.275125    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:51:22.200464 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:22.200426    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn"]
Sep 05 06:51:22.203067 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:22.203050    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn"
Sep 05 06:51:22.205986 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:22.205963    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-5b1d24\"/\"openshift-service-ca.crt\""
Sep 05 06:51:22.206150 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:22.205970    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-5b1d24\"/\"kube-root-ca.crt\""
Sep 05 06:51:22.206989 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:22.206967    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-5b1d24\"/\"default-dockercfg-b4rwk\""
Sep 05 06:51:22.207133 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:22.207007    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-5b1d24\"/\"rate-test-model-5b1d24-kserve-self-signed-certs\""
Sep 05 06:51:22.236730 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:22.236701    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn"]
Sep 05 06:51:22.354657 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:22.354630    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26c85c45-b808-4cb6-8047-ba3b36b598f6-tmp-dir\") pod \"rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn\" (UID: \"26c85c45-b808-4cb6-8047-ba3b36b598f6\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn"
Sep 05 06:51:22.354963 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:22.354686    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26c85c45-b808-4cb6-8047-ba3b36b598f6-model-cache\") pod \"rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn\" (UID: \"26c85c45-b808-4cb6-8047-ba3b36b598f6\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn"
Sep 05 06:51:22.354963 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:22.354706    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26c85c45-b808-4cb6-8047-ba3b36b598f6-tls-certs\") pod \"rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn\" (UID: \"26c85c45-b808-4cb6-8047-ba3b36b598f6\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn"
Sep 05 06:51:22.354963 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:22.354726    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26c85c45-b808-4cb6-8047-ba3b36b598f6-home\") pod \"rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn\" (UID: \"26c85c45-b808-4cb6-8047-ba3b36b598f6\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn"
Sep 05 06:51:22.354963 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:22.354740    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26c85c45-b808-4cb6-8047-ba3b36b598f6-dshm\") pod \"rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn\" (UID: \"26c85c45-b808-4cb6-8047-ba3b36b598f6\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn"
Sep 05 06:51:22.354963 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:22.354758    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjctv\" (UniqueName: \"kubernetes.io/projected/26c85c45-b808-4cb6-8047-ba3b36b598f6-kube-api-access-sjctv\") pod \"rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn\" (UID: \"26c85c45-b808-4cb6-8047-ba3b36b598f6\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn"
Sep 05 06:51:22.455993 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:22.455907    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26c85c45-b808-4cb6-8047-ba3b36b598f6-model-cache\") pod \"rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn\" (UID: \"26c85c45-b808-4cb6-8047-ba3b36b598f6\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn"
Sep 05 06:51:22.455993 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:22.455945    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26c85c45-b808-4cb6-8047-ba3b36b598f6-tls-certs\") pod \"rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn\" (UID: \"26c85c45-b808-4cb6-8047-ba3b36b598f6\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn"
Sep 05 06:51:22.455993 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:22.455982    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26c85c45-b808-4cb6-8047-ba3b36b598f6-home\") pod \"rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn\" (UID: \"26c85c45-b808-4cb6-8047-ba3b36b598f6\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn"
Sep 05 06:51:22.456318 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:22.456005    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26c85c45-b808-4cb6-8047-ba3b36b598f6-dshm\") pod \"rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn\" (UID: \"26c85c45-b808-4cb6-8047-ba3b36b598f6\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn"
Sep 05 06:51:22.456318 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:22.456168    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjctv\" (UniqueName: \"kubernetes.io/projected/26c85c45-b808-4cb6-8047-ba3b36b598f6-kube-api-access-sjctv\") pod \"rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn\" (UID: \"26c85c45-b808-4cb6-8047-ba3b36b598f6\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn"
Sep 05 06:51:22.456427 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:22.456334    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26c85c45-b808-4cb6-8047-ba3b36b598f6-tmp-dir\") pod \"rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn\" (UID: \"26c85c45-b808-4cb6-8047-ba3b36b598f6\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn"
Sep 05 06:51:22.456427 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:22.456369    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26c85c45-b808-4cb6-8047-ba3b36b598f6-model-cache\") pod \"rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn\" (UID: \"26c85c45-b808-4cb6-8047-ba3b36b598f6\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn"
Sep 05 06:51:22.456427 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:22.456400    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26c85c45-b808-4cb6-8047-ba3b36b598f6-home\") pod \"rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn\" (UID: \"26c85c45-b808-4cb6-8047-ba3b36b598f6\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn"
Sep 05 06:51:22.456616 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:22.456587    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26c85c45-b808-4cb6-8047-ba3b36b598f6-tmp-dir\") pod \"rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn\" (UID: \"26c85c45-b808-4cb6-8047-ba3b36b598f6\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn"
Sep 05 06:51:22.458427 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:22.458407    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26c85c45-b808-4cb6-8047-ba3b36b598f6-dshm\") pod \"rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn\" (UID: \"26c85c45-b808-4cb6-8047-ba3b36b598f6\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn"
Sep 05 06:51:22.458670 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:22.458655    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26c85c45-b808-4cb6-8047-ba3b36b598f6-tls-certs\") pod \"rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn\" (UID: \"26c85c45-b808-4cb6-8047-ba3b36b598f6\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn"
Sep 05 06:51:22.465925 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:22.465904    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjctv\" (UniqueName: \"kubernetes.io/projected/26c85c45-b808-4cb6-8047-ba3b36b598f6-kube-api-access-sjctv\") pod \"rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn\" (UID: \"26c85c45-b808-4cb6-8047-ba3b36b598f6\") " pod="ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn"
Sep 05 06:51:22.511905 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:22.511882    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn"
Sep 05 06:51:22.788176 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:22.788150    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn"]
Sep 05 06:51:22.789810 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:51:22.789787    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26c85c45_b808_4cb6_8047_ba3b36b598f6.slice/crio-9b0c0bc69b07cf13614a4e1224cd10bd1a33713e0a42f8a454e2e746f13291a0 WatchSource:0}: Error finding container 9b0c0bc69b07cf13614a4e1224cd10bd1a33713e0a42f8a454e2e746f13291a0: Status 404 returned error can't find the container with id 9b0c0bc69b07cf13614a4e1224cd10bd1a33713e0a42f8a454e2e746f13291a0
Sep 05 06:51:23.524940 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:23.524906    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn" event={"ID":"26c85c45-b808-4cb6-8047-ba3b36b598f6","Type":"ContainerStarted","Data":"c5f570de4cf00b474b2e7ba6e02c067bb7c45e1a46d97d878a66698eac41ad89"}
Sep 05 06:51:23.525314 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:23.524948    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn" event={"ID":"26c85c45-b808-4cb6-8047-ba3b36b598f6","Type":"ContainerStarted","Data":"9b0c0bc69b07cf13614a4e1224cd10bd1a33713e0a42f8a454e2e746f13291a0"}
Sep 05 06:51:23.543435 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:23.543389    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn" podStartSLOduration=1.543374848 podStartE2EDuration="1.543374848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:51:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:51:23.542262945 +0000 UTC m=+1549.516017630" watchObservedRunningTime="2026-09-05 06:51:23.543374848 +0000 UTC m=+1549.517129531"
Sep 05 06:51:32.512969 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:32.512934    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn"
Sep 05 06:51:32.513387 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:32.513021    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn"
Sep 05 06:51:32.525271 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:32.525247    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn"
Sep 05 06:51:32.586397 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:32.586371    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn"
Sep 05 06:51:47.851709 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:47.851668    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"]
Sep 05 06:51:47.852243 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:47.851941    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr" podUID="044641ba-be42-40b2-a4df-ce4abc81f84e" containerName="istio-proxy" containerID="cri-o://742df382930c4eda6175569be1b6359789f7c73369f84ab5c24e1083565ee0d8" gracePeriod=30
Sep 05 06:51:53.105230 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.105206    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:51:53.139240 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.139182    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/044641ba-be42-40b2-a4df-ce4abc81f84e-istio-envoy\") pod \"044641ba-be42-40b2-a4df-ce4abc81f84e\" (UID: \"044641ba-be42-40b2-a4df-ce4abc81f84e\") "
Sep 05 06:51:53.139240 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.139214    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/044641ba-be42-40b2-a4df-ce4abc81f84e-istio-token\") pod \"044641ba-be42-40b2-a4df-ce4abc81f84e\" (UID: \"044641ba-be42-40b2-a4df-ce4abc81f84e\") "
Sep 05 06:51:53.139434 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.139251    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/044641ba-be42-40b2-a4df-ce4abc81f84e-credential-socket\") pod \"044641ba-be42-40b2-a4df-ce4abc81f84e\" (UID: \"044641ba-be42-40b2-a4df-ce4abc81f84e\") "
Sep 05 06:51:53.139434 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.139277    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/044641ba-be42-40b2-a4df-ce4abc81f84e-istio-podinfo\") pod \"044641ba-be42-40b2-a4df-ce4abc81f84e\" (UID: \"044641ba-be42-40b2-a4df-ce4abc81f84e\") "
Sep 05 06:51:53.139434 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.139390    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/044641ba-be42-40b2-a4df-ce4abc81f84e-istio-data\") pod \"044641ba-be42-40b2-a4df-ce4abc81f84e\" (UID: \"044641ba-be42-40b2-a4df-ce4abc81f84e\") "
Sep 05 06:51:53.139600 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.139463    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/044641ba-be42-40b2-a4df-ce4abc81f84e-istiod-ca-cert\") pod \"044641ba-be42-40b2-a4df-ce4abc81f84e\" (UID: \"044641ba-be42-40b2-a4df-ce4abc81f84e\") "
Sep 05 06:51:53.139600 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.139533    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/044641ba-be42-40b2-a4df-ce4abc81f84e-workload-certs\") pod \"044641ba-be42-40b2-a4df-ce4abc81f84e\" (UID: \"044641ba-be42-40b2-a4df-ce4abc81f84e\") "
Sep 05 06:51:53.139600 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.139559    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nk8zq\" (UniqueName: \"kubernetes.io/projected/044641ba-be42-40b2-a4df-ce4abc81f84e-kube-api-access-nk8zq\") pod \"044641ba-be42-40b2-a4df-ce4abc81f84e\" (UID: \"044641ba-be42-40b2-a4df-ce4abc81f84e\") "
Sep 05 06:51:53.139600 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.139594    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/044641ba-be42-40b2-a4df-ce4abc81f84e-workload-socket\") pod \"044641ba-be42-40b2-a4df-ce4abc81f84e\" (UID: \"044641ba-be42-40b2-a4df-ce4abc81f84e\") "
Sep 05 06:51:53.140150 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.139565    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/044641ba-be42-40b2-a4df-ce4abc81f84e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "044641ba-be42-40b2-a4df-ce4abc81f84e" (UID: "044641ba-be42-40b2-a4df-ce4abc81f84e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:51:53.140150 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.139637    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/044641ba-be42-40b2-a4df-ce4abc81f84e-istio-data" (OuterVolumeSpecName: "istio-data") pod "044641ba-be42-40b2-a4df-ce4abc81f84e" (UID: "044641ba-be42-40b2-a4df-ce4abc81f84e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:51:53.140150 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.139773    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/044641ba-be42-40b2-a4df-ce4abc81f84e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "044641ba-be42-40b2-a4df-ce4abc81f84e" (UID: "044641ba-be42-40b2-a4df-ce4abc81f84e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:51:53.140394 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.140151    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/044641ba-be42-40b2-a4df-ce4abc81f84e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "044641ba-be42-40b2-a4df-ce4abc81f84e" (UID: "044641ba-be42-40b2-a4df-ce4abc81f84e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:51:53.140394 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.140252    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/044641ba-be42-40b2-a4df-ce4abc81f84e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "044641ba-be42-40b2-a4df-ce4abc81f84e" (UID: "044641ba-be42-40b2-a4df-ce4abc81f84e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:51:53.141713 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.141686    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/044641ba-be42-40b2-a4df-ce4abc81f84e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "044641ba-be42-40b2-a4df-ce4abc81f84e" (UID: "044641ba-be42-40b2-a4df-ce4abc81f84e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:51:53.141821 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.141688    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/044641ba-be42-40b2-a4df-ce4abc81f84e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "044641ba-be42-40b2-a4df-ce4abc81f84e" (UID: "044641ba-be42-40b2-a4df-ce4abc81f84e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 05 06:51:53.142134 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.142111    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/044641ba-be42-40b2-a4df-ce4abc81f84e-istio-token" (OuterVolumeSpecName: "istio-token") pod "044641ba-be42-40b2-a4df-ce4abc81f84e" (UID: "044641ba-be42-40b2-a4df-ce4abc81f84e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:51:53.142265 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.142246    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/044641ba-be42-40b2-a4df-ce4abc81f84e-kube-api-access-nk8zq" (OuterVolumeSpecName: "kube-api-access-nk8zq") pod "044641ba-be42-40b2-a4df-ce4abc81f84e" (UID: "044641ba-be42-40b2-a4df-ce4abc81f84e"). InnerVolumeSpecName "kube-api-access-nk8zq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:51:53.241316 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.241291    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/044641ba-be42-40b2-a4df-ce4abc81f84e-istio-envoy\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:51:53.241316 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.241314    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/044641ba-be42-40b2-a4df-ce4abc81f84e-istio-token\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:51:53.241447 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.241323    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/044641ba-be42-40b2-a4df-ce4abc81f84e-credential-socket\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:51:53.241447 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.241331    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/044641ba-be42-40b2-a4df-ce4abc81f84e-istio-podinfo\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:51:53.241447 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.241340    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/044641ba-be42-40b2-a4df-ce4abc81f84e-istio-data\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:51:53.241447 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.241347    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/044641ba-be42-40b2-a4df-ce4abc81f84e-istiod-ca-cert\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:51:53.241447 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.241356    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/044641ba-be42-40b2-a4df-ce4abc81f84e-workload-certs\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:51:53.241447 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.241364    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nk8zq\" (UniqueName: \"kubernetes.io/projected/044641ba-be42-40b2-a4df-ce4abc81f84e-kube-api-access-nk8zq\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:51:53.241447 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.241372    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/044641ba-be42-40b2-a4df-ce4abc81f84e-workload-socket\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:51:53.680699 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.680674    2567 generic.go:356] "Generic (PLEG): container finished" podID="044641ba-be42-40b2-a4df-ce4abc81f84e" containerID="742df382930c4eda6175569be1b6359789f7c73369f84ab5c24e1083565ee0d8" exitCode=0
Sep 05 06:51:53.680835 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.680721    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"
Sep 05 06:51:53.680835 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.680766    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr" event={"ID":"044641ba-be42-40b2-a4df-ce4abc81f84e","Type":"ContainerDied","Data":"742df382930c4eda6175569be1b6359789f7c73369f84ab5c24e1083565ee0d8"}
Sep 05 06:51:53.680835 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.680817    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr" event={"ID":"044641ba-be42-40b2-a4df-ce4abc81f84e","Type":"ContainerDied","Data":"cc7c08abb03046506453a02bffdef251289c2f8d30e54b6975115f2bc972050e"}
Sep 05 06:51:53.680947 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.680840    2567 scope.go:117] "RemoveContainer" containerID="742df382930c4eda6175569be1b6359789f7c73369f84ab5c24e1083565ee0d8"
Sep 05 06:51:53.691111 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.691096    2567 scope.go:117] "RemoveContainer" containerID="a4752cfabd8c8680053fb53601e01402e0d2ebe387eb19c65cadee8ef159469a"
Sep 05 06:51:53.700102 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.700083    2567 scope.go:117] "RemoveContainer" containerID="742df382930c4eda6175569be1b6359789f7c73369f84ab5c24e1083565ee0d8"
Sep 05 06:51:53.700515 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:51:53.700479    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"742df382930c4eda6175569be1b6359789f7c73369f84ab5c24e1083565ee0d8\": container with ID starting with 742df382930c4eda6175569be1b6359789f7c73369f84ab5c24e1083565ee0d8 not found: ID does not exist" containerID="742df382930c4eda6175569be1b6359789f7c73369f84ab5c24e1083565ee0d8"
Sep 05 06:51:53.700628 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.700515    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"742df382930c4eda6175569be1b6359789f7c73369f84ab5c24e1083565ee0d8"} err="failed to get container status \"742df382930c4eda6175569be1b6359789f7c73369f84ab5c24e1083565ee0d8\": rpc error: code = NotFound desc = could not find container \"742df382930c4eda6175569be1b6359789f7c73369f84ab5c24e1083565ee0d8\": container with ID starting with 742df382930c4eda6175569be1b6359789f7c73369f84ab5c24e1083565ee0d8 not found: ID does not exist"
Sep 05 06:51:53.700628 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.700547    2567 scope.go:117] "RemoveContainer" containerID="a4752cfabd8c8680053fb53601e01402e0d2ebe387eb19c65cadee8ef159469a"
Sep 05 06:51:53.700986 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:51:53.700962    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4752cfabd8c8680053fb53601e01402e0d2ebe387eb19c65cadee8ef159469a\": container with ID starting with a4752cfabd8c8680053fb53601e01402e0d2ebe387eb19c65cadee8ef159469a not found: ID does not exist" containerID="a4752cfabd8c8680053fb53601e01402e0d2ebe387eb19c65cadee8ef159469a"
Sep 05 06:51:53.701131 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.700994    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4752cfabd8c8680053fb53601e01402e0d2ebe387eb19c65cadee8ef159469a"} err="failed to get container status \"a4752cfabd8c8680053fb53601e01402e0d2ebe387eb19c65cadee8ef159469a\": rpc error: code = NotFound desc = could not find container \"a4752cfabd8c8680053fb53601e01402e0d2ebe387eb19c65cadee8ef159469a\": container with ID starting with a4752cfabd8c8680053fb53601e01402e0d2ebe387eb19c65cadee8ef159469a not found: ID does not exist"
Sep 05 06:51:53.703257 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.703237    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"]
Sep 05 06:51:53.706851 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:53.706831    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr"]
Sep 05 06:51:54.580987 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:51:54.580953    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="044641ba-be42-40b2-a4df-ce4abc81f84e" path="/var/lib/kubelet/pods/044641ba-be42-40b2-a4df-ce4abc81f84e/volumes"
Sep 05 06:52:11.542621 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:11.542583    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"]
Sep 05 06:52:11.543117 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:11.542854    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd" podUID="dadcbc13-6133-4c82-8c22-dfc4d71d4af9" containerName="istio-proxy" containerID="cri-o://c252fef417ecee7911d5d97e3d0204fe1139e57c68b01756dc5a16fcf65f7530" gracePeriod=30
Sep 05 06:52:13.348573 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:13.348540    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn"]
Sep 05 06:52:16.791039 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:16.791002    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:52:16.801369 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:16.801339    2567 generic.go:356] "Generic (PLEG): container finished" podID="dadcbc13-6133-4c82-8c22-dfc4d71d4af9" containerID="c252fef417ecee7911d5d97e3d0204fe1139e57c68b01756dc5a16fcf65f7530" exitCode=0
Sep 05 06:52:16.801468 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:16.801382    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"
Sep 05 06:52:16.801468 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:16.801421    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd" event={"ID":"dadcbc13-6133-4c82-8c22-dfc4d71d4af9","Type":"ContainerDied","Data":"c252fef417ecee7911d5d97e3d0204fe1139e57c68b01756dc5a16fcf65f7530"}
Sep 05 06:52:16.801569 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:16.801473    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd" event={"ID":"dadcbc13-6133-4c82-8c22-dfc4d71d4af9","Type":"ContainerDied","Data":"e98d7b2e48f1f1b7fab403c29b5915dfc358bec2319542a3e1b03f8d65c80d61"}
Sep 05 06:52:16.801569 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:16.801496    2567 scope.go:117] "RemoveContainer" containerID="c252fef417ecee7911d5d97e3d0204fe1139e57c68b01756dc5a16fcf65f7530"
Sep 05 06:52:16.810497 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:16.810470    2567 scope.go:117] "RemoveContainer" containerID="cd6931c29036c4dd379ab6cef8d2766d6bf5752cd503b83b25e41bafbc2875ec"
Sep 05 06:52:16.820554 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:16.820534    2567 scope.go:117] "RemoveContainer" containerID="c252fef417ecee7911d5d97e3d0204fe1139e57c68b01756dc5a16fcf65f7530"
Sep 05 06:52:16.820919 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:52:16.820889    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c252fef417ecee7911d5d97e3d0204fe1139e57c68b01756dc5a16fcf65f7530\": container with ID starting with c252fef417ecee7911d5d97e3d0204fe1139e57c68b01756dc5a16fcf65f7530 not found: ID does not exist" containerID="c252fef417ecee7911d5d97e3d0204fe1139e57c68b01756dc5a16fcf65f7530"
Sep 05 06:52:16.820988 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:16.820924    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c252fef417ecee7911d5d97e3d0204fe1139e57c68b01756dc5a16fcf65f7530"} err="failed to get container status \"c252fef417ecee7911d5d97e3d0204fe1139e57c68b01756dc5a16fcf65f7530\": rpc error: code = NotFound desc = could not find container \"c252fef417ecee7911d5d97e3d0204fe1139e57c68b01756dc5a16fcf65f7530\": container with ID starting with c252fef417ecee7911d5d97e3d0204fe1139e57c68b01756dc5a16fcf65f7530 not found: ID does not exist"
Sep 05 06:52:16.820988 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:16.820940    2567 scope.go:117] "RemoveContainer" containerID="cd6931c29036c4dd379ab6cef8d2766d6bf5752cd503b83b25e41bafbc2875ec"
Sep 05 06:52:16.821249 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:52:16.821230    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd6931c29036c4dd379ab6cef8d2766d6bf5752cd503b83b25e41bafbc2875ec\": container with ID starting with cd6931c29036c4dd379ab6cef8d2766d6bf5752cd503b83b25e41bafbc2875ec not found: ID does not exist" containerID="cd6931c29036c4dd379ab6cef8d2766d6bf5752cd503b83b25e41bafbc2875ec"
Sep 05 06:52:16.821313 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:16.821253    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd6931c29036c4dd379ab6cef8d2766d6bf5752cd503b83b25e41bafbc2875ec"} err="failed to get container status \"cd6931c29036c4dd379ab6cef8d2766d6bf5752cd503b83b25e41bafbc2875ec\": rpc error: code = NotFound desc = could not find container \"cd6931c29036c4dd379ab6cef8d2766d6bf5752cd503b83b25e41bafbc2875ec\": container with ID starting with cd6931c29036c4dd379ab6cef8d2766d6bf5752cd503b83b25e41bafbc2875ec not found: ID does not exist"
Sep 05 06:52:16.961250 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:16.961227    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-istio-token\") pod \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\" (UID: \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\") "
Sep 05 06:52:16.961348 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:16.961267    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-istio-envoy\") pod \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\" (UID: \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\") "
Sep 05 06:52:16.961348 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:16.961308    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-credential-socket\") pod \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\" (UID: \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\") "
Sep 05 06:52:16.961348 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:16.961331    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v24zj\" (UniqueName: \"kubernetes.io/projected/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-kube-api-access-v24zj\") pod \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\" (UID: \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\") "
Sep 05 06:52:16.961459 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:16.961354    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-istio-data\") pod \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\" (UID: \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\") "
Sep 05 06:52:16.961459 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:16.961371    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-istio-podinfo\") pod \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\" (UID: \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\") "
Sep 05 06:52:16.961459 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:16.961402    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-istiod-ca-cert\") pod \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\" (UID: \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\") "
Sep 05 06:52:16.961459 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:16.961436    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-workload-certs\") pod \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\" (UID: \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\") "
Sep 05 06:52:16.961654 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:16.961486    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-workload-socket\") pod \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\" (UID: \"dadcbc13-6133-4c82-8c22-dfc4d71d4af9\") "
Sep 05 06:52:16.961711 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:16.961692    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-istio-data" (OuterVolumeSpecName: "istio-data") pod "dadcbc13-6133-4c82-8c22-dfc4d71d4af9" (UID: "dadcbc13-6133-4c82-8c22-dfc4d71d4af9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:52:16.961921 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:16.961901    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-istio-data\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:52:16.962007 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:16.961928    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dadcbc13-6133-4c82-8c22-dfc4d71d4af9" (UID: "dadcbc13-6133-4c82-8c22-dfc4d71d4af9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:52:16.962007 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:16.961893    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dadcbc13-6133-4c82-8c22-dfc4d71d4af9" (UID: "dadcbc13-6133-4c82-8c22-dfc4d71d4af9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:52:16.962007 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:16.961987    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dadcbc13-6133-4c82-8c22-dfc4d71d4af9" (UID: "dadcbc13-6133-4c82-8c22-dfc4d71d4af9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:52:16.962380 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:16.962121    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dadcbc13-6133-4c82-8c22-dfc4d71d4af9" (UID: "dadcbc13-6133-4c82-8c22-dfc4d71d4af9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:52:16.963580 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:16.963557    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-istio-token" (OuterVolumeSpecName: "istio-token") pod "dadcbc13-6133-4c82-8c22-dfc4d71d4af9" (UID: "dadcbc13-6133-4c82-8c22-dfc4d71d4af9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:52:16.963823 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:16.963802    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-kube-api-access-v24zj" (OuterVolumeSpecName: "kube-api-access-v24zj") pod "dadcbc13-6133-4c82-8c22-dfc4d71d4af9" (UID: "dadcbc13-6133-4c82-8c22-dfc4d71d4af9"). InnerVolumeSpecName "kube-api-access-v24zj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:52:16.964107 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:16.964085    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dadcbc13-6133-4c82-8c22-dfc4d71d4af9" (UID: "dadcbc13-6133-4c82-8c22-dfc4d71d4af9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 05 06:52:16.964203 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:16.964106    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dadcbc13-6133-4c82-8c22-dfc4d71d4af9" (UID: "dadcbc13-6133-4c82-8c22-dfc4d71d4af9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:52:17.063068 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:17.062987    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-istio-envoy\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:52:17.063068 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:17.063007    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-credential-socket\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:52:17.063068 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:17.063018    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v24zj\" (UniqueName: \"kubernetes.io/projected/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-kube-api-access-v24zj\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:52:17.063068 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:17.063048    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-istio-podinfo\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:52:17.063068 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:17.063056    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-istiod-ca-cert\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:52:17.063068 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:17.063064    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-workload-certs\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:52:17.063068 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:17.063071    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-workload-socket\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:52:17.063354 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:17.063078    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dadcbc13-6133-4c82-8c22-dfc4d71d4af9-istio-token\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:52:17.135988 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:17.135962    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"]
Sep 05 06:52:17.139786 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:17.139763    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd"]
Sep 05 06:52:18.581897 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:18.581862    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dadcbc13-6133-4c82-8c22-dfc4d71d4af9" path="/var/lib/kubelet/pods/dadcbc13-6133-4c82-8c22-dfc4d71d4af9/volumes"
Sep 05 06:52:22.545349 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:22.545315    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh"]
Sep 05 06:52:22.545914 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:22.545583    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh" podUID="6949f799-fe1a-4171-8c05-4bd4c1e4d654" containerName="payload-processing" containerID="cri-o://af99f5f6efdf0107942b75e264106468a65c349b49f5f77430e8913fef310485" gracePeriod=30
Sep 05 06:52:22.814420 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:22.814390    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh"
Sep 05 06:52:22.834975 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:22.834944    2567 generic.go:356] "Generic (PLEG): container finished" podID="6949f799-fe1a-4171-8c05-4bd4c1e4d654" containerID="af99f5f6efdf0107942b75e264106468a65c349b49f5f77430e8913fef310485" exitCode=0
Sep 05 06:52:22.835159 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:22.835079    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh" event={"ID":"6949f799-fe1a-4171-8c05-4bd4c1e4d654","Type":"ContainerDied","Data":"af99f5f6efdf0107942b75e264106468a65c349b49f5f77430e8913fef310485"}
Sep 05 06:52:22.835238 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:22.835157    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh" event={"ID":"6949f799-fe1a-4171-8c05-4bd4c1e4d654","Type":"ContainerDied","Data":"86f084bf94310f75f5898c418c1c9d7bb87ce949a46cc2e5f5c33ae4c0a96cf2"}
Sep 05 06:52:22.835238 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:22.835189    2567 scope.go:117] "RemoveContainer" containerID="af99f5f6efdf0107942b75e264106468a65c349b49f5f77430e8913fef310485"
Sep 05 06:52:22.835346 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:22.835339    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh"
Sep 05 06:52:22.846249 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:22.846227    2567 scope.go:117] "RemoveContainer" containerID="af99f5f6efdf0107942b75e264106468a65c349b49f5f77430e8913fef310485"
Sep 05 06:52:22.846536 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:52:22.846519    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af99f5f6efdf0107942b75e264106468a65c349b49f5f77430e8913fef310485\": container with ID starting with af99f5f6efdf0107942b75e264106468a65c349b49f5f77430e8913fef310485 not found: ID does not exist" containerID="af99f5f6efdf0107942b75e264106468a65c349b49f5f77430e8913fef310485"
Sep 05 06:52:22.846591 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:22.846543    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af99f5f6efdf0107942b75e264106468a65c349b49f5f77430e8913fef310485"} err="failed to get container status \"af99f5f6efdf0107942b75e264106468a65c349b49f5f77430e8913fef310485\": rpc error: code = NotFound desc = could not find container \"af99f5f6efdf0107942b75e264106468a65c349b49f5f77430e8913fef310485\": container with ID starting with af99f5f6efdf0107942b75e264106468a65c349b49f5f77430e8913fef310485 not found: ID does not exist"
Sep 05 06:52:22.911134 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:22.911103    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfzkk\" (UniqueName: \"kubernetes.io/projected/6949f799-fe1a-4171-8c05-4bd4c1e4d654-kube-api-access-gfzkk\") pod \"6949f799-fe1a-4171-8c05-4bd4c1e4d654\" (UID: \"6949f799-fe1a-4171-8c05-4bd4c1e4d654\") "
Sep 05 06:52:22.911310 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:22.911167    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6949f799-fe1a-4171-8c05-4bd4c1e4d654-plugins-config-volume\") pod \"6949f799-fe1a-4171-8c05-4bd4c1e4d654\" (UID: \"6949f799-fe1a-4171-8c05-4bd4c1e4d654\") "
Sep 05 06:52:22.911542 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:22.911519    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6949f799-fe1a-4171-8c05-4bd4c1e4d654-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6949f799-fe1a-4171-8c05-4bd4c1e4d654" (UID: "6949f799-fe1a-4171-8c05-4bd4c1e4d654"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:52:22.913397 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:22.913371    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6949f799-fe1a-4171-8c05-4bd4c1e4d654-kube-api-access-gfzkk" (OuterVolumeSpecName: "kube-api-access-gfzkk") pod "6949f799-fe1a-4171-8c05-4bd4c1e4d654" (UID: "6949f799-fe1a-4171-8c05-4bd4c1e4d654"). InnerVolumeSpecName "kube-api-access-gfzkk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:52:23.012662 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:23.012637    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfzkk\" (UniqueName: \"kubernetes.io/projected/6949f799-fe1a-4171-8c05-4bd4c1e4d654-kube-api-access-gfzkk\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:52:23.012662 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:23.012659    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6949f799-fe1a-4171-8c05-4bd4c1e4d654-plugins-config-volume\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:52:23.156555 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:23.156529    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh"]
Sep 05 06:52:23.161960 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:23.161938    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh"]
Sep 05 06:52:24.580665 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:24.580632    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6949f799-fe1a-4171-8c05-4bd4c1e4d654" path="/var/lib/kubelet/pods/6949f799-fe1a-4171-8c05-4bd4c1e4d654/volumes"
Sep 05 06:52:28.369373 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:28.369329    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn" podUID="26c85c45-b808-4cb6-8047-ba3b36b598f6" containerName="main" containerID="cri-o://c5f570de4cf00b474b2e7ba6e02c067bb7c45e1a46d97d878a66698eac41ad89" gracePeriod=45
Sep 05 06:52:28.615669 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:28.615644    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn"
Sep 05 06:52:28.661599 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:28.661535    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26c85c45-b808-4cb6-8047-ba3b36b598f6-tmp-dir\") pod \"26c85c45-b808-4cb6-8047-ba3b36b598f6\" (UID: \"26c85c45-b808-4cb6-8047-ba3b36b598f6\") "
Sep 05 06:52:28.661599 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:28.661597    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26c85c45-b808-4cb6-8047-ba3b36b598f6-home\") pod \"26c85c45-b808-4cb6-8047-ba3b36b598f6\" (UID: \"26c85c45-b808-4cb6-8047-ba3b36b598f6\") "
Sep 05 06:52:28.661823 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:28.661684    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26c85c45-b808-4cb6-8047-ba3b36b598f6-tls-certs\") pod \"26c85c45-b808-4cb6-8047-ba3b36b598f6\" (UID: \"26c85c45-b808-4cb6-8047-ba3b36b598f6\") "
Sep 05 06:52:28.661823 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:28.661772    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjctv\" (UniqueName: \"kubernetes.io/projected/26c85c45-b808-4cb6-8047-ba3b36b598f6-kube-api-access-sjctv\") pod \"26c85c45-b808-4cb6-8047-ba3b36b598f6\" (UID: \"26c85c45-b808-4cb6-8047-ba3b36b598f6\") "
Sep 05 06:52:28.661823 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:28.661777    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26c85c45-b808-4cb6-8047-ba3b36b598f6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "26c85c45-b808-4cb6-8047-ba3b36b598f6" (UID: "26c85c45-b808-4cb6-8047-ba3b36b598f6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:52:28.661823 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:28.661819    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26c85c45-b808-4cb6-8047-ba3b36b598f6-model-cache\") pod \"26c85c45-b808-4cb6-8047-ba3b36b598f6\" (UID: \"26c85c45-b808-4cb6-8047-ba3b36b598f6\") "
Sep 05 06:52:28.662075 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:28.661818    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26c85c45-b808-4cb6-8047-ba3b36b598f6-home" (OuterVolumeSpecName: "home") pod "26c85c45-b808-4cb6-8047-ba3b36b598f6" (UID: "26c85c45-b808-4cb6-8047-ba3b36b598f6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:52:28.662075 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:28.661847    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26c85c45-b808-4cb6-8047-ba3b36b598f6-dshm\") pod \"26c85c45-b808-4cb6-8047-ba3b36b598f6\" (UID: \"26c85c45-b808-4cb6-8047-ba3b36b598f6\") "
Sep 05 06:52:28.662075 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:28.662044    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26c85c45-b808-4cb6-8047-ba3b36b598f6-model-cache" (OuterVolumeSpecName: "model-cache") pod "26c85c45-b808-4cb6-8047-ba3b36b598f6" (UID: "26c85c45-b808-4cb6-8047-ba3b36b598f6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:52:28.662221 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:28.662202    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26c85c45-b808-4cb6-8047-ba3b36b598f6-model-cache\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:52:28.662282 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:28.662228    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26c85c45-b808-4cb6-8047-ba3b36b598f6-tmp-dir\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:52:28.662282 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:28.662242    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26c85c45-b808-4cb6-8047-ba3b36b598f6-home\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:52:28.664094 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:28.664070    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26c85c45-b808-4cb6-8047-ba3b36b598f6-dshm" (OuterVolumeSpecName: "dshm") pod "26c85c45-b808-4cb6-8047-ba3b36b598f6" (UID: "26c85c45-b808-4cb6-8047-ba3b36b598f6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:52:28.664367 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:28.664349    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26c85c45-b808-4cb6-8047-ba3b36b598f6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "26c85c45-b808-4cb6-8047-ba3b36b598f6" (UID: "26c85c45-b808-4cb6-8047-ba3b36b598f6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 05 06:52:28.664440 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:28.664368    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26c85c45-b808-4cb6-8047-ba3b36b598f6-kube-api-access-sjctv" (OuterVolumeSpecName: "kube-api-access-sjctv") pod "26c85c45-b808-4cb6-8047-ba3b36b598f6" (UID: "26c85c45-b808-4cb6-8047-ba3b36b598f6"). InnerVolumeSpecName "kube-api-access-sjctv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:52:28.762755 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:28.762732    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjctv\" (UniqueName: \"kubernetes.io/projected/26c85c45-b808-4cb6-8047-ba3b36b598f6-kube-api-access-sjctv\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:52:28.762755 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:28.762752    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26c85c45-b808-4cb6-8047-ba3b36b598f6-dshm\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:52:28.762889 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:28.762761    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26c85c45-b808-4cb6-8047-ba3b36b598f6-tls-certs\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:52:28.868640 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:28.868606    2567 generic.go:356] "Generic (PLEG): container finished" podID="26c85c45-b808-4cb6-8047-ba3b36b598f6" containerID="c5f570de4cf00b474b2e7ba6e02c067bb7c45e1a46d97d878a66698eac41ad89" exitCode=0
Sep 05 06:52:28.868742 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:28.868650    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn"
Sep 05 06:52:28.868742 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:28.868686    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn" event={"ID":"26c85c45-b808-4cb6-8047-ba3b36b598f6","Type":"ContainerDied","Data":"c5f570de4cf00b474b2e7ba6e02c067bb7c45e1a46d97d878a66698eac41ad89"}
Sep 05 06:52:28.868742 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:28.868725    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn" event={"ID":"26c85c45-b808-4cb6-8047-ba3b36b598f6","Type":"ContainerDied","Data":"9b0c0bc69b07cf13614a4e1224cd10bd1a33713e0a42f8a454e2e746f13291a0"}
Sep 05 06:52:28.868742 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:28.868741    2567 scope.go:117] "RemoveContainer" containerID="c5f570de4cf00b474b2e7ba6e02c067bb7c45e1a46d97d878a66698eac41ad89"
Sep 05 06:52:28.879346 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:28.879311    2567 scope.go:117] "RemoveContainer" containerID="c5f570de4cf00b474b2e7ba6e02c067bb7c45e1a46d97d878a66698eac41ad89"
Sep 05 06:52:28.879789 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:52:28.879761    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5f570de4cf00b474b2e7ba6e02c067bb7c45e1a46d97d878a66698eac41ad89\": container with ID starting with c5f570de4cf00b474b2e7ba6e02c067bb7c45e1a46d97d878a66698eac41ad89 not found: ID does not exist" containerID="c5f570de4cf00b474b2e7ba6e02c067bb7c45e1a46d97d878a66698eac41ad89"
Sep 05 06:52:28.879870 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:28.879796    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5f570de4cf00b474b2e7ba6e02c067bb7c45e1a46d97d878a66698eac41ad89"} err="failed to get container status \"c5f570de4cf00b474b2e7ba6e02c067bb7c45e1a46d97d878a66698eac41ad89\": rpc error: code = NotFound desc = could not find container \"c5f570de4cf00b474b2e7ba6e02c067bb7c45e1a46d97d878a66698eac41ad89\": container with ID starting with c5f570de4cf00b474b2e7ba6e02c067bb7c45e1a46d97d878a66698eac41ad89 not found: ID does not exist"
Sep 05 06:52:28.890377 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:28.890354    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn"]
Sep 05 06:52:28.893844 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:28.893825    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-5b1d24/rate-test-model-5b1d24-kserve-6bd47c8d47-fg6hn"]
Sep 05 06:52:29.782897 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:29.782863    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"]
Sep 05 06:52:29.783358 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:29.783137    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd" podUID="46aaab82-0224-49e8-863a-bd51488416cf" containerName="istio-proxy" containerID="cri-o://45139d0c9498d46f554a416833e90c51d4bb1e1ad485f573e44e205b29bb1f6d" gracePeriod=30
Sep 05 06:52:30.161630 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:30.161553    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-32e859-sp2k5"]
Sep 05 06:52:30.161951 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:30.161938    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6949f799-fe1a-4171-8c05-4bd4c1e4d654" containerName="payload-processing"
Sep 05 06:52:30.161997 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:30.161953    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6949f799-fe1a-4171-8c05-4bd4c1e4d654" containerName="payload-processing"
Sep 05 06:52:30.161997 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:30.161962    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26c85c45-b808-4cb6-8047-ba3b36b598f6" containerName="main"
Sep 05 06:52:30.161997 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:30.161968    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="26c85c45-b808-4cb6-8047-ba3b36b598f6" containerName="main"
Sep 05 06:52:30.161997 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:30.161977    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dadcbc13-6133-4c82-8c22-dfc4d71d4af9" containerName="istio-proxy"
Sep 05 06:52:30.161997 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:30.161984    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="dadcbc13-6133-4c82-8c22-dfc4d71d4af9" containerName="istio-proxy"
Sep 05 06:52:30.161997 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:30.161992    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="044641ba-be42-40b2-a4df-ce4abc81f84e" containerName="istio-proxy"
Sep 05 06:52:30.162210 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:30.162012    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="044641ba-be42-40b2-a4df-ce4abc81f84e" containerName="istio-proxy"
Sep 05 06:52:30.162210 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:30.162091    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="dadcbc13-6133-4c82-8c22-dfc4d71d4af9" containerName="istio-proxy"
Sep 05 06:52:30.162210 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:30.162100    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="dadcbc13-6133-4c82-8c22-dfc4d71d4af9" containerName="istio-proxy"
Sep 05 06:52:30.162210 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:30.162108    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="26c85c45-b808-4cb6-8047-ba3b36b598f6" containerName="main"
Sep 05 06:52:30.162210 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:30.162114    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="6949f799-fe1a-4171-8c05-4bd4c1e4d654" containerName="payload-processing"
Sep 05 06:52:30.162210 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:30.162120    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="044641ba-be42-40b2-a4df-ce4abc81f84e" containerName="istio-proxy"
Sep 05 06:52:30.162210 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:30.162126    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="044641ba-be42-40b2-a4df-ce4abc81f84e" containerName="istio-proxy"
Sep 05 06:52:30.166408 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:30.166390    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-32e859-sp2k5"
Sep 05 06:52:30.169680 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:30.169659    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 05 06:52:30.170058 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:30.170009    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tlgjj\""
Sep 05 06:52:30.173551 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:30.173455    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-32e859-sp2k5"]
Sep 05 06:52:30.280437 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:30.280408    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/730dfbe2-b4a4-4cfc-b4fd-90b448544bd5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-32e859-sp2k5\" (UID: \"730dfbe2-b4a4-4cfc-b4fd-90b448544bd5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-32e859-sp2k5"
Sep 05 06:52:30.381145 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:30.381108    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/730dfbe2-b4a4-4cfc-b4fd-90b448544bd5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-32e859-sp2k5\" (UID: \"730dfbe2-b4a4-4cfc-b4fd-90b448544bd5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-32e859-sp2k5"
Sep 05 06:52:30.381845 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:30.381816    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/730dfbe2-b4a4-4cfc-b4fd-90b448544bd5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-32e859-sp2k5\" (UID: \"730dfbe2-b4a4-4cfc-b4fd-90b448544bd5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-32e859-sp2k5"
Sep 05 06:52:30.483277 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:30.483245    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-32e859-sp2k5"
Sep 05 06:52:30.581528 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:30.581493    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26c85c45-b808-4cb6-8047-ba3b36b598f6" path="/var/lib/kubelet/pods/26c85c45-b808-4cb6-8047-ba3b36b598f6/volumes"
Sep 05 06:52:30.752354 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:30.752328    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-32e859-sp2k5"]
Sep 05 06:52:30.754257 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:52:30.754228    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod730dfbe2_b4a4_4cfc_b4fd_90b448544bd5.slice/crio-3042de942c32d1cd28698da06ed3dd5af82fc4a393e6a8078b3adc97372beb17 WatchSource:0}: Error finding container 3042de942c32d1cd28698da06ed3dd5af82fc4a393e6a8078b3adc97372beb17: Status 404 returned error can't find the container with id 3042de942c32d1cd28698da06ed3dd5af82fc4a393e6a8078b3adc97372beb17
Sep 05 06:52:30.880959 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:30.880932    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-32e859-sp2k5" event={"ID":"730dfbe2-b4a4-4cfc-b4fd-90b448544bd5","Type":"ContainerStarted","Data":"3042de942c32d1cd28698da06ed3dd5af82fc4a393e6a8078b3adc97372beb17"}
Sep 05 06:52:31.887924 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:31.887883    2567 generic.go:356] "Generic (PLEG): container finished" podID="730dfbe2-b4a4-4cfc-b4fd-90b448544bd5" containerID="b666fcdabbffaab131aa45be1272feb9bd40ed7df899bdcf7011b7e46abeb3e1" exitCode=0
Sep 05 06:52:31.888336 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:31.887969    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-32e859-sp2k5" event={"ID":"730dfbe2-b4a4-4cfc-b4fd-90b448544bd5","Type":"ContainerDied","Data":"b666fcdabbffaab131aa45be1272feb9bd40ed7df899bdcf7011b7e46abeb3e1"}
Sep 05 06:52:33.026695 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:33.026669    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-32e859-sp2k5"
Sep 05 06:52:33.104686 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:33.104657    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/730dfbe2-b4a4-4cfc-b4fd-90b448544bd5-maas-api-service-ca\") pod \"730dfbe2-b4a4-4cfc-b4fd-90b448544bd5\" (UID: \"730dfbe2-b4a4-4cfc-b4fd-90b448544bd5\") "
Sep 05 06:52:33.105014 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:33.104996    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/730dfbe2-b4a4-4cfc-b4fd-90b448544bd5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "730dfbe2-b4a4-4cfc-b4fd-90b448544bd5" (UID: "730dfbe2-b4a4-4cfc-b4fd-90b448544bd5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:52:33.205530 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:33.205508    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/730dfbe2-b4a4-4cfc-b4fd-90b448544bd5-maas-api-service-ca\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:52:33.900762 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:33.900731    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-32e859-sp2k5"
Sep 05 06:52:33.900762 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:33.900749    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-32e859-sp2k5" event={"ID":"730dfbe2-b4a4-4cfc-b4fd-90b448544bd5","Type":"ContainerDied","Data":"3042de942c32d1cd28698da06ed3dd5af82fc4a393e6a8078b3adc97372beb17"}
Sep 05 06:52:33.900982 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:33.900801    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3042de942c32d1cd28698da06ed3dd5af82fc4a393e6a8078b3adc97372beb17"
Sep 05 06:52:34.908201 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:34.908168    2567 generic.go:356] "Generic (PLEG): container finished" podID="46aaab82-0224-49e8-863a-bd51488416cf" containerID="45139d0c9498d46f554a416833e90c51d4bb1e1ad485f573e44e205b29bb1f6d" exitCode=0
Sep 05 06:52:34.908517 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:34.908245    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd" event={"ID":"46aaab82-0224-49e8-863a-bd51488416cf","Type":"ContainerDied","Data":"45139d0c9498d46f554a416833e90c51d4bb1e1ad485f573e44e205b29bb1f6d"}
Sep 05 06:52:34.908517 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:34.908324    2567 scope.go:117] "RemoveContainer" containerID="9a91306e82f6411c131999d72d57d32b70acf1f00473ea0d142338f0a9cedad5"
Sep 05 06:52:35.036490 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:35.036469    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:52:35.122365 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:35.122296    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46aaab82-0224-49e8-863a-bd51488416cf-istio-data\") pod \"46aaab82-0224-49e8-863a-bd51488416cf\" (UID: \"46aaab82-0224-49e8-863a-bd51488416cf\") "
Sep 05 06:52:35.122365 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:35.122342    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46aaab82-0224-49e8-863a-bd51488416cf-workload-socket\") pod \"46aaab82-0224-49e8-863a-bd51488416cf\" (UID: \"46aaab82-0224-49e8-863a-bd51488416cf\") "
Sep 05 06:52:35.122563 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:35.122393    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46aaab82-0224-49e8-863a-bd51488416cf-istio-envoy\") pod \"46aaab82-0224-49e8-863a-bd51488416cf\" (UID: \"46aaab82-0224-49e8-863a-bd51488416cf\") "
Sep 05 06:52:35.122563 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:35.122441    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46aaab82-0224-49e8-863a-bd51488416cf-credential-socket\") pod \"46aaab82-0224-49e8-863a-bd51488416cf\" (UID: \"46aaab82-0224-49e8-863a-bd51488416cf\") "
Sep 05 06:52:35.122563 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:35.122468    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46aaab82-0224-49e8-863a-bd51488416cf-istiod-ca-cert\") pod \"46aaab82-0224-49e8-863a-bd51488416cf\" (UID: \"46aaab82-0224-49e8-863a-bd51488416cf\") "
Sep 05 06:52:35.122563 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:35.122495    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46aaab82-0224-49e8-863a-bd51488416cf-istio-token\") pod \"46aaab82-0224-49e8-863a-bd51488416cf\" (UID: \"46aaab82-0224-49e8-863a-bd51488416cf\") "
Sep 05 06:52:35.122563 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:35.122527    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46aaab82-0224-49e8-863a-bd51488416cf-istio-podinfo\") pod \"46aaab82-0224-49e8-863a-bd51488416cf\" (UID: \"46aaab82-0224-49e8-863a-bd51488416cf\") "
Sep 05 06:52:35.122828 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:35.122564    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46aaab82-0224-49e8-863a-bd51488416cf-istio-data" (OuterVolumeSpecName: "istio-data") pod "46aaab82-0224-49e8-863a-bd51488416cf" (UID: "46aaab82-0224-49e8-863a-bd51488416cf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:52:35.122828 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:35.122633    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46aaab82-0224-49e8-863a-bd51488416cf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "46aaab82-0224-49e8-863a-bd51488416cf" (UID: "46aaab82-0224-49e8-863a-bd51488416cf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:52:35.122828 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:35.122638    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46aaab82-0224-49e8-863a-bd51488416cf-workload-certs\") pod \"46aaab82-0224-49e8-863a-bd51488416cf\" (UID: \"46aaab82-0224-49e8-863a-bd51488416cf\") "
Sep 05 06:52:35.122828 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:35.122743    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46aaab82-0224-49e8-863a-bd51488416cf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "46aaab82-0224-49e8-863a-bd51488416cf" (UID: "46aaab82-0224-49e8-863a-bd51488416cf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:52:35.122828 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:35.122761    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9s2fj\" (UniqueName: \"kubernetes.io/projected/46aaab82-0224-49e8-863a-bd51488416cf-kube-api-access-9s2fj\") pod \"46aaab82-0224-49e8-863a-bd51488416cf\" (UID: \"46aaab82-0224-49e8-863a-bd51488416cf\") "
Sep 05 06:52:35.123057 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:35.122844    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46aaab82-0224-49e8-863a-bd51488416cf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "46aaab82-0224-49e8-863a-bd51488416cf" (UID: "46aaab82-0224-49e8-863a-bd51488416cf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:52:35.123057 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:35.122889    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46aaab82-0224-49e8-863a-bd51488416cf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "46aaab82-0224-49e8-863a-bd51488416cf" (UID: "46aaab82-0224-49e8-863a-bd51488416cf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:52:35.123159 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:35.123145    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46aaab82-0224-49e8-863a-bd51488416cf-workload-socket\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:52:35.123211 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:35.123165    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46aaab82-0224-49e8-863a-bd51488416cf-credential-socket\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:52:35.123211 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:35.123180    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46aaab82-0224-49e8-863a-bd51488416cf-istiod-ca-cert\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:52:35.123211 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:35.123193    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46aaab82-0224-49e8-863a-bd51488416cf-workload-certs\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:52:35.123211 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:35.123206    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46aaab82-0224-49e8-863a-bd51488416cf-istio-data\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:52:35.124753 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:35.124726    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46aaab82-0224-49e8-863a-bd51488416cf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "46aaab82-0224-49e8-863a-bd51488416cf" (UID: "46aaab82-0224-49e8-863a-bd51488416cf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:52:35.124857 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:35.124815    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/46aaab82-0224-49e8-863a-bd51488416cf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "46aaab82-0224-49e8-863a-bd51488416cf" (UID: "46aaab82-0224-49e8-863a-bd51488416cf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 05 06:52:35.125053 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:35.125002    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46aaab82-0224-49e8-863a-bd51488416cf-istio-token" (OuterVolumeSpecName: "istio-token") pod "46aaab82-0224-49e8-863a-bd51488416cf" (UID: "46aaab82-0224-49e8-863a-bd51488416cf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:52:35.125053 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:35.125015    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46aaab82-0224-49e8-863a-bd51488416cf-kube-api-access-9s2fj" (OuterVolumeSpecName: "kube-api-access-9s2fj") pod "46aaab82-0224-49e8-863a-bd51488416cf" (UID: "46aaab82-0224-49e8-863a-bd51488416cf"). InnerVolumeSpecName "kube-api-access-9s2fj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:52:35.223894 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:35.223867    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46aaab82-0224-49e8-863a-bd51488416cf-istio-envoy\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:52:35.223894 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:35.223890    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46aaab82-0224-49e8-863a-bd51488416cf-istio-token\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:52:35.223894 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:35.223898    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46aaab82-0224-49e8-863a-bd51488416cf-istio-podinfo\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:52:35.224121 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:35.223907    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9s2fj\" (UniqueName: \"kubernetes.io/projected/46aaab82-0224-49e8-863a-bd51488416cf-kube-api-access-9s2fj\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:52:35.915116 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:35.915078    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"
Sep 05 06:52:35.915116 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:35.915094    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd" event={"ID":"46aaab82-0224-49e8-863a-bd51488416cf","Type":"ContainerDied","Data":"aa46c49be93f51a4e9c0c0aa0a782bcd1c093b2d8015493adba0839a3175c593"}
Sep 05 06:52:35.915579 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:35.915171    2567 scope.go:117] "RemoveContainer" containerID="45139d0c9498d46f554a416833e90c51d4bb1e1ad485f573e44e205b29bb1f6d"
Sep 05 06:52:35.937888 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:35.937860    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"]
Sep 05 06:52:35.941764 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:35.941740    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd"]
Sep 05 06:52:36.583781 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:36.583750    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46aaab82-0224-49e8-863a-bd51488416cf" path="/var/lib/kubelet/pods/46aaab82-0224-49e8-863a-bd51488416cf/volumes"
Sep 05 06:52:40.952887 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:40.952852    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-32e859-sp2k5"]
Sep 05 06:52:40.954618 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:40.954595    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-32e859-sp2k5"]
Sep 05 06:52:42.580817 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:42.580784    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="730dfbe2-b4a4-4cfc-b4fd-90b448544bd5" path="/var/lib/kubelet/pods/730dfbe2-b4a4-4cfc-b4fd-90b448544bd5/volumes"
Sep 05 06:52:46.679128 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.679098    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"]
Sep 05 06:52:46.679490 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.679475    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46aaab82-0224-49e8-863a-bd51488416cf" containerName="istio-proxy"
Sep 05 06:52:46.679490 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.679487    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="46aaab82-0224-49e8-863a-bd51488416cf" containerName="istio-proxy"
Sep 05 06:52:46.679556 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.679501    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="730dfbe2-b4a4-4cfc-b4fd-90b448544bd5" containerName="revoke-keys"
Sep 05 06:52:46.679556 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.679506    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="730dfbe2-b4a4-4cfc-b4fd-90b448544bd5" containerName="revoke-keys"
Sep 05 06:52:46.679556 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.679516    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dadcbc13-6133-4c82-8c22-dfc4d71d4af9" containerName="istio-proxy"
Sep 05 06:52:46.679556 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.679521    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="dadcbc13-6133-4c82-8c22-dfc4d71d4af9" containerName="istio-proxy"
Sep 05 06:52:46.679556 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.679529    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="044641ba-be42-40b2-a4df-ce4abc81f84e" containerName="istio-proxy"
Sep 05 06:52:46.679556 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.679534    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="044641ba-be42-40b2-a4df-ce4abc81f84e" containerName="istio-proxy"
Sep 05 06:52:46.679731 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.679599    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="46aaab82-0224-49e8-863a-bd51488416cf" containerName="istio-proxy"
Sep 05 06:52:46.679731 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.679609    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="46aaab82-0224-49e8-863a-bd51488416cf" containerName="istio-proxy"
Sep 05 06:52:46.679731 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.679619    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="730dfbe2-b4a4-4cfc-b4fd-90b448544bd5" containerName="revoke-keys"
Sep 05 06:52:46.684110 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.684092    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:52:46.686526 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.686507    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-930288-openshift-default-dockercfg-jq9qm\""
Sep 05 06:52:46.697683 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.697661    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"]
Sep 05 06:52:46.823933 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.823897    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c845abef-fb7a-420a-9e34-ae67744c97e1-istio-data\") pod \"e2e-ipp-b-930288-openshift-default-674786887b-4hthg\" (UID: \"c845abef-fb7a-420a-9e34-ae67744c97e1\") " pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:52:46.824124 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.824075    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c845abef-fb7a-420a-9e34-ae67744c97e1-credential-socket\") pod \"e2e-ipp-b-930288-openshift-default-674786887b-4hthg\" (UID: \"c845abef-fb7a-420a-9e34-ae67744c97e1\") " pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:52:46.824124 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.824111    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnz9v\" (UniqueName: \"kubernetes.io/projected/c845abef-fb7a-420a-9e34-ae67744c97e1-kube-api-access-gnz9v\") pod \"e2e-ipp-b-930288-openshift-default-674786887b-4hthg\" (UID: \"c845abef-fb7a-420a-9e34-ae67744c97e1\") " pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:52:46.824270 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.824162    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c845abef-fb7a-420a-9e34-ae67744c97e1-workload-socket\") pod \"e2e-ipp-b-930288-openshift-default-674786887b-4hthg\" (UID: \"c845abef-fb7a-420a-9e34-ae67744c97e1\") " pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:52:46.824322 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.824273    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c845abef-fb7a-420a-9e34-ae67744c97e1-workload-certs\") pod \"e2e-ipp-b-930288-openshift-default-674786887b-4hthg\" (UID: \"c845abef-fb7a-420a-9e34-ae67744c97e1\") " pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:52:46.824322 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.824314    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c845abef-fb7a-420a-9e34-ae67744c97e1-istiod-ca-cert\") pod \"e2e-ipp-b-930288-openshift-default-674786887b-4hthg\" (UID: \"c845abef-fb7a-420a-9e34-ae67744c97e1\") " pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:52:46.824418 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.824376    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c845abef-fb7a-420a-9e34-ae67744c97e1-istio-token\") pod \"e2e-ipp-b-930288-openshift-default-674786887b-4hthg\" (UID: \"c845abef-fb7a-420a-9e34-ae67744c97e1\") " pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:52:46.824472 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.824413    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c845abef-fb7a-420a-9e34-ae67744c97e1-istio-podinfo\") pod \"e2e-ipp-b-930288-openshift-default-674786887b-4hthg\" (UID: \"c845abef-fb7a-420a-9e34-ae67744c97e1\") " pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:52:46.824532 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.824511    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c845abef-fb7a-420a-9e34-ae67744c97e1-istio-envoy\") pod \"e2e-ipp-b-930288-openshift-default-674786887b-4hthg\" (UID: \"c845abef-fb7a-420a-9e34-ae67744c97e1\") " pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:52:46.925224 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.925184    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c845abef-fb7a-420a-9e34-ae67744c97e1-workload-socket\") pod \"e2e-ipp-b-930288-openshift-default-674786887b-4hthg\" (UID: \"c845abef-fb7a-420a-9e34-ae67744c97e1\") " pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:52:46.925421 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.925236    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c845abef-fb7a-420a-9e34-ae67744c97e1-workload-certs\") pod \"e2e-ipp-b-930288-openshift-default-674786887b-4hthg\" (UID: \"c845abef-fb7a-420a-9e34-ae67744c97e1\") " pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:52:46.925421 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.925258    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c845abef-fb7a-420a-9e34-ae67744c97e1-istiod-ca-cert\") pod \"e2e-ipp-b-930288-openshift-default-674786887b-4hthg\" (UID: \"c845abef-fb7a-420a-9e34-ae67744c97e1\") " pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:52:46.925421 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.925305    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c845abef-fb7a-420a-9e34-ae67744c97e1-istio-token\") pod \"e2e-ipp-b-930288-openshift-default-674786887b-4hthg\" (UID: \"c845abef-fb7a-420a-9e34-ae67744c97e1\") " pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:52:46.925421 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.925332    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c845abef-fb7a-420a-9e34-ae67744c97e1-istio-podinfo\") pod \"e2e-ipp-b-930288-openshift-default-674786887b-4hthg\" (UID: \"c845abef-fb7a-420a-9e34-ae67744c97e1\") " pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:52:46.925421 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.925416    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c845abef-fb7a-420a-9e34-ae67744c97e1-istio-envoy\") pod \"e2e-ipp-b-930288-openshift-default-674786887b-4hthg\" (UID: \"c845abef-fb7a-420a-9e34-ae67744c97e1\") " pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:52:46.925699 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.925441    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c845abef-fb7a-420a-9e34-ae67744c97e1-istio-data\") pod \"e2e-ipp-b-930288-openshift-default-674786887b-4hthg\" (UID: \"c845abef-fb7a-420a-9e34-ae67744c97e1\") " pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:52:46.925699 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.925486    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c845abef-fb7a-420a-9e34-ae67744c97e1-credential-socket\") pod \"e2e-ipp-b-930288-openshift-default-674786887b-4hthg\" (UID: \"c845abef-fb7a-420a-9e34-ae67744c97e1\") " pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:52:46.925699 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.925514    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnz9v\" (UniqueName: \"kubernetes.io/projected/c845abef-fb7a-420a-9e34-ae67744c97e1-kube-api-access-gnz9v\") pod \"e2e-ipp-b-930288-openshift-default-674786887b-4hthg\" (UID: \"c845abef-fb7a-420a-9e34-ae67744c97e1\") " pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:52:46.925699 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.925589    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c845abef-fb7a-420a-9e34-ae67744c97e1-workload-socket\") pod \"e2e-ipp-b-930288-openshift-default-674786887b-4hthg\" (UID: \"c845abef-fb7a-420a-9e34-ae67744c97e1\") " pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:52:46.925699 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.925635    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c845abef-fb7a-420a-9e34-ae67744c97e1-workload-certs\") pod \"e2e-ipp-b-930288-openshift-default-674786887b-4hthg\" (UID: \"c845abef-fb7a-420a-9e34-ae67744c97e1\") " pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:52:46.925921 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.925905    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c845abef-fb7a-420a-9e34-ae67744c97e1-istio-data\") pod \"e2e-ipp-b-930288-openshift-default-674786887b-4hthg\" (UID: \"c845abef-fb7a-420a-9e34-ae67744c97e1\") " pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:52:46.925959 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.925944    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c845abef-fb7a-420a-9e34-ae67744c97e1-credential-socket\") pod \"e2e-ipp-b-930288-openshift-default-674786887b-4hthg\" (UID: \"c845abef-fb7a-420a-9e34-ae67744c97e1\") " pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:52:46.926213 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.926195    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c845abef-fb7a-420a-9e34-ae67744c97e1-istiod-ca-cert\") pod \"e2e-ipp-b-930288-openshift-default-674786887b-4hthg\" (UID: \"c845abef-fb7a-420a-9e34-ae67744c97e1\") " pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:52:46.927807 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.927780    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c845abef-fb7a-420a-9e34-ae67744c97e1-istio-envoy\") pod \"e2e-ipp-b-930288-openshift-default-674786887b-4hthg\" (UID: \"c845abef-fb7a-420a-9e34-ae67744c97e1\") " pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:52:46.928082 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.928062    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c845abef-fb7a-420a-9e34-ae67744c97e1-istio-podinfo\") pod \"e2e-ipp-b-930288-openshift-default-674786887b-4hthg\" (UID: \"c845abef-fb7a-420a-9e34-ae67744c97e1\") " pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:52:46.936969 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.936917    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnz9v\" (UniqueName: \"kubernetes.io/projected/c845abef-fb7a-420a-9e34-ae67744c97e1-kube-api-access-gnz9v\") pod \"e2e-ipp-b-930288-openshift-default-674786887b-4hthg\" (UID: \"c845abef-fb7a-420a-9e34-ae67744c97e1\") " pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:52:46.937087 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.936997    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c845abef-fb7a-420a-9e34-ae67744c97e1-istio-token\") pod \"e2e-ipp-b-930288-openshift-default-674786887b-4hthg\" (UID: \"c845abef-fb7a-420a-9e34-ae67744c97e1\") " pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:52:46.995051 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:46.995001    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:52:47.272423 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:47.272399    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"]
Sep 05 06:52:47.274014 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:52:47.273978    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc845abef_fb7a_420a_9e34_ae67744c97e1.slice/crio-bb6f4e335bb3f22d24d77be0644049dc04b06aa227700bb2acc7e624cec1e83a WatchSource:0}: Error finding container bb6f4e335bb3f22d24d77be0644049dc04b06aa227700bb2acc7e624cec1e83a: Status 404 returned error can't find the container with id bb6f4e335bb3f22d24d77be0644049dc04b06aa227700bb2acc7e624cec1e83a
Sep 05 06:52:47.276179 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:47.276148    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:52:47.276253 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:47.276210    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:52:47.276253 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:47.276237    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:52:47.980861 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:47.980807    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg" event={"ID":"c845abef-fb7a-420a-9e34-ae67744c97e1","Type":"ContainerStarted","Data":"1120dd4fe1bb612d184bb6b239bc5ac3ab9ab673e2cdfef6cf77a10346625809"}
Sep 05 06:52:47.981323 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:47.980885    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg" event={"ID":"c845abef-fb7a-420a-9e34-ae67744c97e1","Type":"ContainerStarted","Data":"bb6f4e335bb3f22d24d77be0644049dc04b06aa227700bb2acc7e624cec1e83a"}
Sep 05 06:52:47.996090 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:47.996071    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:52:48.002572 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:48.002524    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg" podStartSLOduration=2.002507557 podStartE2EDuration="2.002507557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:52:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:52:48.001446127 +0000 UTC m=+1633.975200801" watchObservedRunningTime="2026-09-05 06:52:48.002507557 +0000 UTC m=+1633.976262231"
Sep 05 06:52:49.000706 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:49.000671    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:52:49.250497 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:49.250465    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"]
Sep 05 06:52:49.250787 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:49.250731    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9" podUID="04f1c5e9-cec3-42e8-b025-1498acfa621c" containerName="istio-proxy" containerID="cri-o://3bd7291a24d09431aeadb52e7a703c19f081298330c0a1b6f28b982f91dd411c" gracePeriod=30
Sep 05 06:52:49.991060 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:49.990990    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:52:49.991992 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:49.991971    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:52:51.739009 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:51.738974    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49"]
Sep 05 06:52:51.739386 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:51.739361    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46aaab82-0224-49e8-863a-bd51488416cf" containerName="istio-proxy"
Sep 05 06:52:51.739386 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:51.739373    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="46aaab82-0224-49e8-863a-bd51488416cf" containerName="istio-proxy"
Sep 05 06:52:51.743154 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:51.743137    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49"
Sep 05 06:52:51.746015 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:51.745993    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-930288\""
Sep 05 06:52:51.746015 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:51.746007    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-930288-dockercfg-tp9w6\""
Sep 05 06:52:51.755053 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:51.755002    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49"]
Sep 05 06:52:51.871877 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:51.871825    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9w9d\" (UniqueName: \"kubernetes.io/projected/3a38e906-6d54-4e44-841f-35e8dfb9e96a-kube-api-access-r9w9d\") pod \"payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49\" (UID: \"3a38e906-6d54-4e44-841f-35e8dfb9e96a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49"
Sep 05 06:52:51.872073 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:51.871938    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a38e906-6d54-4e44-841f-35e8dfb9e96a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49\" (UID: \"3a38e906-6d54-4e44-841f-35e8dfb9e96a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49"
Sep 05 06:52:51.972967 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:51.972934    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a38e906-6d54-4e44-841f-35e8dfb9e96a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49\" (UID: \"3a38e906-6d54-4e44-841f-35e8dfb9e96a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49"
Sep 05 06:52:51.973185 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:51.973108    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9w9d\" (UniqueName: \"kubernetes.io/projected/3a38e906-6d54-4e44-841f-35e8dfb9e96a-kube-api-access-r9w9d\") pod \"payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49\" (UID: \"3a38e906-6d54-4e44-841f-35e8dfb9e96a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49"
Sep 05 06:52:51.973596 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:51.973573    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a38e906-6d54-4e44-841f-35e8dfb9e96a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49\" (UID: \"3a38e906-6d54-4e44-841f-35e8dfb9e96a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49"
Sep 05 06:52:51.981459 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:51.981430    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9w9d\" (UniqueName: \"kubernetes.io/projected/3a38e906-6d54-4e44-841f-35e8dfb9e96a-kube-api-access-r9w9d\") pod \"payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49\" (UID: \"3a38e906-6d54-4e44-841f-35e8dfb9e96a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49"
Sep 05 06:52:52.053688 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:52.053632    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49"
Sep 05 06:52:52.323574 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:52.323550    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49"]
Sep 05 06:52:52.325258 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:52:52.325232    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a38e906_6d54_4e44_841f_35e8dfb9e96a.slice/crio-b6cb8ac57fafbfa4d61e19e3051f95b87a97e711684d84b119e080bbd75af6fc WatchSource:0}: Error finding container b6cb8ac57fafbfa4d61e19e3051f95b87a97e711684d84b119e080bbd75af6fc: Status 404 returned error can't find the container with id b6cb8ac57fafbfa4d61e19e3051f95b87a97e711684d84b119e080bbd75af6fc
Sep 05 06:52:53.006960 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:53.006924    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49" event={"ID":"3a38e906-6d54-4e44-841f-35e8dfb9e96a","Type":"ContainerStarted","Data":"0b591358e3165ff0b138eb6b5d20ee232a4b3b129b0c89ab44dbbe56fc91f07d"}
Sep 05 06:52:53.007457 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:53.006981    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49" event={"ID":"3a38e906-6d54-4e44-841f-35e8dfb9e96a","Type":"ContainerStarted","Data":"b6cb8ac57fafbfa4d61e19e3051f95b87a97e711684d84b119e080bbd75af6fc"}
Sep 05 06:52:53.007457 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:53.007012    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49"
Sep 05 06:52:53.023691 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:53.023631    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49" podStartSLOduration=2.023611234 podStartE2EDuration="2.023611234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:52:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:52:53.022831893 +0000 UTC m=+1638.996586568" watchObservedRunningTime="2026-09-05 06:52:53.023611234 +0000 UTC m=+1638.997365909"
Sep 05 06:52:54.501190 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:54.501166    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:52:54.597586 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:54.597515    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwkhp\" (UniqueName: \"kubernetes.io/projected/04f1c5e9-cec3-42e8-b025-1498acfa621c-kube-api-access-pwkhp\") pod \"04f1c5e9-cec3-42e8-b025-1498acfa621c\" (UID: \"04f1c5e9-cec3-42e8-b025-1498acfa621c\") "
Sep 05 06:52:54.597586 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:54.597578    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04f1c5e9-cec3-42e8-b025-1498acfa621c-istio-token\") pod \"04f1c5e9-cec3-42e8-b025-1498acfa621c\" (UID: \"04f1c5e9-cec3-42e8-b025-1498acfa621c\") "
Sep 05 06:52:54.597828 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:54.597607    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04f1c5e9-cec3-42e8-b025-1498acfa621c-istio-envoy\") pod \"04f1c5e9-cec3-42e8-b025-1498acfa621c\" (UID: \"04f1c5e9-cec3-42e8-b025-1498acfa621c\") "
Sep 05 06:52:54.597828 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:54.597671    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04f1c5e9-cec3-42e8-b025-1498acfa621c-workload-certs\") pod \"04f1c5e9-cec3-42e8-b025-1498acfa621c\" (UID: \"04f1c5e9-cec3-42e8-b025-1498acfa621c\") "
Sep 05 06:52:54.597828 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:54.597694    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04f1c5e9-cec3-42e8-b025-1498acfa621c-istio-podinfo\") pod \"04f1c5e9-cec3-42e8-b025-1498acfa621c\" (UID: \"04f1c5e9-cec3-42e8-b025-1498acfa621c\") "
Sep 05 06:52:54.597828 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:54.597748    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04f1c5e9-cec3-42e8-b025-1498acfa621c-workload-socket\") pod \"04f1c5e9-cec3-42e8-b025-1498acfa621c\" (UID: \"04f1c5e9-cec3-42e8-b025-1498acfa621c\") "
Sep 05 06:52:54.597828 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:54.597800    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04f1c5e9-cec3-42e8-b025-1498acfa621c-istio-data\") pod \"04f1c5e9-cec3-42e8-b025-1498acfa621c\" (UID: \"04f1c5e9-cec3-42e8-b025-1498acfa621c\") "
Sep 05 06:52:54.598134 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:54.597838    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04f1c5e9-cec3-42e8-b025-1498acfa621c-istiod-ca-cert\") pod \"04f1c5e9-cec3-42e8-b025-1498acfa621c\" (UID: \"04f1c5e9-cec3-42e8-b025-1498acfa621c\") "
Sep 05 06:52:54.598134 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:54.597876    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04f1c5e9-cec3-42e8-b025-1498acfa621c-credential-socket\") pod \"04f1c5e9-cec3-42e8-b025-1498acfa621c\" (UID: \"04f1c5e9-cec3-42e8-b025-1498acfa621c\") "
Sep 05 06:52:54.598134 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:54.598011    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04f1c5e9-cec3-42e8-b025-1498acfa621c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "04f1c5e9-cec3-42e8-b025-1498acfa621c" (UID: "04f1c5e9-cec3-42e8-b025-1498acfa621c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:52:54.598134 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:54.598042    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04f1c5e9-cec3-42e8-b025-1498acfa621c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "04f1c5e9-cec3-42e8-b025-1498acfa621c" (UID: "04f1c5e9-cec3-42e8-b025-1498acfa621c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:52:54.598134 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:54.598112    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04f1c5e9-cec3-42e8-b025-1498acfa621c-istio-data" (OuterVolumeSpecName: "istio-data") pod "04f1c5e9-cec3-42e8-b025-1498acfa621c" (UID: "04f1c5e9-cec3-42e8-b025-1498acfa621c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:52:54.598387 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:54.598222    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04f1c5e9-cec3-42e8-b025-1498acfa621c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "04f1c5e9-cec3-42e8-b025-1498acfa621c" (UID: "04f1c5e9-cec3-42e8-b025-1498acfa621c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:52:54.598387 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:54.598282    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04f1c5e9-cec3-42e8-b025-1498acfa621c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "04f1c5e9-cec3-42e8-b025-1498acfa621c" (UID: "04f1c5e9-cec3-42e8-b025-1498acfa621c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:52:54.598387 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:54.598352    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04f1c5e9-cec3-42e8-b025-1498acfa621c-istiod-ca-cert\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:52:54.598387 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:54.598376    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04f1c5e9-cec3-42e8-b025-1498acfa621c-credential-socket\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:52:54.598543 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:54.598394    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04f1c5e9-cec3-42e8-b025-1498acfa621c-workload-certs\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:52:54.598543 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:54.598409    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04f1c5e9-cec3-42e8-b025-1498acfa621c-workload-socket\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:52:54.598543 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:54.598421    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04f1c5e9-cec3-42e8-b025-1498acfa621c-istio-data\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:52:54.599863 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:54.599840    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04f1c5e9-cec3-42e8-b025-1498acfa621c-istio-token" (OuterVolumeSpecName: "istio-token") pod "04f1c5e9-cec3-42e8-b025-1498acfa621c" (UID: "04f1c5e9-cec3-42e8-b025-1498acfa621c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:52:54.600344 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:54.600323    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04f1c5e9-cec3-42e8-b025-1498acfa621c-kube-api-access-pwkhp" (OuterVolumeSpecName: "kube-api-access-pwkhp") pod "04f1c5e9-cec3-42e8-b025-1498acfa621c" (UID: "04f1c5e9-cec3-42e8-b025-1498acfa621c"). InnerVolumeSpecName "kube-api-access-pwkhp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:52:54.600406 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:54.600352    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/04f1c5e9-cec3-42e8-b025-1498acfa621c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "04f1c5e9-cec3-42e8-b025-1498acfa621c" (UID: "04f1c5e9-cec3-42e8-b025-1498acfa621c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 05 06:52:54.600449 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:54.600427    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04f1c5e9-cec3-42e8-b025-1498acfa621c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "04f1c5e9-cec3-42e8-b025-1498acfa621c" (UID: "04f1c5e9-cec3-42e8-b025-1498acfa621c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:52:54.700019 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:54.699989    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwkhp\" (UniqueName: \"kubernetes.io/projected/04f1c5e9-cec3-42e8-b025-1498acfa621c-kube-api-access-pwkhp\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:52:54.700134 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:54.700019    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04f1c5e9-cec3-42e8-b025-1498acfa621c-istio-token\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:52:54.700134 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:54.700057    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04f1c5e9-cec3-42e8-b025-1498acfa621c-istio-envoy\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:52:54.700134 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:54.700067    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04f1c5e9-cec3-42e8-b025-1498acfa621c-istio-podinfo\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:52:55.018237 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:55.018209    2567 generic.go:356] "Generic (PLEG): container finished" podID="04f1c5e9-cec3-42e8-b025-1498acfa621c" containerID="3bd7291a24d09431aeadb52e7a703c19f081298330c0a1b6f28b982f91dd411c" exitCode=0
Sep 05 06:52:55.018400 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:55.018262    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"
Sep 05 06:52:55.018400 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:55.018293    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9" event={"ID":"04f1c5e9-cec3-42e8-b025-1498acfa621c","Type":"ContainerDied","Data":"3bd7291a24d09431aeadb52e7a703c19f081298330c0a1b6f28b982f91dd411c"}
Sep 05 06:52:55.018400 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:55.018355    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9" event={"ID":"04f1c5e9-cec3-42e8-b025-1498acfa621c","Type":"ContainerDied","Data":"edb44341ccb4dbe83ae97cc746200836b41bbdbc77bb99e365e6316f24c40e3d"}
Sep 05 06:52:55.018400 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:55.018383    2567 scope.go:117] "RemoveContainer" containerID="3bd7291a24d09431aeadb52e7a703c19f081298330c0a1b6f28b982f91dd411c"
Sep 05 06:52:55.027687 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:55.027670    2567 scope.go:117] "RemoveContainer" containerID="595878aec984d82e2b318ce6383d1517794ff3138e00c28aece4278f399395f5"
Sep 05 06:52:55.035388 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:55.035364    2567 scope.go:117] "RemoveContainer" containerID="3bd7291a24d09431aeadb52e7a703c19f081298330c0a1b6f28b982f91dd411c"
Sep 05 06:52:55.035617 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:52:55.035602    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bd7291a24d09431aeadb52e7a703c19f081298330c0a1b6f28b982f91dd411c\": container with ID starting with 3bd7291a24d09431aeadb52e7a703c19f081298330c0a1b6f28b982f91dd411c not found: ID does not exist" containerID="3bd7291a24d09431aeadb52e7a703c19f081298330c0a1b6f28b982f91dd411c"
Sep 05 06:52:55.035673 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:55.035624    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bd7291a24d09431aeadb52e7a703c19f081298330c0a1b6f28b982f91dd411c"} err="failed to get container status \"3bd7291a24d09431aeadb52e7a703c19f081298330c0a1b6f28b982f91dd411c\": rpc error: code = NotFound desc = could not find container \"3bd7291a24d09431aeadb52e7a703c19f081298330c0a1b6f28b982f91dd411c\": container with ID starting with 3bd7291a24d09431aeadb52e7a703c19f081298330c0a1b6f28b982f91dd411c not found: ID does not exist"
Sep 05 06:52:55.035673 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:55.035641    2567 scope.go:117] "RemoveContainer" containerID="595878aec984d82e2b318ce6383d1517794ff3138e00c28aece4278f399395f5"
Sep 05 06:52:55.035874 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:52:55.035856    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"595878aec984d82e2b318ce6383d1517794ff3138e00c28aece4278f399395f5\": container with ID starting with 595878aec984d82e2b318ce6383d1517794ff3138e00c28aece4278f399395f5 not found: ID does not exist" containerID="595878aec984d82e2b318ce6383d1517794ff3138e00c28aece4278f399395f5"
Sep 05 06:52:55.035928 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:55.035884    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"595878aec984d82e2b318ce6383d1517794ff3138e00c28aece4278f399395f5"} err="failed to get container status \"595878aec984d82e2b318ce6383d1517794ff3138e00c28aece4278f399395f5\": rpc error: code = NotFound desc = could not find container \"595878aec984d82e2b318ce6383d1517794ff3138e00c28aece4278f399395f5\": container with ID starting with 595878aec984d82e2b318ce6383d1517794ff3138e00c28aece4278f399395f5 not found: ID does not exist"
Sep 05 06:52:55.042971 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:55.042948    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"]
Sep 05 06:52:55.047652 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:55.047631    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9"]
Sep 05 06:52:56.581488 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:52:56.581458    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04f1c5e9-cec3-42e8-b025-1498acfa621c" path="/var/lib/kubelet/pods/04f1c5e9-cec3-42e8-b025-1498acfa621c/volumes"
Sep 05 06:53:04.014237 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:04.014161    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49"
Sep 05 06:53:06.032167 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:06.032129    2567 patch_prober.go:28] interesting pod/e2e-ipp-b-930288-openshift-default-674786887b-4hthg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 05 06:53:06.032555 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:06.032190    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg" podUID="c845abef-fb7a-420a-9e34-ae67744c97e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 05 06:53:07.087298 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:07.087230    2567 generic.go:356] "Generic (PLEG): container finished" podID="c845abef-fb7a-420a-9e34-ae67744c97e1" containerID="1120dd4fe1bb612d184bb6b239bc5ac3ab9ab673e2cdfef6cf77a10346625809" exitCode=0
Sep 05 06:53:07.087654 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:07.087308    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg" event={"ID":"c845abef-fb7a-420a-9e34-ae67744c97e1","Type":"ContainerDied","Data":"1120dd4fe1bb612d184bb6b239bc5ac3ab9ab673e2cdfef6cf77a10346625809"}
Sep 05 06:53:07.087707 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:07.087693    2567 scope.go:117] "RemoveContainer" containerID="1120dd4fe1bb612d184bb6b239bc5ac3ab9ab673e2cdfef6cf77a10346625809"
Sep 05 06:53:07.088722 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:07.088694    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:53:07.088780 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:07.088766    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:53:07.088817 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:07.088805    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:53:08.094087 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:08.094056    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg" event={"ID":"c845abef-fb7a-420a-9e34-ae67744c97e1","Type":"ContainerStarted","Data":"7046ee2a680d30da94ddbb973c3422c79385f2329c2755dbcd3713d757b81319"}
Sep 05 06:53:08.995585 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:08.995558    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:53:08.995822 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:08.995802    2567 patch_prober.go:28] interesting pod/e2e-ipp-b-930288-openshift-default-674786887b-4hthg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 05 06:53:08.995869 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:08.995853    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg" podUID="c845abef-fb7a-420a-9e34-ae67744c97e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 05 06:53:09.995637 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:09.995604    2567 patch_prober.go:28] interesting pod/e2e-ipp-b-930288-openshift-default-674786887b-4hthg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 05 06:53:09.996021 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:09.995660    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg" podUID="c845abef-fb7a-420a-9e34-ae67744c97e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 05 06:53:10.995854 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:10.995818    2567 patch_prober.go:28] interesting pod/e2e-ipp-b-930288-openshift-default-674786887b-4hthg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 05 06:53:10.996264 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:10.995886    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg" podUID="c845abef-fb7a-420a-9e34-ae67744c97e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 05 06:53:11.995347 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:11.995312    2567 patch_prober.go:28] interesting pod/e2e-ipp-b-930288-openshift-default-674786887b-4hthg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 05 06:53:11.995525 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:11.995377    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg" podUID="c845abef-fb7a-420a-9e34-ae67744c97e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 05 06:53:12.996239 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:12.996197    2567 patch_prober.go:28] interesting pod/e2e-ipp-b-930288-openshift-default-674786887b-4hthg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 05 06:53:12.996698 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:12.996270    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg" podUID="c845abef-fb7a-420a-9e34-ae67744c97e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 05 06:53:13.999667 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:13.999636    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:53:14.000145 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:13.999991    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:53:14.000657 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:14.000640    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:53:32.569479 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:32.569448    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp"]
Sep 05 06:53:32.570099 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:32.569829    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04f1c5e9-cec3-42e8-b025-1498acfa621c" containerName="istio-proxy"
Sep 05 06:53:32.570099 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:32.569840    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="04f1c5e9-cec3-42e8-b025-1498acfa621c" containerName="istio-proxy"
Sep 05 06:53:32.570099 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:32.569849    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04f1c5e9-cec3-42e8-b025-1498acfa621c" containerName="istio-proxy"
Sep 05 06:53:32.570099 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:32.569855    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="04f1c5e9-cec3-42e8-b025-1498acfa621c" containerName="istio-proxy"
Sep 05 06:53:32.570099 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:32.569919    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="04f1c5e9-cec3-42e8-b025-1498acfa621c" containerName="istio-proxy"
Sep 05 06:53:32.574250 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:32.574229    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp"
Sep 05 06:53:32.577042 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:32.576999    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-73a747\"/\"openshift-service-ca.crt\""
Sep 05 06:53:32.578154 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:32.578132    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-73a747\"/\"ipp-route-73a747-kserve-self-signed-certs\""
Sep 05 06:53:32.578282 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:32.578158    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-73a747\"/\"default-dockercfg-s855n\""
Sep 05 06:53:32.578282 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:32.578187    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-73a747\"/\"kube-root-ca.crt\""
Sep 05 06:53:32.582142 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:32.582120    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp"]
Sep 05 06:53:32.652171 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:32.652141    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bec0518d-16a4-4201-922c-4a785631ce57-model-cache\") pod \"ipp-route-73a747-kserve-6484848bf5-nblwp\" (UID: \"bec0518d-16a4-4201-922c-4a785631ce57\") " pod="ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp"
Sep 05 06:53:32.652335 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:32.652179    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bec0518d-16a4-4201-922c-4a785631ce57-home\") pod \"ipp-route-73a747-kserve-6484848bf5-nblwp\" (UID: \"bec0518d-16a4-4201-922c-4a785631ce57\") " pod="ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp"
Sep 05 06:53:32.652335 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:32.652261    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bec0518d-16a4-4201-922c-4a785631ce57-dshm\") pod \"ipp-route-73a747-kserve-6484848bf5-nblwp\" (UID: \"bec0518d-16a4-4201-922c-4a785631ce57\") " pod="ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp"
Sep 05 06:53:32.652456 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:32.652343    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x44pz\" (UniqueName: \"kubernetes.io/projected/bec0518d-16a4-4201-922c-4a785631ce57-kube-api-access-x44pz\") pod \"ipp-route-73a747-kserve-6484848bf5-nblwp\" (UID: \"bec0518d-16a4-4201-922c-4a785631ce57\") " pod="ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp"
Sep 05 06:53:32.652456 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:32.652395    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bec0518d-16a4-4201-922c-4a785631ce57-tls-certs\") pod \"ipp-route-73a747-kserve-6484848bf5-nblwp\" (UID: \"bec0518d-16a4-4201-922c-4a785631ce57\") " pod="ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp"
Sep 05 06:53:32.652456 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:32.652429    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bec0518d-16a4-4201-922c-4a785631ce57-tmp-dir\") pod \"ipp-route-73a747-kserve-6484848bf5-nblwp\" (UID: \"bec0518d-16a4-4201-922c-4a785631ce57\") " pod="ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp"
Sep 05 06:53:32.753925 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:32.753886    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bec0518d-16a4-4201-922c-4a785631ce57-tmp-dir\") pod \"ipp-route-73a747-kserve-6484848bf5-nblwp\" (UID: \"bec0518d-16a4-4201-922c-4a785631ce57\") " pod="ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp"
Sep 05 06:53:32.754133 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:32.754047    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bec0518d-16a4-4201-922c-4a785631ce57-model-cache\") pod \"ipp-route-73a747-kserve-6484848bf5-nblwp\" (UID: \"bec0518d-16a4-4201-922c-4a785631ce57\") " pod="ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp"
Sep 05 06:53:32.754133 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:32.754079    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bec0518d-16a4-4201-922c-4a785631ce57-home\") pod \"ipp-route-73a747-kserve-6484848bf5-nblwp\" (UID: \"bec0518d-16a4-4201-922c-4a785631ce57\") " pod="ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp"
Sep 05 06:53:32.754133 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:32.754122    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bec0518d-16a4-4201-922c-4a785631ce57-dshm\") pod \"ipp-route-73a747-kserve-6484848bf5-nblwp\" (UID: \"bec0518d-16a4-4201-922c-4a785631ce57\") " pod="ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp"
Sep 05 06:53:32.754284 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:32.754206    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x44pz\" (UniqueName: \"kubernetes.io/projected/bec0518d-16a4-4201-922c-4a785631ce57-kube-api-access-x44pz\") pod \"ipp-route-73a747-kserve-6484848bf5-nblwp\" (UID: \"bec0518d-16a4-4201-922c-4a785631ce57\") " pod="ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp"
Sep 05 06:53:32.754284 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:32.754246    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bec0518d-16a4-4201-922c-4a785631ce57-tls-certs\") pod \"ipp-route-73a747-kserve-6484848bf5-nblwp\" (UID: \"bec0518d-16a4-4201-922c-4a785631ce57\") " pod="ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp"
Sep 05 06:53:32.754284 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:32.754255    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bec0518d-16a4-4201-922c-4a785631ce57-tmp-dir\") pod \"ipp-route-73a747-kserve-6484848bf5-nblwp\" (UID: \"bec0518d-16a4-4201-922c-4a785631ce57\") " pod="ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp"
Sep 05 06:53:32.754408 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:32.754363    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bec0518d-16a4-4201-922c-4a785631ce57-model-cache\") pod \"ipp-route-73a747-kserve-6484848bf5-nblwp\" (UID: \"bec0518d-16a4-4201-922c-4a785631ce57\") " pod="ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp"
Sep 05 06:53:32.754486 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:32.754446    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bec0518d-16a4-4201-922c-4a785631ce57-home\") pod \"ipp-route-73a747-kserve-6484848bf5-nblwp\" (UID: \"bec0518d-16a4-4201-922c-4a785631ce57\") " pod="ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp"
Sep 05 06:53:32.756516 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:32.756490    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bec0518d-16a4-4201-922c-4a785631ce57-dshm\") pod \"ipp-route-73a747-kserve-6484848bf5-nblwp\" (UID: \"bec0518d-16a4-4201-922c-4a785631ce57\") " pod="ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp"
Sep 05 06:53:32.756839 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:32.756824    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bec0518d-16a4-4201-922c-4a785631ce57-tls-certs\") pod \"ipp-route-73a747-kserve-6484848bf5-nblwp\" (UID: \"bec0518d-16a4-4201-922c-4a785631ce57\") " pod="ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp"
Sep 05 06:53:32.764281 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:32.764255    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x44pz\" (UniqueName: \"kubernetes.io/projected/bec0518d-16a4-4201-922c-4a785631ce57-kube-api-access-x44pz\") pod \"ipp-route-73a747-kserve-6484848bf5-nblwp\" (UID: \"bec0518d-16a4-4201-922c-4a785631ce57\") " pod="ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp"
Sep 05 06:53:32.885002 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:32.884917    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp"
Sep 05 06:53:33.170674 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:33.170643    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp"]
Sep 05 06:53:33.172232 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:53:33.172207    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbec0518d_16a4_4201_922c_4a785631ce57.slice/crio-85414744906a06bdd4dbd23d77b585e1c9fbc66b1cb4f699805ac386d9a34744 WatchSource:0}: Error finding container 85414744906a06bdd4dbd23d77b585e1c9fbc66b1cb4f699805ac386d9a34744: Status 404 returned error can't find the container with id 85414744906a06bdd4dbd23d77b585e1c9fbc66b1cb4f699805ac386d9a34744
Sep 05 06:53:33.220187 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:33.220157    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp" event={"ID":"bec0518d-16a4-4201-922c-4a785631ce57","Type":"ContainerStarted","Data":"85414744906a06bdd4dbd23d77b585e1c9fbc66b1cb4f699805ac386d9a34744"}
Sep 05 06:53:34.226979 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:34.226938    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp" event={"ID":"bec0518d-16a4-4201-922c-4a785631ce57","Type":"ContainerStarted","Data":"c6124123d48e7cd7acf62734ac4d7e5d943dbb78a9ffcc16f738004f8f9e0b54"}
Sep 05 06:53:34.243194 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:34.243144    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp" podStartSLOduration=2.243125263 podStartE2EDuration="2.243125263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:53:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:53:34.243113941 +0000 UTC m=+1680.216868617" watchObservedRunningTime="2026-09-05 06:53:34.243125263 +0000 UTC m=+1680.216880012"
Sep 05 06:53:35.003196 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:35.003169    2567 scope.go:117] "RemoveContainer" containerID="16b76b846e0940eac8088b76e4db9950c5079818b98b616bc12f60bc27276c08"
Sep 05 06:53:35.012924 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:35.012907    2567 scope.go:117] "RemoveContainer" containerID="9f15ccfca2ed0fcab7f771de09679a1a7ad10fc240c2a74260c4881d2b319b76"
Sep 05 06:53:42.885501 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:42.885456    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp"
Sep 05 06:53:42.885930 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:42.885519    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp"
Sep 05 06:53:42.898226 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:42.898195    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp"
Sep 05 06:53:43.285806 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:43.285775    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp"
Sep 05 06:53:58.800276 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:58.800187    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"]
Sep 05 06:53:58.800885 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:58.800863    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="04f1c5e9-cec3-42e8-b025-1498acfa621c" containerName="istio-proxy"
Sep 05 06:53:58.805602 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:58.805584    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:53:58.808185 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:58.808167    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-703730-openshift-default-dockercfg-8qgk4\""
Sep 05 06:53:58.815142 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:58.815121    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"]
Sep 05 06:53:58.906576 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:58.906543    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be0cda55-6872-463a-8a51-d0e5514a977c-workload-certs\") pod \"e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz\" (UID: \"be0cda55-6872-463a-8a51-d0e5514a977c\") " pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:53:58.906786 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:58.906592    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be0cda55-6872-463a-8a51-d0e5514a977c-istio-envoy\") pod \"e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz\" (UID: \"be0cda55-6872-463a-8a51-d0e5514a977c\") " pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:53:58.906786 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:58.906660    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be0cda55-6872-463a-8a51-d0e5514a977c-workload-socket\") pod \"e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz\" (UID: \"be0cda55-6872-463a-8a51-d0e5514a977c\") " pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:53:58.906786 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:58.906720    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be0cda55-6872-463a-8a51-d0e5514a977c-istio-token\") pod \"e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz\" (UID: \"be0cda55-6872-463a-8a51-d0e5514a977c\") " pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:53:58.906956 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:58.906801    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be0cda55-6872-463a-8a51-d0e5514a977c-istio-data\") pod \"e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz\" (UID: \"be0cda55-6872-463a-8a51-d0e5514a977c\") " pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:53:58.906956 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:58.906826    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v68z\" (UniqueName: \"kubernetes.io/projected/be0cda55-6872-463a-8a51-d0e5514a977c-kube-api-access-4v68z\") pod \"e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz\" (UID: \"be0cda55-6872-463a-8a51-d0e5514a977c\") " pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:53:58.906956 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:58.906875    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be0cda55-6872-463a-8a51-d0e5514a977c-istiod-ca-cert\") pod \"e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz\" (UID: \"be0cda55-6872-463a-8a51-d0e5514a977c\") " pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:53:58.906956 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:58.906930    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be0cda55-6872-463a-8a51-d0e5514a977c-istio-podinfo\") pod \"e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz\" (UID: \"be0cda55-6872-463a-8a51-d0e5514a977c\") " pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:53:58.907207 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:58.906974    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be0cda55-6872-463a-8a51-d0e5514a977c-credential-socket\") pod \"e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz\" (UID: \"be0cda55-6872-463a-8a51-d0e5514a977c\") " pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:53:59.008293 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:59.008258    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be0cda55-6872-463a-8a51-d0e5514a977c-workload-certs\") pod \"e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz\" (UID: \"be0cda55-6872-463a-8a51-d0e5514a977c\") " pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:53:59.008510 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:59.008305    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be0cda55-6872-463a-8a51-d0e5514a977c-istio-envoy\") pod \"e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz\" (UID: \"be0cda55-6872-463a-8a51-d0e5514a977c\") " pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:53:59.008510 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:59.008323    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be0cda55-6872-463a-8a51-d0e5514a977c-workload-socket\") pod \"e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz\" (UID: \"be0cda55-6872-463a-8a51-d0e5514a977c\") " pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:53:59.008510 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:59.008342    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be0cda55-6872-463a-8a51-d0e5514a977c-istio-token\") pod \"e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz\" (UID: \"be0cda55-6872-463a-8a51-d0e5514a977c\") " pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:53:59.008510 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:59.008414    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be0cda55-6872-463a-8a51-d0e5514a977c-istio-data\") pod \"e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz\" (UID: \"be0cda55-6872-463a-8a51-d0e5514a977c\") " pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:53:59.008510 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:59.008445    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v68z\" (UniqueName: \"kubernetes.io/projected/be0cda55-6872-463a-8a51-d0e5514a977c-kube-api-access-4v68z\") pod \"e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz\" (UID: \"be0cda55-6872-463a-8a51-d0e5514a977c\") " pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:53:59.008510 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:59.008493    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be0cda55-6872-463a-8a51-d0e5514a977c-istiod-ca-cert\") pod \"e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz\" (UID: \"be0cda55-6872-463a-8a51-d0e5514a977c\") " pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:53:59.008850 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:59.008548    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be0cda55-6872-463a-8a51-d0e5514a977c-istio-podinfo\") pod \"e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz\" (UID: \"be0cda55-6872-463a-8a51-d0e5514a977c\") " pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:53:59.008850 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:59.008581    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be0cda55-6872-463a-8a51-d0e5514a977c-credential-socket\") pod \"e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz\" (UID: \"be0cda55-6872-463a-8a51-d0e5514a977c\") " pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:53:59.008850 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:59.008740    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be0cda55-6872-463a-8a51-d0e5514a977c-workload-certs\") pod \"e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz\" (UID: \"be0cda55-6872-463a-8a51-d0e5514a977c\") " pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:53:59.008850 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:59.008765    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be0cda55-6872-463a-8a51-d0e5514a977c-workload-socket\") pod \"e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz\" (UID: \"be0cda55-6872-463a-8a51-d0e5514a977c\") " pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:53:59.009012 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:59.008981    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be0cda55-6872-463a-8a51-d0e5514a977c-credential-socket\") pod \"e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz\" (UID: \"be0cda55-6872-463a-8a51-d0e5514a977c\") " pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:53:59.009113 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:59.009051    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be0cda55-6872-463a-8a51-d0e5514a977c-istio-data\") pod \"e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz\" (UID: \"be0cda55-6872-463a-8a51-d0e5514a977c\") " pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:53:59.009311 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:59.009294    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be0cda55-6872-463a-8a51-d0e5514a977c-istiod-ca-cert\") pod \"e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz\" (UID: \"be0cda55-6872-463a-8a51-d0e5514a977c\") " pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:53:59.010809 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:59.010785    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be0cda55-6872-463a-8a51-d0e5514a977c-istio-envoy\") pod \"e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz\" (UID: \"be0cda55-6872-463a-8a51-d0e5514a977c\") " pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:53:59.011257 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:59.011239    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be0cda55-6872-463a-8a51-d0e5514a977c-istio-podinfo\") pod \"e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz\" (UID: \"be0cda55-6872-463a-8a51-d0e5514a977c\") " pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:53:59.016701 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:59.016674    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be0cda55-6872-463a-8a51-d0e5514a977c-istio-token\") pod \"e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz\" (UID: \"be0cda55-6872-463a-8a51-d0e5514a977c\") " pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:53:59.016901 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:59.016884    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v68z\" (UniqueName: \"kubernetes.io/projected/be0cda55-6872-463a-8a51-d0e5514a977c-kube-api-access-4v68z\") pod \"e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz\" (UID: \"be0cda55-6872-463a-8a51-d0e5514a977c\") " pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:53:59.116204 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:59.116117    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:53:59.392448 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:59.392420    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"]
Sep 05 06:53:59.393464 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:53:59.393434    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe0cda55_6872_463a_8a51_d0e5514a977c.slice/crio-b30d2ab40f61fc35a19b90ba9c1e0ef1b71d589d9a6cf249b39a85449784bad0 WatchSource:0}: Error finding container b30d2ab40f61fc35a19b90ba9c1e0ef1b71d589d9a6cf249b39a85449784bad0: Status 404 returned error can't find the container with id b30d2ab40f61fc35a19b90ba9c1e0ef1b71d589d9a6cf249b39a85449784bad0
Sep 05 06:53:59.395610 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:59.395580    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:53:59.395679 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:59.395644    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:53:59.395679 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:53:59.395674    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:54:00.364375 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:00.364341    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz" event={"ID":"be0cda55-6872-463a-8a51-d0e5514a977c","Type":"ContainerStarted","Data":"fcfa0dcbf0e1d793dce2f19256a5f671d4c17630b394c67d8f6ac87983e84908"}
Sep 05 06:54:00.364752 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:00.364392    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz" event={"ID":"be0cda55-6872-463a-8a51-d0e5514a977c","Type":"ContainerStarted","Data":"b30d2ab40f61fc35a19b90ba9c1e0ef1b71d589d9a6cf249b39a85449784bad0"}
Sep 05 06:54:00.385988 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:00.385935    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz" podStartSLOduration=2.385920189 podStartE2EDuration="2.385920189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:53:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:54:00.383717225 +0000 UTC m=+1706.357471901" watchObservedRunningTime="2026-09-05 06:54:00.385920189 +0000 UTC m=+1706.359674861"
Sep 05 06:54:01.116606 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:01.116570    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:54:01.121785 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:01.121755    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:54:01.369962 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:01.369869    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:54:01.370866 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:01.370846    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:54:04.040526 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:04.040489    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m"]
Sep 05 06:54:04.044241 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:04.044224    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m"
Sep 05 06:54:04.047114 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:04.047090    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-703730\""
Sep 05 06:54:04.054462 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:04.054443    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m"]
Sep 05 06:54:04.163071 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:04.163009    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vkd5\" (UniqueName: \"kubernetes.io/projected/9245f865-1d0f-4efc-b40e-59b1cdd0deca-kube-api-access-8vkd5\") pod \"payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m\" (UID: \"9245f865-1d0f-4efc-b40e-59b1cdd0deca\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m"
Sep 05 06:54:04.163294 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:04.163131    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9245f865-1d0f-4efc-b40e-59b1cdd0deca-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m\" (UID: \"9245f865-1d0f-4efc-b40e-59b1cdd0deca\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m"
Sep 05 06:54:04.264076 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:04.264022    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vkd5\" (UniqueName: \"kubernetes.io/projected/9245f865-1d0f-4efc-b40e-59b1cdd0deca-kube-api-access-8vkd5\") pod \"payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m\" (UID: \"9245f865-1d0f-4efc-b40e-59b1cdd0deca\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m"
Sep 05 06:54:04.264282 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:04.264092    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9245f865-1d0f-4efc-b40e-59b1cdd0deca-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m\" (UID: \"9245f865-1d0f-4efc-b40e-59b1cdd0deca\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m"
Sep 05 06:54:04.264784 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:04.264762    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9245f865-1d0f-4efc-b40e-59b1cdd0deca-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m\" (UID: \"9245f865-1d0f-4efc-b40e-59b1cdd0deca\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m"
Sep 05 06:54:04.272945 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:04.272922    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vkd5\" (UniqueName: \"kubernetes.io/projected/9245f865-1d0f-4efc-b40e-59b1cdd0deca-kube-api-access-8vkd5\") pod \"payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m\" (UID: \"9245f865-1d0f-4efc-b40e-59b1cdd0deca\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m"
Sep 05 06:54:04.355596 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:04.355524    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m"
Sep 05 06:54:04.625291 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:04.625266    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m"]
Sep 05 06:54:04.627129 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:54:04.627100    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9245f865_1d0f_4efc_b40e_59b1cdd0deca.slice/crio-53139301493cb192f599d30b6572d1056575a33af93d221db44f5c1890e74577 WatchSource:0}: Error finding container 53139301493cb192f599d30b6572d1056575a33af93d221db44f5c1890e74577: Status 404 returned error can't find the container with id 53139301493cb192f599d30b6572d1056575a33af93d221db44f5c1890e74577
Sep 05 06:54:05.390970 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:05.390930    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m" event={"ID":"9245f865-1d0f-4efc-b40e-59b1cdd0deca","Type":"ContainerStarted","Data":"b5198f84ac0eb6795af5582654f033d8cfe71183b565cfe4b0640385273a8288"}
Sep 05 06:54:05.390970 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:05.390979    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m" event={"ID":"9245f865-1d0f-4efc-b40e-59b1cdd0deca","Type":"ContainerStarted","Data":"53139301493cb192f599d30b6572d1056575a33af93d221db44f5c1890e74577"}
Sep 05 06:54:05.391444 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:05.391091    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m"
Sep 05 06:54:05.407468 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:05.407416    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m" podStartSLOduration=1.407395917 podStartE2EDuration="1.407395917s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 06:54:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 06:54:05.406828664 +0000 UTC m=+1711.380583340" watchObservedRunningTime="2026-09-05 06:54:05.407395917 +0000 UTC m=+1711.381150605"
Sep 05 06:54:16.398263 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:16.398179    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m"
Sep 05 06:54:22.494923 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:22.494890    2567 generic.go:356] "Generic (PLEG): container finished" podID="be0cda55-6872-463a-8a51-d0e5514a977c" containerID="fcfa0dcbf0e1d793dce2f19256a5f671d4c17630b394c67d8f6ac87983e84908" exitCode=0
Sep 05 06:54:22.495347 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:22.494969    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz" event={"ID":"be0cda55-6872-463a-8a51-d0e5514a977c","Type":"ContainerDied","Data":"fcfa0dcbf0e1d793dce2f19256a5f671d4c17630b394c67d8f6ac87983e84908"}
Sep 05 06:54:22.495407 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:22.495399    2567 scope.go:117] "RemoveContainer" containerID="fcfa0dcbf0e1d793dce2f19256a5f671d4c17630b394c67d8f6ac87983e84908"
Sep 05 06:54:22.496522 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:22.496494    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:54:22.496579 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:22.496566    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:54:22.496615 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:22.496601    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 05 06:54:23.502300 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:23.502269    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz" event={"ID":"be0cda55-6872-463a-8a51-d0e5514a977c","Type":"ContainerStarted","Data":"29126c4fbc708e25ece8a66308e7dac6ee04fd78914b948f745d8c0f4a56f80b"}
Sep 05 06:54:24.116590 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:24.116551    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:54:24.116791 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:24.116771    2567 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Sep 05 06:54:24.116853 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:24.116818    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz" podUID="be0cda55-6872-463a-8a51-d0e5514a977c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Sep 05 06:54:25.116997 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:25.116945    2567 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Sep 05 06:54:25.117434 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:25.117058    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz" podUID="be0cda55-6872-463a-8a51-d0e5514a977c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Sep 05 06:54:26.117205 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:26.117167    2567 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Sep 05 06:54:26.117628 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:26.117232    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz" podUID="be0cda55-6872-463a-8a51-d0e5514a977c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Sep 05 06:54:27.117499 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:27.117463    2567 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Sep 05 06:54:27.117972 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:27.117527    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz" podUID="be0cda55-6872-463a-8a51-d0e5514a977c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Sep 05 06:54:28.005096 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:28.005056    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-703730-rlrp2"]
Sep 05 06:54:28.007667 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:28.007649    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-703730-rlrp2"
Sep 05 06:54:28.010122 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:28.010101    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 05 06:54:28.010247 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:28.010229    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tlgjj\""
Sep 05 06:54:28.016696 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:28.016671    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-703730-rlrp2"]
Sep 05 06:54:28.096306 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:28.096269    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eee28330-574e-43af-a0a1-38a4fd5fdf4f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-703730-rlrp2\" (UID: \"eee28330-574e-43af-a0a1-38a4fd5fdf4f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-703730-rlrp2"
Sep 05 06:54:28.117284 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:28.117258    2567 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Sep 05 06:54:28.117373 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:28.117306    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz" podUID="be0cda55-6872-463a-8a51-d0e5514a977c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Sep 05 06:54:28.196817 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:28.196780    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eee28330-574e-43af-a0a1-38a4fd5fdf4f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-703730-rlrp2\" (UID: \"eee28330-574e-43af-a0a1-38a4fd5fdf4f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-703730-rlrp2"
Sep 05 06:54:28.197476 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:28.197454    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eee28330-574e-43af-a0a1-38a4fd5fdf4f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-703730-rlrp2\" (UID: \"eee28330-574e-43af-a0a1-38a4fd5fdf4f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-703730-rlrp2"
Sep 05 06:54:28.318799 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:28.318716    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-703730-rlrp2"
Sep 05 06:54:28.605082 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:28.605057    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-703730-rlrp2"]
Sep 05 06:54:28.607381 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:54:28.607352    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeee28330_574e_43af_a0a1_38a4fd5fdf4f.slice/crio-f4be24c48a782e3ebf6c4f5e440ec971fa99582f9ad3bd3303d71aba7d2c0eb8 WatchSource:0}: Error finding container f4be24c48a782e3ebf6c4f5e440ec971fa99582f9ad3bd3303d71aba7d2c0eb8: Status 404 returned error can't find the container with id f4be24c48a782e3ebf6c4f5e440ec971fa99582f9ad3bd3303d71aba7d2c0eb8
Sep 05 06:54:29.116807 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:29.116763    2567 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Sep 05 06:54:29.116990 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:29.116835    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz" podUID="be0cda55-6872-463a-8a51-d0e5514a977c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Sep 05 06:54:29.533393 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:29.533359    2567 generic.go:356] "Generic (PLEG): container finished" podID="eee28330-574e-43af-a0a1-38a4fd5fdf4f" containerID="2283155e213d678b595b2dd55596b4ae85621f94058d1451f0e21667ec961783" exitCode=0
Sep 05 06:54:29.533796 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:29.533403    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-703730-rlrp2" event={"ID":"eee28330-574e-43af-a0a1-38a4fd5fdf4f","Type":"ContainerDied","Data":"2283155e213d678b595b2dd55596b4ae85621f94058d1451f0e21667ec961783"}
Sep 05 06:54:29.533796 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:29.533459    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-703730-rlrp2" event={"ID":"eee28330-574e-43af-a0a1-38a4fd5fdf4f","Type":"ContainerStarted","Data":"f4be24c48a782e3ebf6c4f5e440ec971fa99582f9ad3bd3303d71aba7d2c0eb8"}
Sep 05 06:54:30.121460 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:30.121430    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:54:30.121733 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:30.121711    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:54:30.122606 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:30.122590    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:54:30.658767 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:30.658743    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-703730-rlrp2"
Sep 05 06:54:30.724783 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:30.724756    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eee28330-574e-43af-a0a1-38a4fd5fdf4f-maas-api-service-ca\") pod \"eee28330-574e-43af-a0a1-38a4fd5fdf4f\" (UID: \"eee28330-574e-43af-a0a1-38a4fd5fdf4f\") "
Sep 05 06:54:30.725073 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:30.725052    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eee28330-574e-43af-a0a1-38a4fd5fdf4f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "eee28330-574e-43af-a0a1-38a4fd5fdf4f" (UID: "eee28330-574e-43af-a0a1-38a4fd5fdf4f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:54:30.825872 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:30.825814    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eee28330-574e-43af-a0a1-38a4fd5fdf4f-maas-api-service-ca\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:54:31.546216 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:31.546186    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-703730-rlrp2"
Sep 05 06:54:31.546443 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:31.546228    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-703730-rlrp2" event={"ID":"eee28330-574e-43af-a0a1-38a4fd5fdf4f","Type":"ContainerDied","Data":"f4be24c48a782e3ebf6c4f5e440ec971fa99582f9ad3bd3303d71aba7d2c0eb8"}
Sep 05 06:54:31.546443 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:31.546284    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4be24c48a782e3ebf6c4f5e440ec971fa99582f9ad3bd3303d71aba7d2c0eb8"
Sep 05 06:54:34.167940 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:34.167906    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m"]
Sep 05 06:54:34.168467 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:34.168163    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m" podUID="9245f865-1d0f-4efc-b40e-59b1cdd0deca" containerName="payload-pre-processing" containerID="cri-o://b5198f84ac0eb6795af5582654f033d8cfe71183b565cfe4b0640385273a8288" gracePeriod=30
Sep 05 06:54:34.324477 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:34.324442    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-703730-rlrp2"]
Sep 05 06:54:34.327431 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:34.327404    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-703730-rlrp2"]
Sep 05 06:54:34.426512 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:34.426453    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m"
Sep 05 06:54:34.454480 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:34.454454    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vkd5\" (UniqueName: \"kubernetes.io/projected/9245f865-1d0f-4efc-b40e-59b1cdd0deca-kube-api-access-8vkd5\") pod \"9245f865-1d0f-4efc-b40e-59b1cdd0deca\" (UID: \"9245f865-1d0f-4efc-b40e-59b1cdd0deca\") "
Sep 05 06:54:34.454631 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:34.454496    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9245f865-1d0f-4efc-b40e-59b1cdd0deca-plugins-config-volume\") pod \"9245f865-1d0f-4efc-b40e-59b1cdd0deca\" (UID: \"9245f865-1d0f-4efc-b40e-59b1cdd0deca\") "
Sep 05 06:54:34.454979 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:34.454943    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9245f865-1d0f-4efc-b40e-59b1cdd0deca-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9245f865-1d0f-4efc-b40e-59b1cdd0deca" (UID: "9245f865-1d0f-4efc-b40e-59b1cdd0deca"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:54:34.456774 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:34.456750    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9245f865-1d0f-4efc-b40e-59b1cdd0deca-kube-api-access-8vkd5" (OuterVolumeSpecName: "kube-api-access-8vkd5") pod "9245f865-1d0f-4efc-b40e-59b1cdd0deca" (UID: "9245f865-1d0f-4efc-b40e-59b1cdd0deca"). InnerVolumeSpecName "kube-api-access-8vkd5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:54:34.556116 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:34.556084    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vkd5\" (UniqueName: \"kubernetes.io/projected/9245f865-1d0f-4efc-b40e-59b1cdd0deca-kube-api-access-8vkd5\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:54:34.556116 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:34.556113    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9245f865-1d0f-4efc-b40e-59b1cdd0deca-plugins-config-volume\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:54:34.563717 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:34.563682    2567 generic.go:356] "Generic (PLEG): container finished" podID="9245f865-1d0f-4efc-b40e-59b1cdd0deca" containerID="b5198f84ac0eb6795af5582654f033d8cfe71183b565cfe4b0640385273a8288" exitCode=0
Sep 05 06:54:34.563853 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:34.563738    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m"
Sep 05 06:54:34.563853 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:34.563772    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m" event={"ID":"9245f865-1d0f-4efc-b40e-59b1cdd0deca","Type":"ContainerDied","Data":"b5198f84ac0eb6795af5582654f033d8cfe71183b565cfe4b0640385273a8288"}
Sep 05 06:54:34.563956 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:34.563852    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m" event={"ID":"9245f865-1d0f-4efc-b40e-59b1cdd0deca","Type":"ContainerDied","Data":"53139301493cb192f599d30b6572d1056575a33af93d221db44f5c1890e74577"}
Sep 05 06:54:34.563956 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:34.563876    2567 scope.go:117] "RemoveContainer" containerID="b5198f84ac0eb6795af5582654f033d8cfe71183b565cfe4b0640385273a8288"
Sep 05 06:54:34.573416 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:34.573401    2567 scope.go:117] "RemoveContainer" containerID="b5198f84ac0eb6795af5582654f033d8cfe71183b565cfe4b0640385273a8288"
Sep 05 06:54:34.573686 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:54:34.573667    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5198f84ac0eb6795af5582654f033d8cfe71183b565cfe4b0640385273a8288\": container with ID starting with b5198f84ac0eb6795af5582654f033d8cfe71183b565cfe4b0640385273a8288 not found: ID does not exist" containerID="b5198f84ac0eb6795af5582654f033d8cfe71183b565cfe4b0640385273a8288"
Sep 05 06:54:34.573744 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:34.573697    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5198f84ac0eb6795af5582654f033d8cfe71183b565cfe4b0640385273a8288"} err="failed to get container status \"b5198f84ac0eb6795af5582654f033d8cfe71183b565cfe4b0640385273a8288\": rpc error: code = NotFound desc = could not find container \"b5198f84ac0eb6795af5582654f033d8cfe71183b565cfe4b0640385273a8288\": container with ID starting with b5198f84ac0eb6795af5582654f033d8cfe71183b565cfe4b0640385273a8288 not found: ID does not exist"
Sep 05 06:54:34.580534 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:34.580511    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eee28330-574e-43af-a0a1-38a4fd5fdf4f" path="/var/lib/kubelet/pods/eee28330-574e-43af-a0a1-38a4fd5fdf4f/volumes"
Sep 05 06:54:34.585716 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:34.585695    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m"]
Sep 05 06:54:34.587632 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:34.587614    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m"]
Sep 05 06:54:36.580808 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:36.580779    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9245f865-1d0f-4efc-b40e-59b1cdd0deca" path="/var/lib/kubelet/pods/9245f865-1d0f-4efc-b40e-59b1cdd0deca/volumes"
Sep 05 06:54:40.976336 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:40.976303    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"]
Sep 05 06:54:40.976760 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:40.976523    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz" podUID="be0cda55-6872-463a-8a51-d0e5514a977c" containerName="istio-proxy" containerID="cri-o://29126c4fbc708e25ece8a66308e7dac6ee04fd78914b948f745d8c0f4a56f80b" gracePeriod=30
Sep 05 06:54:44.749350 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:44.749314    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-73a747-nwqtj"]
Sep 05 06:54:44.749857 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:44.749734    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9245f865-1d0f-4efc-b40e-59b1cdd0deca" containerName="payload-pre-processing"
Sep 05 06:54:44.749857 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:44.749750    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9245f865-1d0f-4efc-b40e-59b1cdd0deca" containerName="payload-pre-processing"
Sep 05 06:54:44.749857 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:44.749764    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eee28330-574e-43af-a0a1-38a4fd5fdf4f" containerName="revoke-keys"
Sep 05 06:54:44.749857 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:44.749772    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="eee28330-574e-43af-a0a1-38a4fd5fdf4f" containerName="revoke-keys"
Sep 05 06:54:44.749857 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:44.749851    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9245f865-1d0f-4efc-b40e-59b1cdd0deca" containerName="payload-pre-processing"
Sep 05 06:54:44.749857 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:44.749860    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="eee28330-574e-43af-a0a1-38a4fd5fdf4f" containerName="revoke-keys"
Sep 05 06:54:44.752597 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:44.752578    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-73a747-nwqtj"
Sep 05 06:54:44.755241 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:44.755215    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 05 06:54:44.755353 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:44.755226    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tlgjj\""
Sep 05 06:54:44.760307 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:44.760280    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-73a747-nwqtj"]
Sep 05 06:54:44.850286 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:44.850259    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f59e3389-3bf0-4e5b-93f5-95fadfb5b5f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-73a747-nwqtj\" (UID: \"f59e3389-3bf0-4e5b-93f5-95fadfb5b5f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-73a747-nwqtj"
Sep 05 06:54:44.951104 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:44.951077    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f59e3389-3bf0-4e5b-93f5-95fadfb5b5f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-73a747-nwqtj\" (UID: \"f59e3389-3bf0-4e5b-93f5-95fadfb5b5f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-73a747-nwqtj"
Sep 05 06:54:44.951699 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:44.951678    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f59e3389-3bf0-4e5b-93f5-95fadfb5b5f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-73a747-nwqtj\" (UID: \"f59e3389-3bf0-4e5b-93f5-95fadfb5b5f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-73a747-nwqtj"
Sep 05 06:54:45.064689 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:45.064605    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-73a747-nwqtj"
Sep 05 06:54:45.124668 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:45.124632    2567 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 05 06:54:45.124868 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:45.124746    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz" podUID="be0cda55-6872-463a-8a51-d0e5514a977c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 05 06:54:45.332209 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:45.332182    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-73a747-nwqtj"]
Sep 05 06:54:45.334117 ip-10-0-141-49 kubenswrapper[2567]: W0905 06:54:45.334092    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf59e3389_3bf0_4e5b_93f5_95fadfb5b5f4.slice/crio-af7253e2ef30a73d82f2c349183c71f7f55c7b25e6a500c09eea736083f0b212 WatchSource:0}: Error finding container af7253e2ef30a73d82f2c349183c71f7f55c7b25e6a500c09eea736083f0b212: Status 404 returned error can't find the container with id af7253e2ef30a73d82f2c349183c71f7f55c7b25e6a500c09eea736083f0b212
Sep 05 06:54:45.618041 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:45.617959    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-73a747-nwqtj" event={"ID":"f59e3389-3bf0-4e5b-93f5-95fadfb5b5f4","Type":"ContainerStarted","Data":"af7253e2ef30a73d82f2c349183c71f7f55c7b25e6a500c09eea736083f0b212"}
Sep 05 06:54:46.223365 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.223344    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:54:46.365310 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.365235    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be0cda55-6872-463a-8a51-d0e5514a977c-istio-envoy\") pod \"be0cda55-6872-463a-8a51-d0e5514a977c\" (UID: \"be0cda55-6872-463a-8a51-d0e5514a977c\") "
Sep 05 06:54:46.365310 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.365278    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4v68z\" (UniqueName: \"kubernetes.io/projected/be0cda55-6872-463a-8a51-d0e5514a977c-kube-api-access-4v68z\") pod \"be0cda55-6872-463a-8a51-d0e5514a977c\" (UID: \"be0cda55-6872-463a-8a51-d0e5514a977c\") "
Sep 05 06:54:46.365310 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.365308    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be0cda55-6872-463a-8a51-d0e5514a977c-workload-certs\") pod \"be0cda55-6872-463a-8a51-d0e5514a977c\" (UID: \"be0cda55-6872-463a-8a51-d0e5514a977c\") "
Sep 05 06:54:46.365585 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.365340    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be0cda55-6872-463a-8a51-d0e5514a977c-istiod-ca-cert\") pod \"be0cda55-6872-463a-8a51-d0e5514a977c\" (UID: \"be0cda55-6872-463a-8a51-d0e5514a977c\") "
Sep 05 06:54:46.365585 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.365371    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be0cda55-6872-463a-8a51-d0e5514a977c-workload-socket\") pod \"be0cda55-6872-463a-8a51-d0e5514a977c\" (UID: \"be0cda55-6872-463a-8a51-d0e5514a977c\") "
Sep 05 06:54:46.365585 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.365393    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be0cda55-6872-463a-8a51-d0e5514a977c-credential-socket\") pod \"be0cda55-6872-463a-8a51-d0e5514a977c\" (UID: \"be0cda55-6872-463a-8a51-d0e5514a977c\") "
Sep 05 06:54:46.365585 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.365458    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be0cda55-6872-463a-8a51-d0e5514a977c-istio-podinfo\") pod \"be0cda55-6872-463a-8a51-d0e5514a977c\" (UID: \"be0cda55-6872-463a-8a51-d0e5514a977c\") "
Sep 05 06:54:46.365585 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.365484    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be0cda55-6872-463a-8a51-d0e5514a977c-istio-token\") pod \"be0cda55-6872-463a-8a51-d0e5514a977c\" (UID: \"be0cda55-6872-463a-8a51-d0e5514a977c\") "
Sep 05 06:54:46.365585 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.365531    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be0cda55-6872-463a-8a51-d0e5514a977c-istio-data\") pod \"be0cda55-6872-463a-8a51-d0e5514a977c\" (UID: \"be0cda55-6872-463a-8a51-d0e5514a977c\") "
Sep 05 06:54:46.365896 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.365654    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be0cda55-6872-463a-8a51-d0e5514a977c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "be0cda55-6872-463a-8a51-d0e5514a977c" (UID: "be0cda55-6872-463a-8a51-d0e5514a977c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:54:46.365896 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.365672    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be0cda55-6872-463a-8a51-d0e5514a977c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "be0cda55-6872-463a-8a51-d0e5514a977c" (UID: "be0cda55-6872-463a-8a51-d0e5514a977c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:54:46.365896 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.365845    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be0cda55-6872-463a-8a51-d0e5514a977c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "be0cda55-6872-463a-8a51-d0e5514a977c" (UID: "be0cda55-6872-463a-8a51-d0e5514a977c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:54:46.365896 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.365868    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be0cda55-6872-463a-8a51-d0e5514a977c-istio-data" (OuterVolumeSpecName: "istio-data") pod "be0cda55-6872-463a-8a51-d0e5514a977c" (UID: "be0cda55-6872-463a-8a51-d0e5514a977c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:54:46.366524 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.366403    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be0cda55-6872-463a-8a51-d0e5514a977c-workload-certs\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:54:46.366524 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.366435    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be0cda55-6872-463a-8a51-d0e5514a977c-istiod-ca-cert\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:54:46.366524 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.366461    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be0cda55-6872-463a-8a51-d0e5514a977c-workload-socket\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:54:46.366524 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.366475    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be0cda55-6872-463a-8a51-d0e5514a977c-istio-data\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:54:46.366790 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.366598    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be0cda55-6872-463a-8a51-d0e5514a977c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "be0cda55-6872-463a-8a51-d0e5514a977c" (UID: "be0cda55-6872-463a-8a51-d0e5514a977c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:54:46.368095 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.368063    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be0cda55-6872-463a-8a51-d0e5514a977c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "be0cda55-6872-463a-8a51-d0e5514a977c" (UID: "be0cda55-6872-463a-8a51-d0e5514a977c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:54:46.368479 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.368453    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be0cda55-6872-463a-8a51-d0e5514a977c-kube-api-access-4v68z" (OuterVolumeSpecName: "kube-api-access-4v68z") pod "be0cda55-6872-463a-8a51-d0e5514a977c" (UID: "be0cda55-6872-463a-8a51-d0e5514a977c"). InnerVolumeSpecName "kube-api-access-4v68z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:54:46.375102 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.375065    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be0cda55-6872-463a-8a51-d0e5514a977c-istio-token" (OuterVolumeSpecName: "istio-token") pod "be0cda55-6872-463a-8a51-d0e5514a977c" (UID: "be0cda55-6872-463a-8a51-d0e5514a977c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:54:46.375990 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.375961    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/be0cda55-6872-463a-8a51-d0e5514a977c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "be0cda55-6872-463a-8a51-d0e5514a977c" (UID: "be0cda55-6872-463a-8a51-d0e5514a977c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 05 06:54:46.467083 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.467050    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be0cda55-6872-463a-8a51-d0e5514a977c-credential-socket\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:54:46.467083 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.467082    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be0cda55-6872-463a-8a51-d0e5514a977c-istio-podinfo\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:54:46.467083 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.467092    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be0cda55-6872-463a-8a51-d0e5514a977c-istio-token\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:54:46.467255 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.467099    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be0cda55-6872-463a-8a51-d0e5514a977c-istio-envoy\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:54:46.467255 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.467126    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4v68z\" (UniqueName: \"kubernetes.io/projected/be0cda55-6872-463a-8a51-d0e5514a977c-kube-api-access-4v68z\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:54:46.624937 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.624870    2567 generic.go:356] "Generic (PLEG): container finished" podID="be0cda55-6872-463a-8a51-d0e5514a977c" containerID="29126c4fbc708e25ece8a66308e7dac6ee04fd78914b948f745d8c0f4a56f80b" exitCode=0
Sep 05 06:54:46.624937 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.624927    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"
Sep 05 06:54:46.625116 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.624956    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz" event={"ID":"be0cda55-6872-463a-8a51-d0e5514a977c","Type":"ContainerDied","Data":"29126c4fbc708e25ece8a66308e7dac6ee04fd78914b948f745d8c0f4a56f80b"}
Sep 05 06:54:46.625116 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.625008    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz" event={"ID":"be0cda55-6872-463a-8a51-d0e5514a977c","Type":"ContainerDied","Data":"b30d2ab40f61fc35a19b90ba9c1e0ef1b71d589d9a6cf249b39a85449784bad0"}
Sep 05 06:54:46.625116 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.625063    2567 scope.go:117] "RemoveContainer" containerID="29126c4fbc708e25ece8a66308e7dac6ee04fd78914b948f745d8c0f4a56f80b"
Sep 05 06:54:46.626911 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.626873    2567 generic.go:356] "Generic (PLEG): container finished" podID="f59e3389-3bf0-4e5b-93f5-95fadfb5b5f4" containerID="11fc67f552979e5c288d774f4e9c6813f7d554af1dca5b54fd43938e8281267b" exitCode=0
Sep 05 06:54:46.627063 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.626958    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-73a747-nwqtj" event={"ID":"f59e3389-3bf0-4e5b-93f5-95fadfb5b5f4","Type":"ContainerDied","Data":"11fc67f552979e5c288d774f4e9c6813f7d554af1dca5b54fd43938e8281267b"}
Sep 05 06:54:46.633939 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.633923    2567 scope.go:117] "RemoveContainer" containerID="fcfa0dcbf0e1d793dce2f19256a5f671d4c17630b394c67d8f6ac87983e84908"
Sep 05 06:54:46.641815 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.641797    2567 scope.go:117] "RemoveContainer" containerID="29126c4fbc708e25ece8a66308e7dac6ee04fd78914b948f745d8c0f4a56f80b"
Sep 05 06:54:46.642106 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:54:46.642079    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29126c4fbc708e25ece8a66308e7dac6ee04fd78914b948f745d8c0f4a56f80b\": container with ID starting with 29126c4fbc708e25ece8a66308e7dac6ee04fd78914b948f745d8c0f4a56f80b not found: ID does not exist" containerID="29126c4fbc708e25ece8a66308e7dac6ee04fd78914b948f745d8c0f4a56f80b"
Sep 05 06:54:46.642190 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.642113    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29126c4fbc708e25ece8a66308e7dac6ee04fd78914b948f745d8c0f4a56f80b"} err="failed to get container status \"29126c4fbc708e25ece8a66308e7dac6ee04fd78914b948f745d8c0f4a56f80b\": rpc error: code = NotFound desc = could not find container \"29126c4fbc708e25ece8a66308e7dac6ee04fd78914b948f745d8c0f4a56f80b\": container with ID starting with 29126c4fbc708e25ece8a66308e7dac6ee04fd78914b948f745d8c0f4a56f80b not found: ID does not exist"
Sep 05 06:54:46.642190 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.642129    2567 scope.go:117] "RemoveContainer" containerID="fcfa0dcbf0e1d793dce2f19256a5f671d4c17630b394c67d8f6ac87983e84908"
Sep 05 06:54:46.642401 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:54:46.642378    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcfa0dcbf0e1d793dce2f19256a5f671d4c17630b394c67d8f6ac87983e84908\": container with ID starting with fcfa0dcbf0e1d793dce2f19256a5f671d4c17630b394c67d8f6ac87983e84908 not found: ID does not exist" containerID="fcfa0dcbf0e1d793dce2f19256a5f671d4c17630b394c67d8f6ac87983e84908"
Sep 05 06:54:46.642493 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.642407    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcfa0dcbf0e1d793dce2f19256a5f671d4c17630b394c67d8f6ac87983e84908"} err="failed to get container status \"fcfa0dcbf0e1d793dce2f19256a5f671d4c17630b394c67d8f6ac87983e84908\": rpc error: code = NotFound desc = could not find container \"fcfa0dcbf0e1d793dce2f19256a5f671d4c17630b394c67d8f6ac87983e84908\": container with ID starting with fcfa0dcbf0e1d793dce2f19256a5f671d4c17630b394c67d8f6ac87983e84908 not found: ID does not exist"
Sep 05 06:54:46.656103 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.656082    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"]
Sep 05 06:54:46.661706 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:46.661680    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz"]
Sep 05 06:54:47.768949 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:47.768927    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-73a747-nwqtj"
Sep 05 06:54:47.879171 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:47.879142    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f59e3389-3bf0-4e5b-93f5-95fadfb5b5f4-maas-api-service-ca\") pod \"f59e3389-3bf0-4e5b-93f5-95fadfb5b5f4\" (UID: \"f59e3389-3bf0-4e5b-93f5-95fadfb5b5f4\") "
Sep 05 06:54:47.879511 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:47.879492    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f59e3389-3bf0-4e5b-93f5-95fadfb5b5f4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f59e3389-3bf0-4e5b-93f5-95fadfb5b5f4" (UID: "f59e3389-3bf0-4e5b-93f5-95fadfb5b5f4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:54:47.979721 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:47.979693    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f59e3389-3bf0-4e5b-93f5-95fadfb5b5f4-maas-api-service-ca\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:54:48.581101 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:48.581056    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be0cda55-6872-463a-8a51-d0e5514a977c" path="/var/lib/kubelet/pods/be0cda55-6872-463a-8a51-d0e5514a977c/volumes"
Sep 05 06:54:48.640931 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:48.640907    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-73a747-nwqtj"
Sep 05 06:54:48.641079 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:48.640898    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-73a747-nwqtj" event={"ID":"f59e3389-3bf0-4e5b-93f5-95fadfb5b5f4","Type":"ContainerDied","Data":"af7253e2ef30a73d82f2c349183c71f7f55c7b25e6a500c09eea736083f0b212"}
Sep 05 06:54:48.641079 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:54:48.641058    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="af7253e2ef30a73d82f2c349183c71f7f55c7b25e6a500c09eea736083f0b212"
Sep 05 06:55:00.459201 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:00.459165    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-73a747-nwqtj"]
Sep 05 06:55:00.460976 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:00.460955    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-73a747-nwqtj"]
Sep 05 06:55:00.581779 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:00.581738    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f59e3389-3bf0-4e5b-93f5-95fadfb5b5f4" path="/var/lib/kubelet/pods/f59e3389-3bf0-4e5b-93f5-95fadfb5b5f4/volumes"
Sep 05 06:55:05.798315 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:05.798279    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp"]
Sep 05 06:55:20.818131 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:20.818076    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp" podUID="bec0518d-16a4-4201-922c-4a785631ce57" containerName="main" containerID="cri-o://c6124123d48e7cd7acf62734ac4d7e5d943dbb78a9ffcc16f738004f8f9e0b54" gracePeriod=45
Sep 05 06:55:21.068190 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:21.068134    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp"
Sep 05 06:55:21.159317 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:21.159284    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bec0518d-16a4-4201-922c-4a785631ce57-dshm\") pod \"bec0518d-16a4-4201-922c-4a785631ce57\" (UID: \"bec0518d-16a4-4201-922c-4a785631ce57\") "
Sep 05 06:55:21.159473 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:21.159362    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bec0518d-16a4-4201-922c-4a785631ce57-home\") pod \"bec0518d-16a4-4201-922c-4a785631ce57\" (UID: \"bec0518d-16a4-4201-922c-4a785631ce57\") "
Sep 05 06:55:21.159473 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:21.159397    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bec0518d-16a4-4201-922c-4a785631ce57-tmp-dir\") pod \"bec0518d-16a4-4201-922c-4a785631ce57\" (UID: \"bec0518d-16a4-4201-922c-4a785631ce57\") "
Sep 05 06:55:21.159473 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:21.159415    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x44pz\" (UniqueName: \"kubernetes.io/projected/bec0518d-16a4-4201-922c-4a785631ce57-kube-api-access-x44pz\") pod \"bec0518d-16a4-4201-922c-4a785631ce57\" (UID: \"bec0518d-16a4-4201-922c-4a785631ce57\") "
Sep 05 06:55:21.159473 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:21.159449    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bec0518d-16a4-4201-922c-4a785631ce57-model-cache\") pod \"bec0518d-16a4-4201-922c-4a785631ce57\" (UID: \"bec0518d-16a4-4201-922c-4a785631ce57\") "
Sep 05 06:55:21.159669 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:21.159589    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bec0518d-16a4-4201-922c-4a785631ce57-tls-certs\") pod \"bec0518d-16a4-4201-922c-4a785631ce57\" (UID: \"bec0518d-16a4-4201-922c-4a785631ce57\") "
Sep 05 06:55:21.159669 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:21.159661    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bec0518d-16a4-4201-922c-4a785631ce57-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bec0518d-16a4-4201-922c-4a785631ce57" (UID: "bec0518d-16a4-4201-922c-4a785631ce57"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:55:21.159765 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:21.159675    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bec0518d-16a4-4201-922c-4a785631ce57-home" (OuterVolumeSpecName: "home") pod "bec0518d-16a4-4201-922c-4a785631ce57" (UID: "bec0518d-16a4-4201-922c-4a785631ce57"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:55:21.159765 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:21.159686    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bec0518d-16a4-4201-922c-4a785631ce57-model-cache" (OuterVolumeSpecName: "model-cache") pod "bec0518d-16a4-4201-922c-4a785631ce57" (UID: "bec0518d-16a4-4201-922c-4a785631ce57"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:55:21.160043 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:21.159953    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bec0518d-16a4-4201-922c-4a785631ce57-tmp-dir\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:55:21.160043 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:21.159978    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bec0518d-16a4-4201-922c-4a785631ce57-model-cache\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:55:21.160043 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:21.159990    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bec0518d-16a4-4201-922c-4a785631ce57-home\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:55:21.161672 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:21.161651    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bec0518d-16a4-4201-922c-4a785631ce57-dshm" (OuterVolumeSpecName: "dshm") pod "bec0518d-16a4-4201-922c-4a785631ce57" (UID: "bec0518d-16a4-4201-922c-4a785631ce57"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:55:21.161800 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:21.161682    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bec0518d-16a4-4201-922c-4a785631ce57-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bec0518d-16a4-4201-922c-4a785631ce57" (UID: "bec0518d-16a4-4201-922c-4a785631ce57"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 05 06:55:21.161800 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:21.161739    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bec0518d-16a4-4201-922c-4a785631ce57-kube-api-access-x44pz" (OuterVolumeSpecName: "kube-api-access-x44pz") pod "bec0518d-16a4-4201-922c-4a785631ce57" (UID: "bec0518d-16a4-4201-922c-4a785631ce57"). InnerVolumeSpecName "kube-api-access-x44pz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:55:21.260723 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:21.260702    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bec0518d-16a4-4201-922c-4a785631ce57-tls-certs\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:55:21.260723 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:21.260722    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bec0518d-16a4-4201-922c-4a785631ce57-dshm\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:55:21.260856 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:21.260731    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x44pz\" (UniqueName: \"kubernetes.io/projected/bec0518d-16a4-4201-922c-4a785631ce57-kube-api-access-x44pz\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:55:21.814433 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:21.814396    2567 generic.go:356] "Generic (PLEG): container finished" podID="bec0518d-16a4-4201-922c-4a785631ce57" containerID="c6124123d48e7cd7acf62734ac4d7e5d943dbb78a9ffcc16f738004f8f9e0b54" exitCode=0
Sep 05 06:55:21.814593 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:21.814440    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp"
Sep 05 06:55:21.814593 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:21.814476    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp" event={"ID":"bec0518d-16a4-4201-922c-4a785631ce57","Type":"ContainerDied","Data":"c6124123d48e7cd7acf62734ac4d7e5d943dbb78a9ffcc16f738004f8f9e0b54"}
Sep 05 06:55:21.814593 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:21.814519    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp" event={"ID":"bec0518d-16a4-4201-922c-4a785631ce57","Type":"ContainerDied","Data":"85414744906a06bdd4dbd23d77b585e1c9fbc66b1cb4f699805ac386d9a34744"}
Sep 05 06:55:21.814593 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:21.814538    2567 scope.go:117] "RemoveContainer" containerID="c6124123d48e7cd7acf62734ac4d7e5d943dbb78a9ffcc16f738004f8f9e0b54"
Sep 05 06:55:21.824352 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:21.824209    2567 scope.go:117] "RemoveContainer" containerID="c6124123d48e7cd7acf62734ac4d7e5d943dbb78a9ffcc16f738004f8f9e0b54"
Sep 05 06:55:21.824553 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:55:21.824507    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6124123d48e7cd7acf62734ac4d7e5d943dbb78a9ffcc16f738004f8f9e0b54\": container with ID starting with c6124123d48e7cd7acf62734ac4d7e5d943dbb78a9ffcc16f738004f8f9e0b54 not found: ID does not exist" containerID="c6124123d48e7cd7acf62734ac4d7e5d943dbb78a9ffcc16f738004f8f9e0b54"
Sep 05 06:55:21.824553 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:21.824532    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6124123d48e7cd7acf62734ac4d7e5d943dbb78a9ffcc16f738004f8f9e0b54"} err="failed to get container status \"c6124123d48e7cd7acf62734ac4d7e5d943dbb78a9ffcc16f738004f8f9e0b54\": rpc error: code = NotFound desc = could not find container \"c6124123d48e7cd7acf62734ac4d7e5d943dbb78a9ffcc16f738004f8f9e0b54\": container with ID starting with c6124123d48e7cd7acf62734ac4d7e5d943dbb78a9ffcc16f738004f8f9e0b54 not found: ID does not exist"
Sep 05 06:55:21.835209 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:21.835183    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp"]
Sep 05 06:55:21.837367 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:21.837347    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-73a747/ipp-route-73a747-kserve-6484848bf5-nblwp"]
Sep 05 06:55:22.583388 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:22.583352    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bec0518d-16a4-4201-922c-4a785631ce57" path="/var/lib/kubelet/pods/bec0518d-16a4-4201-922c-4a785631ce57/volumes"
Sep 05 06:55:34.787187 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:34.787159    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bb4_7f8a8f16-2422-4c01-a619-1f17fe10cd4c/ovn-acl-logging/0.log"
Sep 05 06:55:34.789435 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:34.789404    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bb4_7f8a8f16-2422-4c01-a619-1f17fe10cd4c/ovn-acl-logging/0.log"
Sep 05 06:55:59.933660 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:59.933610    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49"]
Sep 05 06:55:59.934263 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:55:59.933906    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49" podUID="3a38e906-6d54-4e44-841f-35e8dfb9e96a" containerName="payload-pre-processing" containerID="cri-o://0b591358e3165ff0b138eb6b5d20ee232a4b3b129b0c89ab44dbbe56fc91f07d" gracePeriod=30
Sep 05 06:56:00.191696 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:00.191627    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49"
Sep 05 06:56:00.302645 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:00.302614    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a38e906-6d54-4e44-841f-35e8dfb9e96a-plugins-config-volume\") pod \"3a38e906-6d54-4e44-841f-35e8dfb9e96a\" (UID: \"3a38e906-6d54-4e44-841f-35e8dfb9e96a\") "
Sep 05 06:56:00.302823 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:00.302660    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9w9d\" (UniqueName: \"kubernetes.io/projected/3a38e906-6d54-4e44-841f-35e8dfb9e96a-kube-api-access-r9w9d\") pod \"3a38e906-6d54-4e44-841f-35e8dfb9e96a\" (UID: \"3a38e906-6d54-4e44-841f-35e8dfb9e96a\") "
Sep 05 06:56:00.302960 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:00.302935    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a38e906-6d54-4e44-841f-35e8dfb9e96a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3a38e906-6d54-4e44-841f-35e8dfb9e96a" (UID: "3a38e906-6d54-4e44-841f-35e8dfb9e96a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:56:00.303125 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:00.303110    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a38e906-6d54-4e44-841f-35e8dfb9e96a-plugins-config-volume\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:56:00.305375 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:00.305330    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a38e906-6d54-4e44-841f-35e8dfb9e96a-kube-api-access-r9w9d" (OuterVolumeSpecName: "kube-api-access-r9w9d") pod "3a38e906-6d54-4e44-841f-35e8dfb9e96a" (UID: "3a38e906-6d54-4e44-841f-35e8dfb9e96a"). InnerVolumeSpecName "kube-api-access-r9w9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:56:00.403892 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:00.403847    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9w9d\" (UniqueName: \"kubernetes.io/projected/3a38e906-6d54-4e44-841f-35e8dfb9e96a-kube-api-access-r9w9d\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:56:01.013625 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:01.013589    2567 generic.go:356] "Generic (PLEG): container finished" podID="3a38e906-6d54-4e44-841f-35e8dfb9e96a" containerID="0b591358e3165ff0b138eb6b5d20ee232a4b3b129b0c89ab44dbbe56fc91f07d" exitCode=0
Sep 05 06:56:01.014118 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:01.013635    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49"
Sep 05 06:56:01.014118 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:01.013681    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49" event={"ID":"3a38e906-6d54-4e44-841f-35e8dfb9e96a","Type":"ContainerDied","Data":"0b591358e3165ff0b138eb6b5d20ee232a4b3b129b0c89ab44dbbe56fc91f07d"}
Sep 05 06:56:01.014118 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:01.013740    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49" event={"ID":"3a38e906-6d54-4e44-841f-35e8dfb9e96a","Type":"ContainerDied","Data":"b6cb8ac57fafbfa4d61e19e3051f95b87a97e711684d84b119e080bbd75af6fc"}
Sep 05 06:56:01.014118 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:01.013768    2567 scope.go:117] "RemoveContainer" containerID="0b591358e3165ff0b138eb6b5d20ee232a4b3b129b0c89ab44dbbe56fc91f07d"
Sep 05 06:56:01.024916 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:01.024897    2567 scope.go:117] "RemoveContainer" containerID="0b591358e3165ff0b138eb6b5d20ee232a4b3b129b0c89ab44dbbe56fc91f07d"
Sep 05 06:56:01.025246 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:56:01.025226    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b591358e3165ff0b138eb6b5d20ee232a4b3b129b0c89ab44dbbe56fc91f07d\": container with ID starting with 0b591358e3165ff0b138eb6b5d20ee232a4b3b129b0c89ab44dbbe56fc91f07d not found: ID does not exist" containerID="0b591358e3165ff0b138eb6b5d20ee232a4b3b129b0c89ab44dbbe56fc91f07d"
Sep 05 06:56:01.025307 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:01.025256    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b591358e3165ff0b138eb6b5d20ee232a4b3b129b0c89ab44dbbe56fc91f07d"} err="failed to get container status \"0b591358e3165ff0b138eb6b5d20ee232a4b3b129b0c89ab44dbbe56fc91f07d\": rpc error: code = NotFound desc = could not find container \"0b591358e3165ff0b138eb6b5d20ee232a4b3b129b0c89ab44dbbe56fc91f07d\": container with ID starting with 0b591358e3165ff0b138eb6b5d20ee232a4b3b129b0c89ab44dbbe56fc91f07d not found: ID does not exist"
Sep 05 06:56:01.032737 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:01.032714    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49"]
Sep 05 06:56:01.039405 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:01.039384    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49"]
Sep 05 06:56:02.580355 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:02.580325    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a38e906-6d54-4e44-841f-35e8dfb9e96a" path="/var/lib/kubelet/pods/3a38e906-6d54-4e44-841f-35e8dfb9e96a/volumes"
Sep 05 06:56:06.668716 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:06.668673    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"]
Sep 05 06:56:06.669152 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:06.668957    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg" podUID="c845abef-fb7a-420a-9e34-ae67744c97e1" containerName="istio-proxy" containerID="cri-o://7046ee2a680d30da94ddbb973c3422c79385f2329c2755dbcd3713d757b81319" gracePeriod=30
Sep 05 06:56:11.916499 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:11.916474    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:56:12.005112 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.005081    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c845abef-fb7a-420a-9e34-ae67744c97e1-credential-socket\") pod \"c845abef-fb7a-420a-9e34-ae67744c97e1\" (UID: \"c845abef-fb7a-420a-9e34-ae67744c97e1\") "
Sep 05 06:56:12.005302 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.005131    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c845abef-fb7a-420a-9e34-ae67744c97e1-workload-certs\") pod \"c845abef-fb7a-420a-9e34-ae67744c97e1\" (UID: \"c845abef-fb7a-420a-9e34-ae67744c97e1\") "
Sep 05 06:56:12.005302 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.005157    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c845abef-fb7a-420a-9e34-ae67744c97e1-istio-data\") pod \"c845abef-fb7a-420a-9e34-ae67744c97e1\" (UID: \"c845abef-fb7a-420a-9e34-ae67744c97e1\") "
Sep 05 06:56:12.005302 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.005175    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gnz9v\" (UniqueName: \"kubernetes.io/projected/c845abef-fb7a-420a-9e34-ae67744c97e1-kube-api-access-gnz9v\") pod \"c845abef-fb7a-420a-9e34-ae67744c97e1\" (UID: \"c845abef-fb7a-420a-9e34-ae67744c97e1\") "
Sep 05 06:56:12.005302 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.005198    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c845abef-fb7a-420a-9e34-ae67744c97e1-istio-envoy\") pod \"c845abef-fb7a-420a-9e34-ae67744c97e1\" (UID: \"c845abef-fb7a-420a-9e34-ae67744c97e1\") "
Sep 05 06:56:12.005302 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.005220    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c845abef-fb7a-420a-9e34-ae67744c97e1-istio-podinfo\") pod \"c845abef-fb7a-420a-9e34-ae67744c97e1\" (UID: \"c845abef-fb7a-420a-9e34-ae67744c97e1\") "
Sep 05 06:56:12.005577 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.005312    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c845abef-fb7a-420a-9e34-ae67744c97e1-istiod-ca-cert\") pod \"c845abef-fb7a-420a-9e34-ae67744c97e1\" (UID: \"c845abef-fb7a-420a-9e34-ae67744c97e1\") "
Sep 05 06:56:12.005577 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.005344    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c845abef-fb7a-420a-9e34-ae67744c97e1-workload-socket\") pod \"c845abef-fb7a-420a-9e34-ae67744c97e1\" (UID: \"c845abef-fb7a-420a-9e34-ae67744c97e1\") "
Sep 05 06:56:12.005577 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.005378    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c845abef-fb7a-420a-9e34-ae67744c97e1-istio-token\") pod \"c845abef-fb7a-420a-9e34-ae67744c97e1\" (UID: \"c845abef-fb7a-420a-9e34-ae67744c97e1\") "
Sep 05 06:56:12.005577 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.005390    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c845abef-fb7a-420a-9e34-ae67744c97e1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c845abef-fb7a-420a-9e34-ae67744c97e1" (UID: "c845abef-fb7a-420a-9e34-ae67744c97e1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:56:12.005577 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.005447    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c845abef-fb7a-420a-9e34-ae67744c97e1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c845abef-fb7a-420a-9e34-ae67744c97e1" (UID: "c845abef-fb7a-420a-9e34-ae67744c97e1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:56:12.005819 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.005607    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c845abef-fb7a-420a-9e34-ae67744c97e1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c845abef-fb7a-420a-9e34-ae67744c97e1" (UID: "c845abef-fb7a-420a-9e34-ae67744c97e1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:56:12.005819 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.005699    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c845abef-fb7a-420a-9e34-ae67744c97e1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c845abef-fb7a-420a-9e34-ae67744c97e1" (UID: "c845abef-fb7a-420a-9e34-ae67744c97e1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:56:12.005819 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.005800    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c845abef-fb7a-420a-9e34-ae67744c97e1-istiod-ca-cert\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:56:12.005973 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.005822    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c845abef-fb7a-420a-9e34-ae67744c97e1-workload-socket\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:56:12.005973 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.005925    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c845abef-fb7a-420a-9e34-ae67744c97e1-credential-socket\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:56:12.005973 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.005947    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c845abef-fb7a-420a-9e34-ae67744c97e1-workload-certs\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:56:12.005973 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.005915    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c845abef-fb7a-420a-9e34-ae67744c97e1-istio-data" (OuterVolumeSpecName: "istio-data") pod "c845abef-fb7a-420a-9e34-ae67744c97e1" (UID: "c845abef-fb7a-420a-9e34-ae67744c97e1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:56:12.007664 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.007639    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c845abef-fb7a-420a-9e34-ae67744c97e1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c845abef-fb7a-420a-9e34-ae67744c97e1" (UID: "c845abef-fb7a-420a-9e34-ae67744c97e1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 05 06:56:12.007664 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.007644    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c845abef-fb7a-420a-9e34-ae67744c97e1-istio-token" (OuterVolumeSpecName: "istio-token") pod "c845abef-fb7a-420a-9e34-ae67744c97e1" (UID: "c845abef-fb7a-420a-9e34-ae67744c97e1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:56:12.007826 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.007687    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c845abef-fb7a-420a-9e34-ae67744c97e1-kube-api-access-gnz9v" (OuterVolumeSpecName: "kube-api-access-gnz9v") pod "c845abef-fb7a-420a-9e34-ae67744c97e1" (UID: "c845abef-fb7a-420a-9e34-ae67744c97e1"). InnerVolumeSpecName "kube-api-access-gnz9v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:56:12.007826 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.007736    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c845abef-fb7a-420a-9e34-ae67744c97e1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c845abef-fb7a-420a-9e34-ae67744c97e1" (UID: "c845abef-fb7a-420a-9e34-ae67744c97e1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:56:12.072109 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.072082    2567 generic.go:356] "Generic (PLEG): container finished" podID="c845abef-fb7a-420a-9e34-ae67744c97e1" containerID="7046ee2a680d30da94ddbb973c3422c79385f2329c2755dbcd3713d757b81319" exitCode=0
Sep 05 06:56:12.072275 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.072127    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"
Sep 05 06:56:12.072275 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.072163    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg" event={"ID":"c845abef-fb7a-420a-9e34-ae67744c97e1","Type":"ContainerDied","Data":"7046ee2a680d30da94ddbb973c3422c79385f2329c2755dbcd3713d757b81319"}
Sep 05 06:56:12.072275 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.072225    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg" event={"ID":"c845abef-fb7a-420a-9e34-ae67744c97e1","Type":"ContainerDied","Data":"bb6f4e335bb3f22d24d77be0644049dc04b06aa227700bb2acc7e624cec1e83a"}
Sep 05 06:56:12.072275 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.072255    2567 scope.go:117] "RemoveContainer" containerID="7046ee2a680d30da94ddbb973c3422c79385f2329c2755dbcd3713d757b81319"
Sep 05 06:56:12.081298 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.081280    2567 scope.go:117] "RemoveContainer" containerID="1120dd4fe1bb612d184bb6b239bc5ac3ab9ab673e2cdfef6cf77a10346625809"
Sep 05 06:56:12.088872 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.088845    2567 scope.go:117] "RemoveContainer" containerID="7046ee2a680d30da94ddbb973c3422c79385f2329c2755dbcd3713d757b81319"
Sep 05 06:56:12.089155 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:56:12.089135    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7046ee2a680d30da94ddbb973c3422c79385f2329c2755dbcd3713d757b81319\": container with ID starting with 7046ee2a680d30da94ddbb973c3422c79385f2329c2755dbcd3713d757b81319 not found: ID does not exist" containerID="7046ee2a680d30da94ddbb973c3422c79385f2329c2755dbcd3713d757b81319"
Sep 05 06:56:12.089223 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.089161    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7046ee2a680d30da94ddbb973c3422c79385f2329c2755dbcd3713d757b81319"} err="failed to get container status \"7046ee2a680d30da94ddbb973c3422c79385f2329c2755dbcd3713d757b81319\": rpc error: code = NotFound desc = could not find container \"7046ee2a680d30da94ddbb973c3422c79385f2329c2755dbcd3713d757b81319\": container with ID starting with 7046ee2a680d30da94ddbb973c3422c79385f2329c2755dbcd3713d757b81319 not found: ID does not exist"
Sep 05 06:56:12.089223 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.089176    2567 scope.go:117] "RemoveContainer" containerID="1120dd4fe1bb612d184bb6b239bc5ac3ab9ab673e2cdfef6cf77a10346625809"
Sep 05 06:56:12.089411 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:56:12.089394    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1120dd4fe1bb612d184bb6b239bc5ac3ab9ab673e2cdfef6cf77a10346625809\": container with ID starting with 1120dd4fe1bb612d184bb6b239bc5ac3ab9ab673e2cdfef6cf77a10346625809 not found: ID does not exist" containerID="1120dd4fe1bb612d184bb6b239bc5ac3ab9ab673e2cdfef6cf77a10346625809"
Sep 05 06:56:12.089455 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.089419    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1120dd4fe1bb612d184bb6b239bc5ac3ab9ab673e2cdfef6cf77a10346625809"} err="failed to get container status \"1120dd4fe1bb612d184bb6b239bc5ac3ab9ab673e2cdfef6cf77a10346625809\": rpc error: code = NotFound desc = could not find container \"1120dd4fe1bb612d184bb6b239bc5ac3ab9ab673e2cdfef6cf77a10346625809\": container with ID starting with 1120dd4fe1bb612d184bb6b239bc5ac3ab9ab673e2cdfef6cf77a10346625809 not found: ID does not exist"
Sep 05 06:56:12.093735 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.093715    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"]
Sep 05 06:56:12.097812 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.097785    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg"]
Sep 05 06:56:12.107391 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.107374    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c845abef-fb7a-420a-9e34-ae67744c97e1-istio-data\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:56:12.107461 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.107394    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnz9v\" (UniqueName: \"kubernetes.io/projected/c845abef-fb7a-420a-9e34-ae67744c97e1-kube-api-access-gnz9v\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:56:12.107461 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.107402    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c845abef-fb7a-420a-9e34-ae67744c97e1-istio-envoy\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:56:12.107461 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.107412    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c845abef-fb7a-420a-9e34-ae67744c97e1-istio-podinfo\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:56:12.107461 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.107419    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c845abef-fb7a-420a-9e34-ae67744c97e1-istio-token\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:56:12.581340 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:12.581310    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c845abef-fb7a-420a-9e34-ae67744c97e1" path="/var/lib/kubelet/pods/c845abef-fb7a-420a-9e34-ae67744c97e1/volumes"
Sep 05 06:56:17.611682 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:17.611639    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ef54fd-29809845-dkk6q"]
Sep 05 06:56:17.615967 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:17.615942    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ef54fd-29809845-dkk6q"]
Sep 05 06:56:17.651587 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:17.651555    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth"]
Sep 05 06:56:17.652065 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:17.652017    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth" podUID="aa3b6f9f-631d-4967-9209-adbd0c127225" containerName="payload-pre-processing" containerID="cri-o://b97d20aad0846d3820f0d24cffa3df5bcacdded8da29fccd8b73b265648e9e72" gracePeriod=30
Sep 05 06:56:17.899165 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:17.899140    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth"
Sep 05 06:56:17.972107 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:17.971139    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa3b6f9f-631d-4967-9209-adbd0c127225-plugins-config-volume\") pod \"aa3b6f9f-631d-4967-9209-adbd0c127225\" (UID: \"aa3b6f9f-631d-4967-9209-adbd0c127225\") "
Sep 05 06:56:17.972107 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:17.971202    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmslg\" (UniqueName: \"kubernetes.io/projected/aa3b6f9f-631d-4967-9209-adbd0c127225-kube-api-access-zmslg\") pod \"aa3b6f9f-631d-4967-9209-adbd0c127225\" (UID: \"aa3b6f9f-631d-4967-9209-adbd0c127225\") "
Sep 05 06:56:17.972107 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:17.972017    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa3b6f9f-631d-4967-9209-adbd0c127225-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "aa3b6f9f-631d-4967-9209-adbd0c127225" (UID: "aa3b6f9f-631d-4967-9209-adbd0c127225"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:56:17.972371 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:17.972269    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa3b6f9f-631d-4967-9209-adbd0c127225-plugins-config-volume\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:56:17.973899 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:17.973873    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa3b6f9f-631d-4967-9209-adbd0c127225-kube-api-access-zmslg" (OuterVolumeSpecName: "kube-api-access-zmslg") pod "aa3b6f9f-631d-4967-9209-adbd0c127225" (UID: "aa3b6f9f-631d-4967-9209-adbd0c127225"). InnerVolumeSpecName "kube-api-access-zmslg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:56:18.073138 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:18.073092    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmslg\" (UniqueName: \"kubernetes.io/projected/aa3b6f9f-631d-4967-9209-adbd0c127225-kube-api-access-zmslg\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:56:18.102716 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:18.102684    2567 generic.go:356] "Generic (PLEG): container finished" podID="aa3b6f9f-631d-4967-9209-adbd0c127225" containerID="b97d20aad0846d3820f0d24cffa3df5bcacdded8da29fccd8b73b265648e9e72" exitCode=0
Sep 05 06:56:18.102906 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:18.102721    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth"
Sep 05 06:56:18.102906 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:18.102764    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth" event={"ID":"aa3b6f9f-631d-4967-9209-adbd0c127225","Type":"ContainerDied","Data":"b97d20aad0846d3820f0d24cffa3df5bcacdded8da29fccd8b73b265648e9e72"}
Sep 05 06:56:18.102906 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:18.102815    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth" event={"ID":"aa3b6f9f-631d-4967-9209-adbd0c127225","Type":"ContainerDied","Data":"aa13ef0e23628261a56e86c07b25bddc27440940dbb75324bffc44a26d715c05"}
Sep 05 06:56:18.102906 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:18.102852    2567 scope.go:117] "RemoveContainer" containerID="b97d20aad0846d3820f0d24cffa3df5bcacdded8da29fccd8b73b265648e9e72"
Sep 05 06:56:18.111719 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:18.111703    2567 scope.go:117] "RemoveContainer" containerID="b97d20aad0846d3820f0d24cffa3df5bcacdded8da29fccd8b73b265648e9e72"
Sep 05 06:56:18.111981 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:56:18.111963    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b97d20aad0846d3820f0d24cffa3df5bcacdded8da29fccd8b73b265648e9e72\": container with ID starting with b97d20aad0846d3820f0d24cffa3df5bcacdded8da29fccd8b73b265648e9e72 not found: ID does not exist" containerID="b97d20aad0846d3820f0d24cffa3df5bcacdded8da29fccd8b73b265648e9e72"
Sep 05 06:56:18.112059 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:18.111991    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b97d20aad0846d3820f0d24cffa3df5bcacdded8da29fccd8b73b265648e9e72"} err="failed to get container status \"b97d20aad0846d3820f0d24cffa3df5bcacdded8da29fccd8b73b265648e9e72\": rpc error: code = NotFound desc = could not find container \"b97d20aad0846d3820f0d24cffa3df5bcacdded8da29fccd8b73b265648e9e72\": container with ID starting with b97d20aad0846d3820f0d24cffa3df5bcacdded8da29fccd8b73b265648e9e72 not found: ID does not exist"
Sep 05 06:56:18.125069 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:18.125044    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth"]
Sep 05 06:56:18.130819 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:18.130766    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth"]
Sep 05 06:56:18.581970 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:18.581939    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9edc8826-8a38-4dcd-9553-6d19dac175fa" path="/var/lib/kubelet/pods/9edc8826-8a38-4dcd-9553-6d19dac175fa/volumes"
Sep 05 06:56:18.582307 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:18.582293    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa3b6f9f-631d-4967-9209-adbd0c127225" path="/var/lib/kubelet/pods/aa3b6f9f-631d-4967-9209-adbd0c127225/volumes"
Sep 05 06:56:24.707231 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:24.707198    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"]
Sep 05 06:56:24.707661 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:24.707447    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg" podUID="d59b88ec-7e33-41d4-801b-4d031787634d" containerName="istio-proxy" containerID="cri-o://9a4babed4bb946a91c7ef45a2b6d2f22c58be2745b03833f947ac6c08bb757f0" gracePeriod=30
Sep 05 06:56:29.951911 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:29.951881    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:56:30.074852 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.074782    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d59b88ec-7e33-41d4-801b-4d031787634d-istio-token\") pod \"d59b88ec-7e33-41d4-801b-4d031787634d\" (UID: \"d59b88ec-7e33-41d4-801b-4d031787634d\") "
Sep 05 06:56:30.074852 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.074833    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d59b88ec-7e33-41d4-801b-4d031787634d-workload-socket\") pod \"d59b88ec-7e33-41d4-801b-4d031787634d\" (UID: \"d59b88ec-7e33-41d4-801b-4d031787634d\") "
Sep 05 06:56:30.075054 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.074877    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d59b88ec-7e33-41d4-801b-4d031787634d-istiod-ca-cert\") pod \"d59b88ec-7e33-41d4-801b-4d031787634d\" (UID: \"d59b88ec-7e33-41d4-801b-4d031787634d\") "
Sep 05 06:56:30.075054 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.074904    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gf7sq\" (UniqueName: \"kubernetes.io/projected/d59b88ec-7e33-41d4-801b-4d031787634d-kube-api-access-gf7sq\") pod \"d59b88ec-7e33-41d4-801b-4d031787634d\" (UID: \"d59b88ec-7e33-41d4-801b-4d031787634d\") "
Sep 05 06:56:30.075054 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.074956    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d59b88ec-7e33-41d4-801b-4d031787634d-istio-data\") pod \"d59b88ec-7e33-41d4-801b-4d031787634d\" (UID: \"d59b88ec-7e33-41d4-801b-4d031787634d\") "
Sep 05 06:56:30.075054 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.074995    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d59b88ec-7e33-41d4-801b-4d031787634d-credential-socket\") pod \"d59b88ec-7e33-41d4-801b-4d031787634d\" (UID: \"d59b88ec-7e33-41d4-801b-4d031787634d\") "
Sep 05 06:56:30.075227 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.075054    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d59b88ec-7e33-41d4-801b-4d031787634d-istio-podinfo\") pod \"d59b88ec-7e33-41d4-801b-4d031787634d\" (UID: \"d59b88ec-7e33-41d4-801b-4d031787634d\") "
Sep 05 06:56:30.075227 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.075089    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d59b88ec-7e33-41d4-801b-4d031787634d-workload-certs\") pod \"d59b88ec-7e33-41d4-801b-4d031787634d\" (UID: \"d59b88ec-7e33-41d4-801b-4d031787634d\") "
Sep 05 06:56:30.075227 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.075115    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d59b88ec-7e33-41d4-801b-4d031787634d-istio-envoy\") pod \"d59b88ec-7e33-41d4-801b-4d031787634d\" (UID: \"d59b88ec-7e33-41d4-801b-4d031787634d\") "
Sep 05 06:56:30.075227 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.075187    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d59b88ec-7e33-41d4-801b-4d031787634d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d59b88ec-7e33-41d4-801b-4d031787634d" (UID: "d59b88ec-7e33-41d4-801b-4d031787634d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:56:30.075443 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.075226    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d59b88ec-7e33-41d4-801b-4d031787634d-istio-data" (OuterVolumeSpecName: "istio-data") pod "d59b88ec-7e33-41d4-801b-4d031787634d" (UID: "d59b88ec-7e33-41d4-801b-4d031787634d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:56:30.075443 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.075284    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d59b88ec-7e33-41d4-801b-4d031787634d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d59b88ec-7e33-41d4-801b-4d031787634d" (UID: "d59b88ec-7e33-41d4-801b-4d031787634d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:56:30.075443 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.075379    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d59b88ec-7e33-41d4-801b-4d031787634d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d59b88ec-7e33-41d4-801b-4d031787634d" (UID: "d59b88ec-7e33-41d4-801b-4d031787634d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:56:30.075443 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.075415    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d59b88ec-7e33-41d4-801b-4d031787634d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d59b88ec-7e33-41d4-801b-4d031787634d" (UID: "d59b88ec-7e33-41d4-801b-4d031787634d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:56:30.075708 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.075609    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d59b88ec-7e33-41d4-801b-4d031787634d-workload-socket\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:56:30.075778 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.075763    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d59b88ec-7e33-41d4-801b-4d031787634d-istiod-ca-cert\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:56:30.075831 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.075780    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d59b88ec-7e33-41d4-801b-4d031787634d-istio-data\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:56:30.075831 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.075793    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d59b88ec-7e33-41d4-801b-4d031787634d-credential-socket\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:56:30.075831 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.075807    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d59b88ec-7e33-41d4-801b-4d031787634d-workload-certs\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:56:30.077100 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.077075    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d59b88ec-7e33-41d4-801b-4d031787634d-istio-token" (OuterVolumeSpecName: "istio-token") pod "d59b88ec-7e33-41d4-801b-4d031787634d" (UID: "d59b88ec-7e33-41d4-801b-4d031787634d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:56:30.077222 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.077205    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d59b88ec-7e33-41d4-801b-4d031787634d-kube-api-access-gf7sq" (OuterVolumeSpecName: "kube-api-access-gf7sq") pod "d59b88ec-7e33-41d4-801b-4d031787634d" (UID: "d59b88ec-7e33-41d4-801b-4d031787634d"). InnerVolumeSpecName "kube-api-access-gf7sq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:56:30.077374 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.077359    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d59b88ec-7e33-41d4-801b-4d031787634d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d59b88ec-7e33-41d4-801b-4d031787634d" (UID: "d59b88ec-7e33-41d4-801b-4d031787634d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 05 06:56:30.077493 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.077479    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d59b88ec-7e33-41d4-801b-4d031787634d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d59b88ec-7e33-41d4-801b-4d031787634d" (UID: "d59b88ec-7e33-41d4-801b-4d031787634d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 06:56:30.163587 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.163551    2567 generic.go:356] "Generic (PLEG): container finished" podID="d59b88ec-7e33-41d4-801b-4d031787634d" containerID="9a4babed4bb946a91c7ef45a2b6d2f22c58be2745b03833f947ac6c08bb757f0" exitCode=0
Sep 05 06:56:30.163704 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.163597    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"
Sep 05 06:56:30.163704 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.163609    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg" event={"ID":"d59b88ec-7e33-41d4-801b-4d031787634d","Type":"ContainerDied","Data":"9a4babed4bb946a91c7ef45a2b6d2f22c58be2745b03833f947ac6c08bb757f0"}
Sep 05 06:56:30.163704 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.163665    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg" event={"ID":"d59b88ec-7e33-41d4-801b-4d031787634d","Type":"ContainerDied","Data":"3414cd466067e6c0581a4bc67ca551bdbc2bf127a82e50606b088362dda10fee"}
Sep 05 06:56:30.163704 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.163695    2567 scope.go:117] "RemoveContainer" containerID="9a4babed4bb946a91c7ef45a2b6d2f22c58be2745b03833f947ac6c08bb757f0"
Sep 05 06:56:30.173431 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.173414    2567 scope.go:117] "RemoveContainer" containerID="80c9bbd3ae32e9953ca7ba1dda67ee71e1d06439728a9acd0287cb323efc47b0"
Sep 05 06:56:30.177016 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.176996    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d59b88ec-7e33-41d4-801b-4d031787634d-istio-envoy\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:56:30.177016 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.177017    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d59b88ec-7e33-41d4-801b-4d031787634d-istio-token\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:56:30.177168 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.177049    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gf7sq\" (UniqueName: \"kubernetes.io/projected/d59b88ec-7e33-41d4-801b-4d031787634d-kube-api-access-gf7sq\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:56:30.177168 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.177063    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d59b88ec-7e33-41d4-801b-4d031787634d-istio-podinfo\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:56:30.181130 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.181108    2567 scope.go:117] "RemoveContainer" containerID="9a4babed4bb946a91c7ef45a2b6d2f22c58be2745b03833f947ac6c08bb757f0"
Sep 05 06:56:30.181427 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:56:30.181409    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a4babed4bb946a91c7ef45a2b6d2f22c58be2745b03833f947ac6c08bb757f0\": container with ID starting with 9a4babed4bb946a91c7ef45a2b6d2f22c58be2745b03833f947ac6c08bb757f0 not found: ID does not exist" containerID="9a4babed4bb946a91c7ef45a2b6d2f22c58be2745b03833f947ac6c08bb757f0"
Sep 05 06:56:30.181511 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.181440    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a4babed4bb946a91c7ef45a2b6d2f22c58be2745b03833f947ac6c08bb757f0"} err="failed to get container status \"9a4babed4bb946a91c7ef45a2b6d2f22c58be2745b03833f947ac6c08bb757f0\": rpc error: code = NotFound desc = could not find container \"9a4babed4bb946a91c7ef45a2b6d2f22c58be2745b03833f947ac6c08bb757f0\": container with ID starting with 9a4babed4bb946a91c7ef45a2b6d2f22c58be2745b03833f947ac6c08bb757f0 not found: ID does not exist"
Sep 05 06:56:30.181511 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.181462    2567 scope.go:117] "RemoveContainer" containerID="80c9bbd3ae32e9953ca7ba1dda67ee71e1d06439728a9acd0287cb323efc47b0"
Sep 05 06:56:30.181799 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:56:30.181772    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80c9bbd3ae32e9953ca7ba1dda67ee71e1d06439728a9acd0287cb323efc47b0\": container with ID starting with 80c9bbd3ae32e9953ca7ba1dda67ee71e1d06439728a9acd0287cb323efc47b0 not found: ID does not exist" containerID="80c9bbd3ae32e9953ca7ba1dda67ee71e1d06439728a9acd0287cb323efc47b0"
Sep 05 06:56:30.181866 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.181807    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80c9bbd3ae32e9953ca7ba1dda67ee71e1d06439728a9acd0287cb323efc47b0"} err="failed to get container status \"80c9bbd3ae32e9953ca7ba1dda67ee71e1d06439728a9acd0287cb323efc47b0\": rpc error: code = NotFound desc = could not find container \"80c9bbd3ae32e9953ca7ba1dda67ee71e1d06439728a9acd0287cb323efc47b0\": container with ID starting with 80c9bbd3ae32e9953ca7ba1dda67ee71e1d06439728a9acd0287cb323efc47b0 not found: ID does not exist"
Sep 05 06:56:30.184998 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.184977    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"]
Sep 05 06:56:30.189216 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.189196    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg"]
Sep 05 06:56:30.580477 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:30.580435    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d59b88ec-7e33-41d4-801b-4d031787634d" path="/var/lib/kubelet/pods/d59b88ec-7e33-41d4-801b-4d031787634d/volumes"
Sep 05 06:56:35.071330 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:35.071305    2567 scope.go:117] "RemoveContainer" containerID="0bcd1cb3578c77c2019e77497822c918a5ded34c62f0459971d07330c8f0cf72"
Sep 05 06:56:35.556955 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:35.556923    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp"]
Sep 05 06:56:35.557283 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:35.557230    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp" podUID="a7f04b4a-e437-4db1-8784-2ea00175252b" containerName="payload-processing" containerID="cri-o://1eabeb0b00a915000ee986198e80091ca4ccd97c9f3a1f49a0017f4eedc68c35" gracePeriod=30
Sep 05 06:56:35.565426 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:35.564863    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb"]
Sep 05 06:56:35.565426 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:35.565113    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb" podUID="b39b60f3-0390-461b-97c2-d2370151b96d" containerName="payload-pre-processing" containerID="cri-o://79960363023c4775abac463d3a96cf233682b04ae5aaa96b9c82dac8308304e8" gracePeriod=30
Sep 05 06:56:35.834898 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:35.834873    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp"
Sep 05 06:56:35.837668 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:35.837646    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb"
Sep 05 06:56:35.925628 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:35.925595    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wbtt\" (UniqueName: \"kubernetes.io/projected/a7f04b4a-e437-4db1-8784-2ea00175252b-kube-api-access-6wbtt\") pod \"a7f04b4a-e437-4db1-8784-2ea00175252b\" (UID: \"a7f04b4a-e437-4db1-8784-2ea00175252b\") "
Sep 05 06:56:35.925789 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:35.925647    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rbgl\" (UniqueName: \"kubernetes.io/projected/b39b60f3-0390-461b-97c2-d2370151b96d-kube-api-access-6rbgl\") pod \"b39b60f3-0390-461b-97c2-d2370151b96d\" (UID: \"b39b60f3-0390-461b-97c2-d2370151b96d\") "
Sep 05 06:56:35.925789 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:35.925698    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b39b60f3-0390-461b-97c2-d2370151b96d-plugins-config-volume\") pod \"b39b60f3-0390-461b-97c2-d2370151b96d\" (UID: \"b39b60f3-0390-461b-97c2-d2370151b96d\") "
Sep 05 06:56:35.925789 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:35.925770    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7f04b4a-e437-4db1-8784-2ea00175252b-plugins-config-volume\") pod \"a7f04b4a-e437-4db1-8784-2ea00175252b\" (UID: \"a7f04b4a-e437-4db1-8784-2ea00175252b\") "
Sep 05 06:56:35.926152 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:35.926127    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b39b60f3-0390-461b-97c2-d2370151b96d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b39b60f3-0390-461b-97c2-d2370151b96d" (UID: "b39b60f3-0390-461b-97c2-d2370151b96d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:56:35.926255 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:35.926186    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7f04b4a-e437-4db1-8784-2ea00175252b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a7f04b4a-e437-4db1-8784-2ea00175252b" (UID: "a7f04b4a-e437-4db1-8784-2ea00175252b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 06:56:35.927773 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:35.927751    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7f04b4a-e437-4db1-8784-2ea00175252b-kube-api-access-6wbtt" (OuterVolumeSpecName: "kube-api-access-6wbtt") pod "a7f04b4a-e437-4db1-8784-2ea00175252b" (UID: "a7f04b4a-e437-4db1-8784-2ea00175252b"). InnerVolumeSpecName "kube-api-access-6wbtt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:56:35.927881 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:35.927843    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b39b60f3-0390-461b-97c2-d2370151b96d-kube-api-access-6rbgl" (OuterVolumeSpecName: "kube-api-access-6rbgl") pod "b39b60f3-0390-461b-97c2-d2370151b96d" (UID: "b39b60f3-0390-461b-97c2-d2370151b96d"). InnerVolumeSpecName "kube-api-access-6rbgl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 06:56:36.026656 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:36.026624    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b39b60f3-0390-461b-97c2-d2370151b96d-plugins-config-volume\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:56:36.026656 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:36.026649    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7f04b4a-e437-4db1-8784-2ea00175252b-plugins-config-volume\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:56:36.026656 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:36.026658    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wbtt\" (UniqueName: \"kubernetes.io/projected/a7f04b4a-e437-4db1-8784-2ea00175252b-kube-api-access-6wbtt\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:56:36.026920 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:36.026666    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rbgl\" (UniqueName: \"kubernetes.io/projected/b39b60f3-0390-461b-97c2-d2370151b96d-kube-api-access-6rbgl\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 06:56:36.200190 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:36.200146    2567 generic.go:356] "Generic (PLEG): container finished" podID="a7f04b4a-e437-4db1-8784-2ea00175252b" containerID="1eabeb0b00a915000ee986198e80091ca4ccd97c9f3a1f49a0017f4eedc68c35" exitCode=0
Sep 05 06:56:36.200665 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:36.200241    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp"
Sep 05 06:56:36.200665 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:36.200241    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp" event={"ID":"a7f04b4a-e437-4db1-8784-2ea00175252b","Type":"ContainerDied","Data":"1eabeb0b00a915000ee986198e80091ca4ccd97c9f3a1f49a0017f4eedc68c35"}
Sep 05 06:56:36.200665 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:36.200384    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp" event={"ID":"a7f04b4a-e437-4db1-8784-2ea00175252b","Type":"ContainerDied","Data":"830c6fe80e9bf52fa55f462050fef27ebe7f5feca631b1de75bfb060a1845d11"}
Sep 05 06:56:36.200665 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:36.200430    2567 scope.go:117] "RemoveContainer" containerID="1eabeb0b00a915000ee986198e80091ca4ccd97c9f3a1f49a0017f4eedc68c35"
Sep 05 06:56:36.201859 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:36.201825    2567 generic.go:356] "Generic (PLEG): container finished" podID="b39b60f3-0390-461b-97c2-d2370151b96d" containerID="79960363023c4775abac463d3a96cf233682b04ae5aaa96b9c82dac8308304e8" exitCode=0
Sep 05 06:56:36.201939 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:36.201888    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb" event={"ID":"b39b60f3-0390-461b-97c2-d2370151b96d","Type":"ContainerDied","Data":"79960363023c4775abac463d3a96cf233682b04ae5aaa96b9c82dac8308304e8"}
Sep 05 06:56:36.202002 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:36.201942    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb" event={"ID":"b39b60f3-0390-461b-97c2-d2370151b96d","Type":"ContainerDied","Data":"7fa91efa84195b2350844687b039c0f071d7822d4359d9e72f530d5318fe03b2"}
Sep 05 06:56:36.202002 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:36.201898    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb"
Sep 05 06:56:36.209102 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:36.209079    2567 scope.go:117] "RemoveContainer" containerID="1eabeb0b00a915000ee986198e80091ca4ccd97c9f3a1f49a0017f4eedc68c35"
Sep 05 06:56:36.209393 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:56:36.209373    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1eabeb0b00a915000ee986198e80091ca4ccd97c9f3a1f49a0017f4eedc68c35\": container with ID starting with 1eabeb0b00a915000ee986198e80091ca4ccd97c9f3a1f49a0017f4eedc68c35 not found: ID does not exist" containerID="1eabeb0b00a915000ee986198e80091ca4ccd97c9f3a1f49a0017f4eedc68c35"
Sep 05 06:56:36.209497 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:36.209402    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1eabeb0b00a915000ee986198e80091ca4ccd97c9f3a1f49a0017f4eedc68c35"} err="failed to get container status \"1eabeb0b00a915000ee986198e80091ca4ccd97c9f3a1f49a0017f4eedc68c35\": rpc error: code = NotFound desc = could not find container \"1eabeb0b00a915000ee986198e80091ca4ccd97c9f3a1f49a0017f4eedc68c35\": container with ID starting with 1eabeb0b00a915000ee986198e80091ca4ccd97c9f3a1f49a0017f4eedc68c35 not found: ID does not exist"
Sep 05 06:56:36.209497 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:36.209424    2567 scope.go:117] "RemoveContainer" containerID="79960363023c4775abac463d3a96cf233682b04ae5aaa96b9c82dac8308304e8"
Sep 05 06:56:36.217529 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:36.217512    2567 scope.go:117] "RemoveContainer" containerID="79960363023c4775abac463d3a96cf233682b04ae5aaa96b9c82dac8308304e8"
Sep 05 06:56:36.217813 ip-10-0-141-49 kubenswrapper[2567]: E0905 06:56:36.217787    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79960363023c4775abac463d3a96cf233682b04ae5aaa96b9c82dac8308304e8\": container with ID starting with 79960363023c4775abac463d3a96cf233682b04ae5aaa96b9c82dac8308304e8 not found: ID does not exist" containerID="79960363023c4775abac463d3a96cf233682b04ae5aaa96b9c82dac8308304e8"
Sep 05 06:56:36.217864 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:36.217820    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79960363023c4775abac463d3a96cf233682b04ae5aaa96b9c82dac8308304e8"} err="failed to get container status \"79960363023c4775abac463d3a96cf233682b04ae5aaa96b9c82dac8308304e8\": rpc error: code = NotFound desc = could not find container \"79960363023c4775abac463d3a96cf233682b04ae5aaa96b9c82dac8308304e8\": container with ID starting with 79960363023c4775abac463d3a96cf233682b04ae5aaa96b9c82dac8308304e8 not found: ID does not exist"
Sep 05 06:56:36.226198 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:36.226174    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb"]
Sep 05 06:56:36.229405 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:36.229386    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb"]
Sep 05 06:56:36.239615 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:36.239588    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp"]
Sep 05 06:56:36.243020 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:36.243001    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp"]
Sep 05 06:56:36.580646 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:36.580569    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7f04b4a-e437-4db1-8784-2ea00175252b" path="/var/lib/kubelet/pods/a7f04b4a-e437-4db1-8784-2ea00175252b/volumes"
Sep 05 06:56:36.580931 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:56:36.580918    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b39b60f3-0390-461b-97c2-d2370151b96d" path="/var/lib/kubelet/pods/b39b60f3-0390-461b-97c2-d2370151b96d/volumes"
Sep 05 06:57:35.101554 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:57:35.101527    2567 scope.go:117] "RemoveContainer" containerID="f7b2e05e2c6b51fea8170147b6b5135837ec4c739313b259e590628d0136a626"
Sep 05 06:58:35.125530 ip-10-0-141-49 kubenswrapper[2567]: I0905 06:58:35.125500    2567 scope.go:117] "RemoveContainer" containerID="b666fcdabbffaab131aa45be1272feb9bd40ed7df899bdcf7011b7e46abeb3e1"
Sep 05 07:00:34.825870 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:00:34.825843    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bb4_7f8a8f16-2422-4c01-a619-1f17fe10cd4c/ovn-acl-logging/0.log"
Sep 05 07:00:34.829876 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:00:34.829853    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bb4_7f8a8f16-2422-4c01-a619-1f17fe10cd4c/ovn-acl-logging/0.log"
Sep 05 07:00:35.154288 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:00:35.154214    2567 scope.go:117] "RemoveContainer" containerID="2283155e213d678b595b2dd55596b4ae85621f94058d1451f0e21667ec961783"
Sep 05 07:01:05.959453 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:05.959409    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb"]
Sep 05 07:01:05.960134 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:05.959736    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be0cda55-6872-463a-8a51-d0e5514a977c" containerName="istio-proxy"
Sep 05 07:01:05.960134 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:05.959748    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="be0cda55-6872-463a-8a51-d0e5514a977c" containerName="istio-proxy"
Sep 05 07:01:05.960134 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:05.959761    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d59b88ec-7e33-41d4-801b-4d031787634d" containerName="istio-proxy"
Sep 05 07:01:05.960134 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:05.959766    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d59b88ec-7e33-41d4-801b-4d031787634d" containerName="istio-proxy"
Sep 05 07:01:05.960134 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:05.959772    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7f04b4a-e437-4db1-8784-2ea00175252b" containerName="payload-processing"
Sep 05 07:01:05.960134 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:05.959778    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7f04b4a-e437-4db1-8784-2ea00175252b" containerName="payload-processing"
Sep 05 07:01:05.960134 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:05.959784    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bec0518d-16a4-4201-922c-4a785631ce57" containerName="main"
Sep 05 07:01:05.960134 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:05.959789    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="bec0518d-16a4-4201-922c-4a785631ce57" containerName="main"
Sep 05 07:01:05.960134 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:05.959798    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c845abef-fb7a-420a-9e34-ae67744c97e1" containerName="istio-proxy"
Sep 05 07:01:05.960134 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:05.959803    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c845abef-fb7a-420a-9e34-ae67744c97e1" containerName="istio-proxy"
Sep 05 07:01:05.960134 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:05.959818    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa3b6f9f-631d-4967-9209-adbd0c127225" containerName="payload-pre-processing"
Sep 05 07:01:05.960134 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:05.959823    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa3b6f9f-631d-4967-9209-adbd0c127225" containerName="payload-pre-processing"
Sep 05 07:01:05.960134 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:05.959828    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a38e906-6d54-4e44-841f-35e8dfb9e96a" containerName="payload-pre-processing"
Sep 05 07:01:05.960134 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:05.959833    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a38e906-6d54-4e44-841f-35e8dfb9e96a" containerName="payload-pre-processing"
Sep 05 07:01:05.960134 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:05.959843    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c845abef-fb7a-420a-9e34-ae67744c97e1" containerName="istio-proxy"
Sep 05 07:01:05.960134 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:05.959848    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c845abef-fb7a-420a-9e34-ae67744c97e1" containerName="istio-proxy"
Sep 05 07:01:05.960134 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:05.959853    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b39b60f3-0390-461b-97c2-d2370151b96d" containerName="payload-pre-processing"
Sep 05 07:01:05.960134 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:05.959858    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b39b60f3-0390-461b-97c2-d2370151b96d" containerName="payload-pre-processing"
Sep 05 07:01:05.960134 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:05.959863    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f59e3389-3bf0-4e5b-93f5-95fadfb5b5f4" containerName="revoke-keys"
Sep 05 07:01:05.960134 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:05.959868    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f59e3389-3bf0-4e5b-93f5-95fadfb5b5f4" containerName="revoke-keys"
Sep 05 07:01:05.960134 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:05.959916    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d59b88ec-7e33-41d4-801b-4d031787634d" containerName="istio-proxy"
Sep 05 07:01:05.960134 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:05.959924    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="bec0518d-16a4-4201-922c-4a785631ce57" containerName="main"
Sep 05 07:01:05.960134 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:05.959930    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d59b88ec-7e33-41d4-801b-4d031787634d" containerName="istio-proxy"
Sep 05 07:01:05.960134 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:05.959938    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c845abef-fb7a-420a-9e34-ae67744c97e1" containerName="istio-proxy"
Sep 05 07:01:05.960134 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:05.959944    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a38e906-6d54-4e44-841f-35e8dfb9e96a" containerName="payload-pre-processing"
Sep 05 07:01:05.960134 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:05.959950    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f59e3389-3bf0-4e5b-93f5-95fadfb5b5f4" containerName="revoke-keys"
Sep 05 07:01:05.960134 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:05.959955    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c845abef-fb7a-420a-9e34-ae67744c97e1" containerName="istio-proxy"
Sep 05 07:01:05.960134 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:05.959962    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7f04b4a-e437-4db1-8784-2ea00175252b" containerName="payload-processing"
Sep 05 07:01:05.960134 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:05.959966    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="be0cda55-6872-463a-8a51-d0e5514a977c" containerName="istio-proxy"
Sep 05 07:01:05.960134 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:05.959973    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b39b60f3-0390-461b-97c2-d2370151b96d" containerName="payload-pre-processing"
Sep 05 07:01:05.960134 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:05.959979    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="be0cda55-6872-463a-8a51-d0e5514a977c" containerName="istio-proxy"
Sep 05 07:01:05.960134 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:05.959984    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa3b6f9f-631d-4967-9209-adbd0c127225" containerName="payload-pre-processing"
Sep 05 07:01:05.963070 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:05.963052    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb"
Sep 05 07:01:05.965477 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:05.965459    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-02a1edac-kserve-self-signed-certs\""
Sep 05 07:01:05.970592 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:05.970565    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb"]
Sep 05 07:01:06.044673 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:06.044633    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b2cf39b-2c64-4757-b76a-319421cfc1f7-dshm\") pod \"e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb\" (UID: \"4b2cf39b-2c64-4757-b76a-319421cfc1f7\") " pod="llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb"
Sep 05 07:01:06.044857 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:06.044687    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b2cf39b-2c64-4757-b76a-319421cfc1f7-tls-certs\") pod \"e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb\" (UID: \"4b2cf39b-2c64-4757-b76a-319421cfc1f7\") " pod="llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb"
Sep 05 07:01:06.044857 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:06.044777    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b2cf39b-2c64-4757-b76a-319421cfc1f7-home\") pod \"e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb\" (UID: \"4b2cf39b-2c64-4757-b76a-319421cfc1f7\") " pod="llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb"
Sep 05 07:01:06.044857 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:06.044832    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b2cf39b-2c64-4757-b76a-319421cfc1f7-model-cache\") pod \"e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb\" (UID: \"4b2cf39b-2c64-4757-b76a-319421cfc1f7\") " pod="llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb"
Sep 05 07:01:06.044982 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:06.044872    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxw6g\" (UniqueName: \"kubernetes.io/projected/4b2cf39b-2c64-4757-b76a-319421cfc1f7-kube-api-access-vxw6g\") pod \"e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb\" (UID: \"4b2cf39b-2c64-4757-b76a-319421cfc1f7\") " pod="llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb"
Sep 05 07:01:06.044982 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:06.044911    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b2cf39b-2c64-4757-b76a-319421cfc1f7-tmp-dir\") pod \"e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb\" (UID: \"4b2cf39b-2c64-4757-b76a-319421cfc1f7\") " pod="llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb"
Sep 05 07:01:06.145940 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:06.145900    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxw6g\" (UniqueName: \"kubernetes.io/projected/4b2cf39b-2c64-4757-b76a-319421cfc1f7-kube-api-access-vxw6g\") pod \"e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb\" (UID: \"4b2cf39b-2c64-4757-b76a-319421cfc1f7\") " pod="llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb"
Sep 05 07:01:06.146159 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:06.145959    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b2cf39b-2c64-4757-b76a-319421cfc1f7-tmp-dir\") pod \"e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb\" (UID: \"4b2cf39b-2c64-4757-b76a-319421cfc1f7\") " pod="llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb"
Sep 05 07:01:06.146159 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:06.145980    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b2cf39b-2c64-4757-b76a-319421cfc1f7-dshm\") pod \"e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb\" (UID: \"4b2cf39b-2c64-4757-b76a-319421cfc1f7\") " pod="llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb"
Sep 05 07:01:06.146159 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:06.146012    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b2cf39b-2c64-4757-b76a-319421cfc1f7-tls-certs\") pod \"e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb\" (UID: \"4b2cf39b-2c64-4757-b76a-319421cfc1f7\") " pod="llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb"
Sep 05 07:01:06.146159 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:06.146072    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b2cf39b-2c64-4757-b76a-319421cfc1f7-home\") pod \"e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb\" (UID: \"4b2cf39b-2c64-4757-b76a-319421cfc1f7\") " pod="llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb"
Sep 05 07:01:06.146159 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:06.146112    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b2cf39b-2c64-4757-b76a-319421cfc1f7-model-cache\") pod \"e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb\" (UID: \"4b2cf39b-2c64-4757-b76a-319421cfc1f7\") " pod="llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb"
Sep 05 07:01:06.146445 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:06.146329    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b2cf39b-2c64-4757-b76a-319421cfc1f7-tmp-dir\") pod \"e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb\" (UID: \"4b2cf39b-2c64-4757-b76a-319421cfc1f7\") " pod="llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb"
Sep 05 07:01:06.146507 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:06.146447    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b2cf39b-2c64-4757-b76a-319421cfc1f7-model-cache\") pod \"e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb\" (UID: \"4b2cf39b-2c64-4757-b76a-319421cfc1f7\") " pod="llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb"
Sep 05 07:01:06.146507 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:06.146473    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b2cf39b-2c64-4757-b76a-319421cfc1f7-home\") pod \"e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb\" (UID: \"4b2cf39b-2c64-4757-b76a-319421cfc1f7\") " pod="llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb"
Sep 05 07:01:06.148367 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:06.148344    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b2cf39b-2c64-4757-b76a-319421cfc1f7-dshm\") pod \"e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb\" (UID: \"4b2cf39b-2c64-4757-b76a-319421cfc1f7\") " pod="llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb"
Sep 05 07:01:06.148722 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:06.148703    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b2cf39b-2c64-4757-b76a-319421cfc1f7-tls-certs\") pod \"e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb\" (UID: \"4b2cf39b-2c64-4757-b76a-319421cfc1f7\") " pod="llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb"
Sep 05 07:01:06.153891 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:06.153869    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxw6g\" (UniqueName: \"kubernetes.io/projected/4b2cf39b-2c64-4757-b76a-319421cfc1f7-kube-api-access-vxw6g\") pod \"e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb\" (UID: \"4b2cf39b-2c64-4757-b76a-319421cfc1f7\") " pod="llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb"
Sep 05 07:01:06.272377 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:06.272284    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb"
Sep 05 07:01:06.541447 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:06.541418    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb"]
Sep 05 07:01:06.546330 ip-10-0-141-49 kubenswrapper[2567]: W0905 07:01:06.546290    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b2cf39b_2c64_4757_b76a_319421cfc1f7.slice/crio-0157d11ca7d2eae2ec36a864f570f71fc4b9cae5b0bfacf203eec4349a72ba9a WatchSource:0}: Error finding container 0157d11ca7d2eae2ec36a864f570f71fc4b9cae5b0bfacf203eec4349a72ba9a: Status 404 returned error can't find the container with id 0157d11ca7d2eae2ec36a864f570f71fc4b9cae5b0bfacf203eec4349a72ba9a
Sep 05 07:01:07.484862 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:07.484823    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb" event={"ID":"4b2cf39b-2c64-4757-b76a-319421cfc1f7","Type":"ContainerStarted","Data":"86e105a15a857203e66621a4cd81b741f4f2acb55f9b9d0a71238335b2d9143f"}
Sep 05 07:01:07.485272 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:07.484869    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb" event={"ID":"4b2cf39b-2c64-4757-b76a-319421cfc1f7","Type":"ContainerStarted","Data":"0157d11ca7d2eae2ec36a864f570f71fc4b9cae5b0bfacf203eec4349a72ba9a"}
Sep 05 07:01:07.502161 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:07.502109    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb" podStartSLOduration=2.502093567 podStartE2EDuration="2.502093567s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 07:01:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 07:01:07.50096965 +0000 UTC m=+2133.474724325" watchObservedRunningTime="2026-09-05 07:01:07.502093567 +0000 UTC m=+2133.475848271"
Sep 05 07:01:16.272723 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:16.272681    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb"
Sep 05 07:01:16.273203 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:16.272739    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb"
Sep 05 07:01:16.285250 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:16.285226    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb"
Sep 05 07:01:16.539277 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:16.539198    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb"
Sep 05 07:01:24.349913 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:24.349872    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2"]
Sep 05 07:01:24.350323 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:24.350252    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be0cda55-6872-463a-8a51-d0e5514a977c" containerName="istio-proxy"
Sep 05 07:01:24.350323 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:24.350264    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="be0cda55-6872-463a-8a51-d0e5514a977c" containerName="istio-proxy"
Sep 05 07:01:24.350323 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:24.350279    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d59b88ec-7e33-41d4-801b-4d031787634d" containerName="istio-proxy"
Sep 05 07:01:24.350323 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:24.350290    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d59b88ec-7e33-41d4-801b-4d031787634d" containerName="istio-proxy"
Sep 05 07:01:24.353503 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:24.353485    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2"
Sep 05 07:01:24.356115 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:24.356095    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-02a1edac-kserve-self-signed-certs\""
Sep 05 07:01:24.361256 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:24.361110    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2"]
Sep 05 07:01:24.414099 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:24.414060    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ec4d29f-8eab-4a40-86b4-b95cbf755ec6-tls-certs\") pod \"e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2\" (UID: \"3ec4d29f-8eab-4a40-86b4-b95cbf755ec6\") " pod="llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2"
Sep 05 07:01:24.414270 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:24.414127    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ec4d29f-8eab-4a40-86b4-b95cbf755ec6-tmp-dir\") pod \"e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2\" (UID: \"3ec4d29f-8eab-4a40-86b4-b95cbf755ec6\") " pod="llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2"
Sep 05 07:01:24.414270 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:24.414204    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ec4d29f-8eab-4a40-86b4-b95cbf755ec6-model-cache\") pod \"e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2\" (UID: \"3ec4d29f-8eab-4a40-86b4-b95cbf755ec6\") " pod="llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2"
Sep 05 07:01:24.414270 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:24.414257    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ec4d29f-8eab-4a40-86b4-b95cbf755ec6-home\") pod \"e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2\" (UID: \"3ec4d29f-8eab-4a40-86b4-b95cbf755ec6\") " pod="llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2"
Sep 05 07:01:24.414425 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:24.414348    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ec4d29f-8eab-4a40-86b4-b95cbf755ec6-dshm\") pod \"e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2\" (UID: \"3ec4d29f-8eab-4a40-86b4-b95cbf755ec6\") " pod="llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2"
Sep 05 07:01:24.414491 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:24.414469    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjfkz\" (UniqueName: \"kubernetes.io/projected/3ec4d29f-8eab-4a40-86b4-b95cbf755ec6-kube-api-access-bjfkz\") pod \"e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2\" (UID: \"3ec4d29f-8eab-4a40-86b4-b95cbf755ec6\") " pod="llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2"
Sep 05 07:01:24.515431 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:24.515390    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjfkz\" (UniqueName: \"kubernetes.io/projected/3ec4d29f-8eab-4a40-86b4-b95cbf755ec6-kube-api-access-bjfkz\") pod \"e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2\" (UID: \"3ec4d29f-8eab-4a40-86b4-b95cbf755ec6\") " pod="llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2"
Sep 05 07:01:24.515431 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:24.515434    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ec4d29f-8eab-4a40-86b4-b95cbf755ec6-tls-certs\") pod \"e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2\" (UID: \"3ec4d29f-8eab-4a40-86b4-b95cbf755ec6\") " pod="llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2"
Sep 05 07:01:24.515684 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:24.515470    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ec4d29f-8eab-4a40-86b4-b95cbf755ec6-tmp-dir\") pod \"e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2\" (UID: \"3ec4d29f-8eab-4a40-86b4-b95cbf755ec6\") " pod="llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2"
Sep 05 07:01:24.515684 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:24.515505    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ec4d29f-8eab-4a40-86b4-b95cbf755ec6-model-cache\") pod \"e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2\" (UID: \"3ec4d29f-8eab-4a40-86b4-b95cbf755ec6\") " pod="llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2"
Sep 05 07:01:24.515684 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:24.515533    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ec4d29f-8eab-4a40-86b4-b95cbf755ec6-home\") pod \"e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2\" (UID: \"3ec4d29f-8eab-4a40-86b4-b95cbf755ec6\") " pod="llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2"
Sep 05 07:01:24.515684 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:24.515601    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ec4d29f-8eab-4a40-86b4-b95cbf755ec6-dshm\") pod \"e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2\" (UID: \"3ec4d29f-8eab-4a40-86b4-b95cbf755ec6\") " pod="llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2"
Sep 05 07:01:24.515968 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:24.515939    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ec4d29f-8eab-4a40-86b4-b95cbf755ec6-tmp-dir\") pod \"e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2\" (UID: \"3ec4d29f-8eab-4a40-86b4-b95cbf755ec6\") " pod="llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2"
Sep 05 07:01:24.516065 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:24.515970    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ec4d29f-8eab-4a40-86b4-b95cbf755ec6-home\") pod \"e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2\" (UID: \"3ec4d29f-8eab-4a40-86b4-b95cbf755ec6\") " pod="llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2"
Sep 05 07:01:24.516065 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:24.515989    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ec4d29f-8eab-4a40-86b4-b95cbf755ec6-model-cache\") pod \"e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2\" (UID: \"3ec4d29f-8eab-4a40-86b4-b95cbf755ec6\") " pod="llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2"
Sep 05 07:01:24.517865 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:24.517846    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ec4d29f-8eab-4a40-86b4-b95cbf755ec6-dshm\") pod \"e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2\" (UID: \"3ec4d29f-8eab-4a40-86b4-b95cbf755ec6\") " pod="llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2"
Sep 05 07:01:24.518162 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:24.518143    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ec4d29f-8eab-4a40-86b4-b95cbf755ec6-tls-certs\") pod \"e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2\" (UID: \"3ec4d29f-8eab-4a40-86b4-b95cbf755ec6\") " pod="llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2"
Sep 05 07:01:24.523209 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:24.523183    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjfkz\" (UniqueName: \"kubernetes.io/projected/3ec4d29f-8eab-4a40-86b4-b95cbf755ec6-kube-api-access-bjfkz\") pod \"e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2\" (UID: \"3ec4d29f-8eab-4a40-86b4-b95cbf755ec6\") " pod="llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2"
Sep 05 07:01:24.663095 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:24.662975    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2"
Sep 05 07:01:24.945187 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:24.945163    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2"]
Sep 05 07:01:24.947450 ip-10-0-141-49 kubenswrapper[2567]: W0905 07:01:24.947421    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ec4d29f_8eab_4a40_86b4_b95cbf755ec6.slice/crio-1d181d23096f98d21ffd367ed32c17e22f1bd4bcd8697a1ad87ef9a403a14fa5 WatchSource:0}: Error finding container 1d181d23096f98d21ffd367ed32c17e22f1bd4bcd8697a1ad87ef9a403a14fa5: Status 404 returned error can't find the container with id 1d181d23096f98d21ffd367ed32c17e22f1bd4bcd8697a1ad87ef9a403a14fa5
Sep 05 07:01:25.572304 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:25.572273    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2" event={"ID":"3ec4d29f-8eab-4a40-86b4-b95cbf755ec6","Type":"ContainerStarted","Data":"f1b9ba9925edebd6f08157930bf907b928a829e7490141363b4ac86f3ebe69d8"}
Sep 05 07:01:25.572714 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:25.572315    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2" event={"ID":"3ec4d29f-8eab-4a40-86b4-b95cbf755ec6","Type":"ContainerStarted","Data":"1d181d23096f98d21ffd367ed32c17e22f1bd4bcd8697a1ad87ef9a403a14fa5"}
Sep 05 07:01:25.589822 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:25.589761    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2" podStartSLOduration=1.5897465880000001 podStartE2EDuration="1.589746588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 07:01:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 07:01:25.589055632 +0000 UTC m=+2151.562810306" watchObservedRunningTime="2026-09-05 07:01:25.589746588 +0000 UTC m=+2151.563501262"
Sep 05 07:01:34.664169 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:34.664134    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2"
Sep 05 07:01:34.664607 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:34.664431    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2"
Sep 05 07:01:34.677182 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:34.677158    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2"
Sep 05 07:01:35.176393 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:35.176361    2567 scope.go:117] "RemoveContainer" containerID="11fc67f552979e5c288d774f4e9c6813f7d554af1dca5b54fd43938e8281267b"
Sep 05 07:01:35.628887 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:01:35.628850    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2"
Sep 05 07:02:09.125830 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:09.125795    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb"]
Sep 05 07:02:10.874694 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:10.874653    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2"]
Sep 05 07:02:24.145594 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:24.145559    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb" podUID="4b2cf39b-2c64-4757-b76a-319421cfc1f7" containerName="main" containerID="cri-o://86e105a15a857203e66621a4cd81b741f4f2acb55f9b9d0a71238335b2d9143f" gracePeriod=45
Sep 05 07:02:24.392957 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:24.392933    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb"
Sep 05 07:02:24.531814 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:24.531788    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b2cf39b-2c64-4757-b76a-319421cfc1f7-home\") pod \"4b2cf39b-2c64-4757-b76a-319421cfc1f7\" (UID: \"4b2cf39b-2c64-4757-b76a-319421cfc1f7\") "
Sep 05 07:02:24.531950 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:24.531834    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxw6g\" (UniqueName: \"kubernetes.io/projected/4b2cf39b-2c64-4757-b76a-319421cfc1f7-kube-api-access-vxw6g\") pod \"4b2cf39b-2c64-4757-b76a-319421cfc1f7\" (UID: \"4b2cf39b-2c64-4757-b76a-319421cfc1f7\") "
Sep 05 07:02:24.531950 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:24.531884    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b2cf39b-2c64-4757-b76a-319421cfc1f7-model-cache\") pod \"4b2cf39b-2c64-4757-b76a-319421cfc1f7\" (UID: \"4b2cf39b-2c64-4757-b76a-319421cfc1f7\") "
Sep 05 07:02:24.531950 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:24.531939    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b2cf39b-2c64-4757-b76a-319421cfc1f7-tls-certs\") pod \"4b2cf39b-2c64-4757-b76a-319421cfc1f7\" (UID: \"4b2cf39b-2c64-4757-b76a-319421cfc1f7\") "
Sep 05 07:02:24.532160 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:24.532050    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b2cf39b-2c64-4757-b76a-319421cfc1f7-home" (OuterVolumeSpecName: "home") pod "4b2cf39b-2c64-4757-b76a-319421cfc1f7" (UID: "4b2cf39b-2c64-4757-b76a-319421cfc1f7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 07:02:24.532160 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:24.532084    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b2cf39b-2c64-4757-b76a-319421cfc1f7-tmp-dir\") pod \"4b2cf39b-2c64-4757-b76a-319421cfc1f7\" (UID: \"4b2cf39b-2c64-4757-b76a-319421cfc1f7\") "
Sep 05 07:02:24.532160 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:24.532133    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b2cf39b-2c64-4757-b76a-319421cfc1f7-dshm\") pod \"4b2cf39b-2c64-4757-b76a-319421cfc1f7\" (UID: \"4b2cf39b-2c64-4757-b76a-319421cfc1f7\") "
Sep 05 07:02:24.532325 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:24.532213    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b2cf39b-2c64-4757-b76a-319421cfc1f7-model-cache" (OuterVolumeSpecName: "model-cache") pod "4b2cf39b-2c64-4757-b76a-319421cfc1f7" (UID: "4b2cf39b-2c64-4757-b76a-319421cfc1f7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 07:02:24.532325 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:24.532310    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b2cf39b-2c64-4757-b76a-319421cfc1f7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4b2cf39b-2c64-4757-b76a-319421cfc1f7" (UID: "4b2cf39b-2c64-4757-b76a-319421cfc1f7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 07:02:24.532431 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:24.532413    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b2cf39b-2c64-4757-b76a-319421cfc1f7-tmp-dir\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 07:02:24.532495 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:24.532435    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b2cf39b-2c64-4757-b76a-319421cfc1f7-home\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 07:02:24.532495 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:24.532448    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b2cf39b-2c64-4757-b76a-319421cfc1f7-model-cache\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 07:02:24.534166 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:24.534144    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b2cf39b-2c64-4757-b76a-319421cfc1f7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4b2cf39b-2c64-4757-b76a-319421cfc1f7" (UID: "4b2cf39b-2c64-4757-b76a-319421cfc1f7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 05 07:02:24.534271 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:24.534183    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b2cf39b-2c64-4757-b76a-319421cfc1f7-kube-api-access-vxw6g" (OuterVolumeSpecName: "kube-api-access-vxw6g") pod "4b2cf39b-2c64-4757-b76a-319421cfc1f7" (UID: "4b2cf39b-2c64-4757-b76a-319421cfc1f7"). InnerVolumeSpecName "kube-api-access-vxw6g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 07:02:24.534271 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:24.534213    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b2cf39b-2c64-4757-b76a-319421cfc1f7-dshm" (OuterVolumeSpecName: "dshm") pod "4b2cf39b-2c64-4757-b76a-319421cfc1f7" (UID: "4b2cf39b-2c64-4757-b76a-319421cfc1f7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 07:02:24.632959 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:24.632935    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b2cf39b-2c64-4757-b76a-319421cfc1f7-tls-certs\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 07:02:24.632959 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:24.632956    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b2cf39b-2c64-4757-b76a-319421cfc1f7-dshm\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 07:02:24.633116 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:24.632965    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxw6g\" (UniqueName: \"kubernetes.io/projected/4b2cf39b-2c64-4757-b76a-319421cfc1f7-kube-api-access-vxw6g\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 07:02:24.839365 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:24.839297    2567 generic.go:356] "Generic (PLEG): container finished" podID="4b2cf39b-2c64-4757-b76a-319421cfc1f7" containerID="86e105a15a857203e66621a4cd81b741f4f2acb55f9b9d0a71238335b2d9143f" exitCode=0
Sep 05 07:02:24.839365 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:24.839342    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb"
Sep 05 07:02:24.839365 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:24.839358    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb" event={"ID":"4b2cf39b-2c64-4757-b76a-319421cfc1f7","Type":"ContainerDied","Data":"86e105a15a857203e66621a4cd81b741f4f2acb55f9b9d0a71238335b2d9143f"}
Sep 05 07:02:24.839608 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:24.839394    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb" event={"ID":"4b2cf39b-2c64-4757-b76a-319421cfc1f7","Type":"ContainerDied","Data":"0157d11ca7d2eae2ec36a864f570f71fc4b9cae5b0bfacf203eec4349a72ba9a"}
Sep 05 07:02:24.839608 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:24.839414    2567 scope.go:117] "RemoveContainer" containerID="86e105a15a857203e66621a4cd81b741f4f2acb55f9b9d0a71238335b2d9143f"
Sep 05 07:02:24.847113 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:24.847094    2567 scope.go:117] "RemoveContainer" containerID="86e105a15a857203e66621a4cd81b741f4f2acb55f9b9d0a71238335b2d9143f"
Sep 05 07:02:24.847402 ip-10-0-141-49 kubenswrapper[2567]: E0905 07:02:24.847379    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86e105a15a857203e66621a4cd81b741f4f2acb55f9b9d0a71238335b2d9143f\": container with ID starting with 86e105a15a857203e66621a4cd81b741f4f2acb55f9b9d0a71238335b2d9143f not found: ID does not exist" containerID="86e105a15a857203e66621a4cd81b741f4f2acb55f9b9d0a71238335b2d9143f"
Sep 05 07:02:24.847454 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:24.847434    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86e105a15a857203e66621a4cd81b741f4f2acb55f9b9d0a71238335b2d9143f"} err="failed to get container status \"86e105a15a857203e66621a4cd81b741f4f2acb55f9b9d0a71238335b2d9143f\": rpc error: code = NotFound desc = could not find container \"86e105a15a857203e66621a4cd81b741f4f2acb55f9b9d0a71238335b2d9143f\": container with ID starting with 86e105a15a857203e66621a4cd81b741f4f2acb55f9b9d0a71238335b2d9143f not found: ID does not exist"
Sep 05 07:02:24.857248 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:24.857228    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb"]
Sep 05 07:02:24.860674 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:24.860654    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-02a1edac-kserve-5bdf4596f5-cchpb"]
Sep 05 07:02:25.894729 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:25.894693    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2" podUID="3ec4d29f-8eab-4a40-86b4-b95cbf755ec6" containerName="main" containerID="cri-o://f1b9ba9925edebd6f08157930bf907b928a829e7490141363b4ac86f3ebe69d8" gracePeriod=45
Sep 05 07:02:26.143737 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:26.143715    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2"
Sep 05 07:02:26.246520 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:26.246493    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ec4d29f-8eab-4a40-86b4-b95cbf755ec6-dshm\") pod \"3ec4d29f-8eab-4a40-86b4-b95cbf755ec6\" (UID: \"3ec4d29f-8eab-4a40-86b4-b95cbf755ec6\") "
Sep 05 07:02:26.246673 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:26.246551    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjfkz\" (UniqueName: \"kubernetes.io/projected/3ec4d29f-8eab-4a40-86b4-b95cbf755ec6-kube-api-access-bjfkz\") pod \"3ec4d29f-8eab-4a40-86b4-b95cbf755ec6\" (UID: \"3ec4d29f-8eab-4a40-86b4-b95cbf755ec6\") "
Sep 05 07:02:26.246673 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:26.246603    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ec4d29f-8eab-4a40-86b4-b95cbf755ec6-model-cache\") pod \"3ec4d29f-8eab-4a40-86b4-b95cbf755ec6\" (UID: \"3ec4d29f-8eab-4a40-86b4-b95cbf755ec6\") "
Sep 05 07:02:26.246673 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:26.246627    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ec4d29f-8eab-4a40-86b4-b95cbf755ec6-home\") pod \"3ec4d29f-8eab-4a40-86b4-b95cbf755ec6\" (UID: \"3ec4d29f-8eab-4a40-86b4-b95cbf755ec6\") "
Sep 05 07:02:26.246673 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:26.246650    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ec4d29f-8eab-4a40-86b4-b95cbf755ec6-tls-certs\") pod \"3ec4d29f-8eab-4a40-86b4-b95cbf755ec6\" (UID: \"3ec4d29f-8eab-4a40-86b4-b95cbf755ec6\") "
Sep 05 07:02:26.246898 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:26.246683    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ec4d29f-8eab-4a40-86b4-b95cbf755ec6-tmp-dir\") pod \"3ec4d29f-8eab-4a40-86b4-b95cbf755ec6\" (UID: \"3ec4d29f-8eab-4a40-86b4-b95cbf755ec6\") "
Sep 05 07:02:26.246959 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:26.246903    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ec4d29f-8eab-4a40-86b4-b95cbf755ec6-home" (OuterVolumeSpecName: "home") pod "3ec4d29f-8eab-4a40-86b4-b95cbf755ec6" (UID: "3ec4d29f-8eab-4a40-86b4-b95cbf755ec6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 07:02:26.246959 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:26.246919    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ec4d29f-8eab-4a40-86b4-b95cbf755ec6-model-cache" (OuterVolumeSpecName: "model-cache") pod "3ec4d29f-8eab-4a40-86b4-b95cbf755ec6" (UID: "3ec4d29f-8eab-4a40-86b4-b95cbf755ec6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 07:02:26.247082 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:26.246968    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ec4d29f-8eab-4a40-86b4-b95cbf755ec6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3ec4d29f-8eab-4a40-86b4-b95cbf755ec6" (UID: "3ec4d29f-8eab-4a40-86b4-b95cbf755ec6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 07:02:26.247082 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:26.247071    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ec4d29f-8eab-4a40-86b4-b95cbf755ec6-model-cache\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 07:02:26.247161 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:26.247090    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ec4d29f-8eab-4a40-86b4-b95cbf755ec6-home\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 07:02:26.248817 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:26.248790    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ec4d29f-8eab-4a40-86b4-b95cbf755ec6-dshm" (OuterVolumeSpecName: "dshm") pod "3ec4d29f-8eab-4a40-86b4-b95cbf755ec6" (UID: "3ec4d29f-8eab-4a40-86b4-b95cbf755ec6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 05 07:02:26.248817 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:26.248812    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ec4d29f-8eab-4a40-86b4-b95cbf755ec6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3ec4d29f-8eab-4a40-86b4-b95cbf755ec6" (UID: "3ec4d29f-8eab-4a40-86b4-b95cbf755ec6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 05 07:02:26.249130 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:26.248861    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ec4d29f-8eab-4a40-86b4-b95cbf755ec6-kube-api-access-bjfkz" (OuterVolumeSpecName: "kube-api-access-bjfkz") pod "3ec4d29f-8eab-4a40-86b4-b95cbf755ec6" (UID: "3ec4d29f-8eab-4a40-86b4-b95cbf755ec6"). InnerVolumeSpecName "kube-api-access-bjfkz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 07:02:26.348053 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:26.348003    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjfkz\" (UniqueName: \"kubernetes.io/projected/3ec4d29f-8eab-4a40-86b4-b95cbf755ec6-kube-api-access-bjfkz\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 07:02:26.348165 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:26.348053    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ec4d29f-8eab-4a40-86b4-b95cbf755ec6-tls-certs\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 07:02:26.348165 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:26.348070    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ec4d29f-8eab-4a40-86b4-b95cbf755ec6-tmp-dir\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 07:02:26.348165 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:26.348081    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ec4d29f-8eab-4a40-86b4-b95cbf755ec6-dshm\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 07:02:26.580612 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:26.580535    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b2cf39b-2c64-4757-b76a-319421cfc1f7" path="/var/lib/kubelet/pods/4b2cf39b-2c64-4757-b76a-319421cfc1f7/volumes"
Sep 05 07:02:26.850223 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:26.850146    2567 generic.go:356] "Generic (PLEG): container finished" podID="3ec4d29f-8eab-4a40-86b4-b95cbf755ec6" containerID="f1b9ba9925edebd6f08157930bf907b928a829e7490141363b4ac86f3ebe69d8" exitCode=0
Sep 05 07:02:26.850223 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:26.850186    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2" event={"ID":"3ec4d29f-8eab-4a40-86b4-b95cbf755ec6","Type":"ContainerDied","Data":"f1b9ba9925edebd6f08157930bf907b928a829e7490141363b4ac86f3ebe69d8"}
Sep 05 07:02:26.850223 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:26.850209    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2"
Sep 05 07:02:26.850451 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:26.850228    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2" event={"ID":"3ec4d29f-8eab-4a40-86b4-b95cbf755ec6","Type":"ContainerDied","Data":"1d181d23096f98d21ffd367ed32c17e22f1bd4bcd8697a1ad87ef9a403a14fa5"}
Sep 05 07:02:26.850451 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:26.850247    2567 scope.go:117] "RemoveContainer" containerID="f1b9ba9925edebd6f08157930bf907b928a829e7490141363b4ac86f3ebe69d8"
Sep 05 07:02:26.858945 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:26.858924    2567 scope.go:117] "RemoveContainer" containerID="f1b9ba9925edebd6f08157930bf907b928a829e7490141363b4ac86f3ebe69d8"
Sep 05 07:02:26.859234 ip-10-0-141-49 kubenswrapper[2567]: E0905 07:02:26.859216    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1b9ba9925edebd6f08157930bf907b928a829e7490141363b4ac86f3ebe69d8\": container with ID starting with f1b9ba9925edebd6f08157930bf907b928a829e7490141363b4ac86f3ebe69d8 not found: ID does not exist" containerID="f1b9ba9925edebd6f08157930bf907b928a829e7490141363b4ac86f3ebe69d8"
Sep 05 07:02:26.859309 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:26.859243    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1b9ba9925edebd6f08157930bf907b928a829e7490141363b4ac86f3ebe69d8"} err="failed to get container status \"f1b9ba9925edebd6f08157930bf907b928a829e7490141363b4ac86f3ebe69d8\": rpc error: code = NotFound desc = could not find container \"f1b9ba9925edebd6f08157930bf907b928a829e7490141363b4ac86f3ebe69d8\": container with ID starting with f1b9ba9925edebd6f08157930bf907b928a829e7490141363b4ac86f3ebe69d8 not found: ID does not exist"
Sep 05 07:02:26.867959 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:26.867931    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2"]
Sep 05 07:02:26.871413 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:26.871392    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-02a1edac-kserve-6cfb8778d7-fdxv2"]
Sep 05 07:02:28.480770 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:28.480735    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-644985f7bf-c4v6w"]
Sep 05 07:02:28.481249 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:28.481172    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ec4d29f-8eab-4a40-86b4-b95cbf755ec6" containerName="main"
Sep 05 07:02:28.481249 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:28.481191    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ec4d29f-8eab-4a40-86b4-b95cbf755ec6" containerName="main"
Sep 05 07:02:28.481249 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:28.481218    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b2cf39b-2c64-4757-b76a-319421cfc1f7" containerName="main"
Sep 05 07:02:28.481249 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:28.481225    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b2cf39b-2c64-4757-b76a-319421cfc1f7" containerName="main"
Sep 05 07:02:28.481444 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:28.481277    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b2cf39b-2c64-4757-b76a-319421cfc1f7" containerName="main"
Sep 05 07:02:28.481444 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:28.481293    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ec4d29f-8eab-4a40-86b4-b95cbf755ec6" containerName="main"
Sep 05 07:02:28.485832 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:28.485807    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-644985f7bf-c4v6w"
Sep 05 07:02:28.489605 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:28.489567    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 05 07:02:28.489884 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:28.489857    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-hpktq\""
Sep 05 07:02:28.490209 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:28.490186    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 05 07:02:28.490463 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:28.490445    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 05 07:02:28.490743 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:28.490724    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 05 07:02:28.497052 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:28.496968    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-644985f7bf-c4v6w"]
Sep 05 07:02:28.582800 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:28.582763    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ec4d29f-8eab-4a40-86b4-b95cbf755ec6" path="/var/lib/kubelet/pods/3ec4d29f-8eab-4a40-86b4-b95cbf755ec6/volumes"
Sep 05 07:02:28.665000 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:28.664961    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13a48b01-61ff-482b-9443-343e01486840-metrics-certs\") pod \"maas-api-644985f7bf-c4v6w\" (UID: \"13a48b01-61ff-482b-9443-343e01486840\") " pod="odh-ai-gateway-infra/maas-api-644985f7bf-c4v6w"
Sep 05 07:02:28.665182 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:28.665068    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13a48b01-61ff-482b-9443-343e01486840-openshift-service-ca\") pod \"maas-api-644985f7bf-c4v6w\" (UID: \"13a48b01-61ff-482b-9443-343e01486840\") " pod="odh-ai-gateway-infra/maas-api-644985f7bf-c4v6w"
Sep 05 07:02:28.665182 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:28.665107    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13a48b01-61ff-482b-9443-343e01486840-maas-api-tls\") pod \"maas-api-644985f7bf-c4v6w\" (UID: \"13a48b01-61ff-482b-9443-343e01486840\") " pod="odh-ai-gateway-infra/maas-api-644985f7bf-c4v6w"
Sep 05 07:02:28.665265 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:28.665232    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8njdm\" (UniqueName: \"kubernetes.io/projected/13a48b01-61ff-482b-9443-343e01486840-kube-api-access-8njdm\") pod \"maas-api-644985f7bf-c4v6w\" (UID: \"13a48b01-61ff-482b-9443-343e01486840\") " pod="odh-ai-gateway-infra/maas-api-644985f7bf-c4v6w"
Sep 05 07:02:28.766452 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:28.766374    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8njdm\" (UniqueName: \"kubernetes.io/projected/13a48b01-61ff-482b-9443-343e01486840-kube-api-access-8njdm\") pod \"maas-api-644985f7bf-c4v6w\" (UID: \"13a48b01-61ff-482b-9443-343e01486840\") " pod="odh-ai-gateway-infra/maas-api-644985f7bf-c4v6w"
Sep 05 07:02:28.766452 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:28.766434    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13a48b01-61ff-482b-9443-343e01486840-metrics-certs\") pod \"maas-api-644985f7bf-c4v6w\" (UID: \"13a48b01-61ff-482b-9443-343e01486840\") " pod="odh-ai-gateway-infra/maas-api-644985f7bf-c4v6w"
Sep 05 07:02:28.766648 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:28.766493    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13a48b01-61ff-482b-9443-343e01486840-openshift-service-ca\") pod \"maas-api-644985f7bf-c4v6w\" (UID: \"13a48b01-61ff-482b-9443-343e01486840\") " pod="odh-ai-gateway-infra/maas-api-644985f7bf-c4v6w"
Sep 05 07:02:28.766648 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:28.766526    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13a48b01-61ff-482b-9443-343e01486840-maas-api-tls\") pod \"maas-api-644985f7bf-c4v6w\" (UID: \"13a48b01-61ff-482b-9443-343e01486840\") " pod="odh-ai-gateway-infra/maas-api-644985f7bf-c4v6w"
Sep 05 07:02:28.767319 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:28.767286    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13a48b01-61ff-482b-9443-343e01486840-openshift-service-ca\") pod \"maas-api-644985f7bf-c4v6w\" (UID: \"13a48b01-61ff-482b-9443-343e01486840\") " pod="odh-ai-gateway-infra/maas-api-644985f7bf-c4v6w"
Sep 05 07:02:28.769495 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:28.769467    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13a48b01-61ff-482b-9443-343e01486840-metrics-certs\") pod \"maas-api-644985f7bf-c4v6w\" (UID: \"13a48b01-61ff-482b-9443-343e01486840\") " pod="odh-ai-gateway-infra/maas-api-644985f7bf-c4v6w"
Sep 05 07:02:28.769796 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:28.769763    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13a48b01-61ff-482b-9443-343e01486840-maas-api-tls\") pod \"maas-api-644985f7bf-c4v6w\" (UID: \"13a48b01-61ff-482b-9443-343e01486840\") " pod="odh-ai-gateway-infra/maas-api-644985f7bf-c4v6w"
Sep 05 07:02:28.774988 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:28.774960    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8njdm\" (UniqueName: \"kubernetes.io/projected/13a48b01-61ff-482b-9443-343e01486840-kube-api-access-8njdm\") pod \"maas-api-644985f7bf-c4v6w\" (UID: \"13a48b01-61ff-482b-9443-343e01486840\") " pod="odh-ai-gateway-infra/maas-api-644985f7bf-c4v6w"
Sep 05 07:02:28.805324 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:28.805302    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-644985f7bf-c4v6w"
Sep 05 07:02:29.092242 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:29.092219    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-644985f7bf-c4v6w"]
Sep 05 07:02:29.094411 ip-10-0-141-49 kubenswrapper[2567]: W0905 07:02:29.094381    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13a48b01_61ff_482b_9443_343e01486840.slice/crio-ef1fcdfb6e8ea11175f9d154980ebd30e2c21ba1ad77a61ae2621f5e6e40a511 WatchSource:0}: Error finding container ef1fcdfb6e8ea11175f9d154980ebd30e2c21ba1ad77a61ae2621f5e6e40a511: Status 404 returned error can't find the container with id ef1fcdfb6e8ea11175f9d154980ebd30e2c21ba1ad77a61ae2621f5e6e40a511
Sep 05 07:02:29.096076 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:29.096056    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 05 07:02:29.869016 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:29.868972    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-644985f7bf-c4v6w" event={"ID":"13a48b01-61ff-482b-9443-343e01486840","Type":"ContainerStarted","Data":"ef1fcdfb6e8ea11175f9d154980ebd30e2c21ba1ad77a61ae2621f5e6e40a511"}
Sep 05 07:02:30.874790 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:30.874759    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-644985f7bf-c4v6w" event={"ID":"13a48b01-61ff-482b-9443-343e01486840","Type":"ContainerStarted","Data":"64e115d78d4110a7d0ef900d4b40de8cb3a1e2ad393de4ed205b30e602cfc952"}
Sep 05 07:02:30.875123 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:30.874884    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-644985f7bf-c4v6w"
Sep 05 07:02:30.893142 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:30.893096    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-644985f7bf-c4v6w" podStartSLOduration=1.240719376 podStartE2EDuration="2.893082478s" totalImagesPullingTime="1.652363102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 07:02:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 07:02:30.890431848 +0000 UTC m=+2216.864186524" watchObservedRunningTime="2026-09-05 07:02:30.893082478 +0000 UTC m=+2216.866837152"
Sep 05 07:02:36.644322 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:36.644279    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-644985f7bf-c4v6w"]
Sep 05 07:02:36.644712 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:36.644506    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-644985f7bf-c4v6w" podUID="13a48b01-61ff-482b-9443-343e01486840" containerName="maas-api" containerID="cri-o://64e115d78d4110a7d0ef900d4b40de8cb3a1e2ad393de4ed205b30e602cfc952" gracePeriod=30
Sep 05 07:02:36.649960 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:36.649941    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-644985f7bf-c4v6w"
Sep 05 07:02:36.674571 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:36.674546    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5699887589-zgcgx"]
Sep 05 07:02:36.677722 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:36.677705    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5699887589-zgcgx"
Sep 05 07:02:36.685441 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:36.685417    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5699887589-zgcgx"]
Sep 05 07:02:36.736395 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:36.736353    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx4nx\" (UniqueName: \"kubernetes.io/projected/60ee0b44-fc3e-4fa7-ac3a-7d843c9d1c78-kube-api-access-gx4nx\") pod \"maas-api-5699887589-zgcgx\" (UID: \"60ee0b44-fc3e-4fa7-ac3a-7d843c9d1c78\") " pod="odh-ai-gateway-infra/maas-api-5699887589-zgcgx"
Sep 05 07:02:36.736494 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:36.736409    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60ee0b44-fc3e-4fa7-ac3a-7d843c9d1c78-metrics-certs\") pod \"maas-api-5699887589-zgcgx\" (UID: \"60ee0b44-fc3e-4fa7-ac3a-7d843c9d1c78\") " pod="odh-ai-gateway-infra/maas-api-5699887589-zgcgx"
Sep 05 07:02:36.736494 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:36.736462    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60ee0b44-fc3e-4fa7-ac3a-7d843c9d1c78-openshift-service-ca\") pod \"maas-api-5699887589-zgcgx\" (UID: \"60ee0b44-fc3e-4fa7-ac3a-7d843c9d1c78\") " pod="odh-ai-gateway-infra/maas-api-5699887589-zgcgx"
Sep 05 07:02:36.736568 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:36.736500    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60ee0b44-fc3e-4fa7-ac3a-7d843c9d1c78-maas-api-tls\") pod \"maas-api-5699887589-zgcgx\" (UID: \"60ee0b44-fc3e-4fa7-ac3a-7d843c9d1c78\") " pod="odh-ai-gateway-infra/maas-api-5699887589-zgcgx"
Sep 05 07:02:36.837980 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:36.837932    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx4nx\" (UniqueName: \"kubernetes.io/projected/60ee0b44-fc3e-4fa7-ac3a-7d843c9d1c78-kube-api-access-gx4nx\") pod \"maas-api-5699887589-zgcgx\" (UID: \"60ee0b44-fc3e-4fa7-ac3a-7d843c9d1c78\") " pod="odh-ai-gateway-infra/maas-api-5699887589-zgcgx"
Sep 05 07:02:36.838130 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:36.838009    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60ee0b44-fc3e-4fa7-ac3a-7d843c9d1c78-metrics-certs\") pod \"maas-api-5699887589-zgcgx\" (UID: \"60ee0b44-fc3e-4fa7-ac3a-7d843c9d1c78\") " pod="odh-ai-gateway-infra/maas-api-5699887589-zgcgx"
Sep 05 07:02:36.838130 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:36.838085    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60ee0b44-fc3e-4fa7-ac3a-7d843c9d1c78-openshift-service-ca\") pod \"maas-api-5699887589-zgcgx\" (UID: \"60ee0b44-fc3e-4fa7-ac3a-7d843c9d1c78\") " pod="odh-ai-gateway-infra/maas-api-5699887589-zgcgx"
Sep 05 07:02:36.838257 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:36.838147    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60ee0b44-fc3e-4fa7-ac3a-7d843c9d1c78-maas-api-tls\") pod \"maas-api-5699887589-zgcgx\" (UID: \"60ee0b44-fc3e-4fa7-ac3a-7d843c9d1c78\") " pod="odh-ai-gateway-infra/maas-api-5699887589-zgcgx"
Sep 05 07:02:36.839003 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:36.838881    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60ee0b44-fc3e-4fa7-ac3a-7d843c9d1c78-openshift-service-ca\") pod \"maas-api-5699887589-zgcgx\" (UID: \"60ee0b44-fc3e-4fa7-ac3a-7d843c9d1c78\") " pod="odh-ai-gateway-infra/maas-api-5699887589-zgcgx"
Sep 05 07:02:36.840824 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:36.840796    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60ee0b44-fc3e-4fa7-ac3a-7d843c9d1c78-maas-api-tls\") pod \"maas-api-5699887589-zgcgx\" (UID: \"60ee0b44-fc3e-4fa7-ac3a-7d843c9d1c78\") " pod="odh-ai-gateway-infra/maas-api-5699887589-zgcgx"
Sep 05 07:02:36.841056 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:36.841006    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60ee0b44-fc3e-4fa7-ac3a-7d843c9d1c78-metrics-certs\") pod \"maas-api-5699887589-zgcgx\" (UID: \"60ee0b44-fc3e-4fa7-ac3a-7d843c9d1c78\") " pod="odh-ai-gateway-infra/maas-api-5699887589-zgcgx"
Sep 05 07:02:36.849791 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:36.849761    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx4nx\" (UniqueName: \"kubernetes.io/projected/60ee0b44-fc3e-4fa7-ac3a-7d843c9d1c78-kube-api-access-gx4nx\") pod \"maas-api-5699887589-zgcgx\" (UID: \"60ee0b44-fc3e-4fa7-ac3a-7d843c9d1c78\") " pod="odh-ai-gateway-infra/maas-api-5699887589-zgcgx"
Sep 05 07:02:36.890422 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:36.890404    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-644985f7bf-c4v6w"
Sep 05 07:02:36.903333 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:36.903279    2567 generic.go:356] "Generic (PLEG): container finished" podID="13a48b01-61ff-482b-9443-343e01486840" containerID="64e115d78d4110a7d0ef900d4b40de8cb3a1e2ad393de4ed205b30e602cfc952" exitCode=0
Sep 05 07:02:36.903333 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:36.903315    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-644985f7bf-c4v6w"
Sep 05 07:02:36.903333 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:36.903327    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-644985f7bf-c4v6w" event={"ID":"13a48b01-61ff-482b-9443-343e01486840","Type":"ContainerDied","Data":"64e115d78d4110a7d0ef900d4b40de8cb3a1e2ad393de4ed205b30e602cfc952"}
Sep 05 07:02:36.903487 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:36.903366    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-644985f7bf-c4v6w" event={"ID":"13a48b01-61ff-482b-9443-343e01486840","Type":"ContainerDied","Data":"ef1fcdfb6e8ea11175f9d154980ebd30e2c21ba1ad77a61ae2621f5e6e40a511"}
Sep 05 07:02:36.903487 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:36.903387    2567 scope.go:117] "RemoveContainer" containerID="64e115d78d4110a7d0ef900d4b40de8cb3a1e2ad393de4ed205b30e602cfc952"
Sep 05 07:02:36.912962 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:36.912940    2567 scope.go:117] "RemoveContainer" containerID="64e115d78d4110a7d0ef900d4b40de8cb3a1e2ad393de4ed205b30e602cfc952"
Sep 05 07:02:36.913252 ip-10-0-141-49 kubenswrapper[2567]: E0905 07:02:36.913235    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64e115d78d4110a7d0ef900d4b40de8cb3a1e2ad393de4ed205b30e602cfc952\": container with ID starting with 64e115d78d4110a7d0ef900d4b40de8cb3a1e2ad393de4ed205b30e602cfc952 not found: ID does not exist" containerID="64e115d78d4110a7d0ef900d4b40de8cb3a1e2ad393de4ed205b30e602cfc952"
Sep 05 07:02:36.913323 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:36.913261    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64e115d78d4110a7d0ef900d4b40de8cb3a1e2ad393de4ed205b30e602cfc952"} err="failed to get container status \"64e115d78d4110a7d0ef900d4b40de8cb3a1e2ad393de4ed205b30e602cfc952\": rpc error: code = NotFound desc = could not find container \"64e115d78d4110a7d0ef900d4b40de8cb3a1e2ad393de4ed205b30e602cfc952\": container with ID starting with 64e115d78d4110a7d0ef900d4b40de8cb3a1e2ad393de4ed205b30e602cfc952 not found: ID does not exist"
Sep 05 07:02:36.938867 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:36.938849    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13a48b01-61ff-482b-9443-343e01486840-maas-api-tls\") pod \"13a48b01-61ff-482b-9443-343e01486840\" (UID: \"13a48b01-61ff-482b-9443-343e01486840\") "
Sep 05 07:02:36.938966 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:36.938884    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13a48b01-61ff-482b-9443-343e01486840-metrics-certs\") pod \"13a48b01-61ff-482b-9443-343e01486840\" (UID: \"13a48b01-61ff-482b-9443-343e01486840\") "
Sep 05 07:02:36.938966 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:36.938901    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8njdm\" (UniqueName: \"kubernetes.io/projected/13a48b01-61ff-482b-9443-343e01486840-kube-api-access-8njdm\") pod \"13a48b01-61ff-482b-9443-343e01486840\" (UID: \"13a48b01-61ff-482b-9443-343e01486840\") "
Sep 05 07:02:36.938966 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:36.938920    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13a48b01-61ff-482b-9443-343e01486840-openshift-service-ca\") pod \"13a48b01-61ff-482b-9443-343e01486840\" (UID: \"13a48b01-61ff-482b-9443-343e01486840\") "
Sep 05 07:02:36.939395 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:36.939366    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13a48b01-61ff-482b-9443-343e01486840-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "13a48b01-61ff-482b-9443-343e01486840" (UID: "13a48b01-61ff-482b-9443-343e01486840"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 05 07:02:36.941310 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:36.941289    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13a48b01-61ff-482b-9443-343e01486840-kube-api-access-8njdm" (OuterVolumeSpecName: "kube-api-access-8njdm") pod "13a48b01-61ff-482b-9443-343e01486840" (UID: "13a48b01-61ff-482b-9443-343e01486840"). InnerVolumeSpecName "kube-api-access-8njdm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 05 07:02:36.941590 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:36.941568    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13a48b01-61ff-482b-9443-343e01486840-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "13a48b01-61ff-482b-9443-343e01486840" (UID: "13a48b01-61ff-482b-9443-343e01486840"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 05 07:02:36.941590 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:36.941576    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13a48b01-61ff-482b-9443-343e01486840-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "13a48b01-61ff-482b-9443-343e01486840" (UID: "13a48b01-61ff-482b-9443-343e01486840"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 05 07:02:37.027713 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:37.027686    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5699887589-zgcgx"
Sep 05 07:02:37.039701 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:37.039678    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13a48b01-61ff-482b-9443-343e01486840-maas-api-tls\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 07:02:37.039701 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:37.039701    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13a48b01-61ff-482b-9443-343e01486840-metrics-certs\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 07:02:37.039813 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:37.039710    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8njdm\" (UniqueName: \"kubernetes.io/projected/13a48b01-61ff-482b-9443-343e01486840-kube-api-access-8njdm\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 07:02:37.039813 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:37.039720    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13a48b01-61ff-482b-9443-343e01486840-openshift-service-ca\") on node \"ip-10-0-141-49.ec2.internal\" DevicePath \"\""
Sep 05 07:02:37.228114 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:37.228082    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-644985f7bf-c4v6w"]
Sep 05 07:02:37.230079 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:37.230055    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-644985f7bf-c4v6w"]
Sep 05 07:02:37.297232 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:37.297209    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5699887589-zgcgx"]
Sep 05 07:02:37.298998 ip-10-0-141-49 kubenswrapper[2567]: W0905 07:02:37.298971    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60ee0b44_fc3e_4fa7_ac3a_7d843c9d1c78.slice/crio-8cde2095babc6c7264d6286ef35bb0422dfd8f855926a4bb62376d24792cf381 WatchSource:0}: Error finding container 8cde2095babc6c7264d6286ef35bb0422dfd8f855926a4bb62376d24792cf381: Status 404 returned error can't find the container with id 8cde2095babc6c7264d6286ef35bb0422dfd8f855926a4bb62376d24792cf381
Sep 05 07:02:37.909455 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:37.909420    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5699887589-zgcgx" event={"ID":"60ee0b44-fc3e-4fa7-ac3a-7d843c9d1c78","Type":"ContainerStarted","Data":"76d84dc50495d71ebb1d54102d75211cf85595d0df814322894b235b39caa174"}
Sep 05 07:02:37.909957 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:37.909485    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5699887589-zgcgx" event={"ID":"60ee0b44-fc3e-4fa7-ac3a-7d843c9d1c78","Type":"ContainerStarted","Data":"8cde2095babc6c7264d6286ef35bb0422dfd8f855926a4bb62376d24792cf381"}
Sep 05 07:02:37.909957 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:37.909518    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5699887589-zgcgx"
Sep 05 07:02:37.925862 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:37.925751    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5699887589-zgcgx" podStartSLOduration=1.475347149 podStartE2EDuration="1.925735117s" totalImagesPullingTime="450.387968ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 07:02:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 07:02:37.924261335 +0000 UTC m=+2223.898016012" watchObservedRunningTime="2026-09-05 07:02:37.925735117 +0000 UTC m=+2223.899489791"
Sep 05 07:02:38.581687 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:38.581656    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13a48b01-61ff-482b-9443-343e01486840" path="/var/lib/kubelet/pods/13a48b01-61ff-482b-9443-343e01486840/volumes"
Sep 05 07:02:43.920525 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:02:43.920496    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5699887589-zgcgx"
Sep 05 07:03:00.653872 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:00.653795    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f79bbd6d6-bc7xr_14ff11ad-015c-49e2-967b-8218bd73c4dd/authorino/0.log"
Sep 05 07:03:06.571637 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:06.571607    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-qzlvk_591433e0-9a8b-472a-9d1b-fa09be16c023/server/0.log"
Sep 05 07:03:06.955586 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:06.955560    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-665f9d595b-84wff_63bba13c-e48d-4752-8b3e-4f5a38784df9/manager/0.log"
Sep 05 07:03:06.961209 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:06.961192    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-665f9d595b-84wff_63bba13c-e48d-4752-8b3e-4f5a38784df9/copy-manifests/0.log"
Sep 05 07:03:07.586143 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:07.586117    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5699887589-zgcgx_60ee0b44-fc3e-4fa7-ac3a-7d843c9d1c78/maas-api/0.log"
Sep 05 07:03:08.764214 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:08.764186    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f79bbd6d6-bc7xr_14ff11ad-015c-49e2-967b-8218bd73c4dd/authorino/0.log"
Sep 05 07:03:09.922132 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:09.922099    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz_71a7ecb0-e5cf-4b09-9511-0afd1c132cbe/istio-proxy/0.log"
Sep 05 07:03:10.187918 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:10.187845    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6ff6468b6c-8k468_ddccbaf7-3774-407d-abe9-694d2db3a112/kube-auth-proxy/0.log"
Sep 05 07:03:10.432492 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:10.432467    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-6v9xh_5ce163ec-61e7-445e-96a7-8a90054949e8/istio-proxy/1.log"
Sep 05 07:03:10.797394 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:10.797370    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5885f47846-fxgw4_2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4/router/0.log"
Sep 05 07:03:11.499612 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:11.499576    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-5g5rf_dd8f9bc7-ef8b-409e-a929-3249dadbb73d/main/0.log"
Sep 05 07:03:11.616557 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:11.616522    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq2pw8_a67fbf2a-2103-4d3a-b35c-99f3ba655a1d/main/0.log"
Sep 05 07:03:20.734310 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:20.734281    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ddpb9_486067d7-7a47-4c88-86d6-721fcd141e43/global-pull-secret-syncer/0.log"
Sep 05 07:03:20.890350 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:20.890327    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-snbwl_b7ed807e-6f50-4ceb-bc81-c95d18d4c24f/konnectivity-agent/0.log"
Sep 05 07:03:20.941504 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:20.941470    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-49.ec2.internal_83997819976fe16ec940b23b2f10ee3f/haproxy/0.log"
Sep 05 07:03:25.218095 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:25.218062    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f79bbd6d6-bc7xr_14ff11ad-015c-49e2-967b-8218bd73c4dd/authorino/0.log"
Sep 05 07:03:27.267528 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:27.267503    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-76d584df7-sp8xc_0957d224-5722-434b-875e-08cddf2a9179/metrics-server/0.log"
Sep 05 07:03:27.293183 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:27.293160    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-9sk9w_40d15e42-0673-4995-9bf3-442f64a656b2/monitoring-plugin/0.log"
Sep 05 07:03:27.461550 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:27.461526    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zzm9b_f14b04b2-7405-41e1-9dc4-121f01eaa540/node-exporter/0.log"
Sep 05 07:03:27.480074 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:27.480051    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zzm9b_f14b04b2-7405-41e1-9dc4-121f01eaa540/kube-rbac-proxy/0.log"
Sep 05 07:03:27.503991 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:27.503973    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zzm9b_f14b04b2-7405-41e1-9dc4-121f01eaa540/init-textfile/0.log"
Sep 05 07:03:27.543840 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:27.543807    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-fl7v2_a6ccb90c-ddd5-4d93-97ea-39d417b1ba57/kube-rbac-proxy-main/0.log"
Sep 05 07:03:27.565695 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:27.565678    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-fl7v2_a6ccb90c-ddd5-4d93-97ea-39d417b1ba57/kube-rbac-proxy-self/0.log"
Sep 05 07:03:27.584478 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:27.584455    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-fl7v2_a6ccb90c-ddd5-4d93-97ea-39d417b1ba57/openshift-state-metrics/0.log"
Sep 05 07:03:27.621412 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:27.621391    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_487fa0fd-f22c-42a9-9fb2-396b113b8072/prometheus/0.log"
Sep 05 07:03:27.640260 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:27.640228    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_487fa0fd-f22c-42a9-9fb2-396b113b8072/config-reloader/0.log"
Sep 05 07:03:27.660337 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:27.660312    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_487fa0fd-f22c-42a9-9fb2-396b113b8072/thanos-sidecar/0.log"
Sep 05 07:03:27.680933 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:27.680909    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_487fa0fd-f22c-42a9-9fb2-396b113b8072/kube-rbac-proxy-web/0.log"
Sep 05 07:03:27.701645 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:27.701623    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_487fa0fd-f22c-42a9-9fb2-396b113b8072/kube-rbac-proxy/0.log"
Sep 05 07:03:27.721941 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:27.721922    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_487fa0fd-f22c-42a9-9fb2-396b113b8072/kube-rbac-proxy-thanos/0.log"
Sep 05 07:03:27.742108 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:27.742090    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_487fa0fd-f22c-42a9-9fb2-396b113b8072/init-config-reloader/0.log"
Sep 05 07:03:30.900388 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:30.900354    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-q9qgh/perf-node-gather-daemonset-xzqtc"]
Sep 05 07:03:30.900746 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:30.900670    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13a48b01-61ff-482b-9443-343e01486840" containerName="maas-api"
Sep 05 07:03:30.900746 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:30.900680    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="13a48b01-61ff-482b-9443-343e01486840" containerName="maas-api"
Sep 05 07:03:30.900746 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:30.900746    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="13a48b01-61ff-482b-9443-343e01486840" containerName="maas-api"
Sep 05 07:03:30.903114 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:30.903094    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-xzqtc"
Sep 05 07:03:30.905434 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:30.905418    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q9qgh\"/\"openshift-service-ca.crt\""
Sep 05 07:03:30.906443 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:30.906427    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-q9qgh\"/\"default-dockercfg-ssk9n\""
Sep 05 07:03:30.906443 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:30.906440    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q9qgh\"/\"kube-root-ca.crt\""
Sep 05 07:03:30.913126 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:30.913107    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q9qgh/perf-node-gather-daemonset-xzqtc"]
Sep 05 07:03:30.983159 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:30.983129    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5txmw\" (UniqueName: \"kubernetes.io/projected/f5144d1a-b9bb-4fb1-a188-e20c11a1b348-kube-api-access-5txmw\") pod \"perf-node-gather-daemonset-xzqtc\" (UID: \"f5144d1a-b9bb-4fb1-a188-e20c11a1b348\") " pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-xzqtc"
Sep 05 07:03:30.983309 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:30.983183    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f5144d1a-b9bb-4fb1-a188-e20c11a1b348-proc\") pod \"perf-node-gather-daemonset-xzqtc\" (UID: \"f5144d1a-b9bb-4fb1-a188-e20c11a1b348\") " pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-xzqtc"
Sep 05 07:03:30.983309 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:30.983241    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f5144d1a-b9bb-4fb1-a188-e20c11a1b348-podres\") pod \"perf-node-gather-daemonset-xzqtc\" (UID: \"f5144d1a-b9bb-4fb1-a188-e20c11a1b348\") " pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-xzqtc"
Sep 05 07:03:30.983309 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:30.983270    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5144d1a-b9bb-4fb1-a188-e20c11a1b348-sys\") pod \"perf-node-gather-daemonset-xzqtc\" (UID: \"f5144d1a-b9bb-4fb1-a188-e20c11a1b348\") " pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-xzqtc"
Sep 05 07:03:30.983309 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:30.983291    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f5144d1a-b9bb-4fb1-a188-e20c11a1b348-lib-modules\") pod \"perf-node-gather-daemonset-xzqtc\" (UID: \"f5144d1a-b9bb-4fb1-a188-e20c11a1b348\") " pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-xzqtc"
Sep 05 07:03:31.083682 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:31.083652    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5txmw\" (UniqueName: \"kubernetes.io/projected/f5144d1a-b9bb-4fb1-a188-e20c11a1b348-kube-api-access-5txmw\") pod \"perf-node-gather-daemonset-xzqtc\" (UID: \"f5144d1a-b9bb-4fb1-a188-e20c11a1b348\") " pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-xzqtc"
Sep 05 07:03:31.083805 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:31.083696    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f5144d1a-b9bb-4fb1-a188-e20c11a1b348-proc\") pod \"perf-node-gather-daemonset-xzqtc\" (UID: \"f5144d1a-b9bb-4fb1-a188-e20c11a1b348\") " pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-xzqtc"
Sep 05 07:03:31.083805 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:31.083721    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f5144d1a-b9bb-4fb1-a188-e20c11a1b348-podres\") pod \"perf-node-gather-daemonset-xzqtc\" (UID: \"f5144d1a-b9bb-4fb1-a188-e20c11a1b348\") " pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-xzqtc"
Sep 05 07:03:31.083805 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:31.083749    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5144d1a-b9bb-4fb1-a188-e20c11a1b348-sys\") pod \"perf-node-gather-daemonset-xzqtc\" (UID: \"f5144d1a-b9bb-4fb1-a188-e20c11a1b348\") " pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-xzqtc"
Sep 05 07:03:31.083805 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:31.083766    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f5144d1a-b9bb-4fb1-a188-e20c11a1b348-lib-modules\") pod \"perf-node-gather-daemonset-xzqtc\" (UID: \"f5144d1a-b9bb-4fb1-a188-e20c11a1b348\") " pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-xzqtc"
Sep 05 07:03:31.083805 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:31.083785    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f5144d1a-b9bb-4fb1-a188-e20c11a1b348-proc\") pod \"perf-node-gather-daemonset-xzqtc\" (UID: \"f5144d1a-b9bb-4fb1-a188-e20c11a1b348\") " pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-xzqtc"
Sep 05 07:03:31.083978 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:31.083885    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5144d1a-b9bb-4fb1-a188-e20c11a1b348-sys\") pod \"perf-node-gather-daemonset-xzqtc\" (UID: \"f5144d1a-b9bb-4fb1-a188-e20c11a1b348\") " pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-xzqtc"
Sep 05 07:03:31.083978 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:31.083911    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f5144d1a-b9bb-4fb1-a188-e20c11a1b348-lib-modules\") pod \"perf-node-gather-daemonset-xzqtc\" (UID: \"f5144d1a-b9bb-4fb1-a188-e20c11a1b348\") " pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-xzqtc"
Sep 05 07:03:31.083978 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:31.083911    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f5144d1a-b9bb-4fb1-a188-e20c11a1b348-podres\") pod \"perf-node-gather-daemonset-xzqtc\" (UID: \"f5144d1a-b9bb-4fb1-a188-e20c11a1b348\") " pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-xzqtc"
Sep 05 07:03:31.092996 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:31.092979    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5txmw\" (UniqueName: \"kubernetes.io/projected/f5144d1a-b9bb-4fb1-a188-e20c11a1b348-kube-api-access-5txmw\") pod \"perf-node-gather-daemonset-xzqtc\" (UID: \"f5144d1a-b9bb-4fb1-a188-e20c11a1b348\") " pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-xzqtc"
Sep 05 07:03:31.213718 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:31.213692    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-xzqtc"
Sep 05 07:03:31.481548 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:31.481524    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q9qgh/perf-node-gather-daemonset-xzqtc"]
Sep 05 07:03:31.483593 ip-10-0-141-49 kubenswrapper[2567]: W0905 07:03:31.483565    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf5144d1a_b9bb_4fb1_a188_e20c11a1b348.slice/crio-0642fe49b8c37fa800bc02c58ebead06772f8115ee2bb53bacb7492514b404ec WatchSource:0}: Error finding container 0642fe49b8c37fa800bc02c58ebead06772f8115ee2bb53bacb7492514b404ec: Status 404 returned error can't find the container with id 0642fe49b8c37fa800bc02c58ebead06772f8115ee2bb53bacb7492514b404ec
Sep 05 07:03:32.163131 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:32.163091    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-xzqtc" event={"ID":"f5144d1a-b9bb-4fb1-a188-e20c11a1b348","Type":"ContainerStarted","Data":"24cbb27e409a86957a17c3bcb489cc1762374aec98fb5241cdedf4d0d97c96d8"}
Sep 05 07:03:32.163559 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:32.163149    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-xzqtc" event={"ID":"f5144d1a-b9bb-4fb1-a188-e20c11a1b348","Type":"ContainerStarted","Data":"0642fe49b8c37fa800bc02c58ebead06772f8115ee2bb53bacb7492514b404ec"}
Sep 05 07:03:32.163559 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:32.163170    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-xzqtc"
Sep 05 07:03:32.180172 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:32.180131    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-xzqtc" podStartSLOduration=2.180117237 podStartE2EDuration="2.180117237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 07:03:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 07:03:32.179064985 +0000 UTC m=+2278.152819657" watchObservedRunningTime="2026-09-05 07:03:32.180117237 +0000 UTC m=+2278.153871911"
Sep 05 07:03:32.801070 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:32.801021    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2hbc9_60948d62-de5e-4153-88a9-35f7726ca11d/dns/0.log"
Sep 05 07:03:32.820490 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:32.820466    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2hbc9_60948d62-de5e-4153-88a9-35f7726ca11d/kube-rbac-proxy/0.log"
Sep 05 07:03:32.962088 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:32.962061    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gqtqf_6258b8f7-e185-4e63-8f2d-5f693cd6f19a/dns-node-resolver/0.log"
Sep 05 07:03:33.580075 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:33.580039    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-56b9678bf9-7cgmx_e6e30ace-ad3e-48df-a76f-826f347a3a2b/registry/0.log"
Sep 05 07:03:33.646508 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:33.646479    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d8ftv_cfb4483c-d0eb-4434-95e5-46fdb9618271/node-ca/0.log"
Sep 05 07:03:34.551876 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:34.551845    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz_71a7ecb0-e5cf-4b09-9511-0afd1c132cbe/istio-proxy/0.log"
Sep 05 07:03:34.858567 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:34.858492    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6ff6468b6c-8k468_ddccbaf7-3774-407d-abe9-694d2db3a112/kube-auth-proxy/0.log"
Sep 05 07:03:34.913179 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:34.913149    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-6v9xh_5ce163ec-61e7-445e-96a7-8a90054949e8/istio-proxy/0.log"
Sep 05 07:03:34.930909 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:34.930873    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-6v9xh_5ce163ec-61e7-445e-96a7-8a90054949e8/istio-proxy/1.log"
Sep 05 07:03:35.029994 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:35.029972    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5885f47846-fxgw4_2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4/router/0.log"
Sep 05 07:03:35.915667 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:35.915628    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qhxfc_eb9b64fc-5965-4eb1-95e0-df1dc72f4e2d/serve-healthcheck-canary/0.log"
Sep 05 07:03:36.364198 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:36.364171    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-nm4mr_e0721b53-eb71-4fff-8b34-a59dbe3afeb0/insights-operator/0.log"
Sep 05 07:03:36.367708 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:36.367687    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-nm4mr_e0721b53-eb71-4fff-8b34-a59dbe3afeb0/insights-operator/1.log"
Sep 05 07:03:36.515060 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:36.515017    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xhw98_83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1/kube-rbac-proxy/0.log"
Sep 05 07:03:36.533088 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:36.533062    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xhw98_83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1/exporter/0.log"
Sep 05 07:03:36.552931 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:36.552898    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xhw98_83fdc0e2-36c9-4260-a169-8f8dfbcc0ff1/extractor/0.log"
Sep 05 07:03:38.177312 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:38.177282    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-q9qgh/perf-node-gather-daemonset-xzqtc"
Sep 05 07:03:38.911532 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:38.911500    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-qzlvk_591433e0-9a8b-472a-9d1b-fa09be16c023/server/0.log"
Sep 05 07:03:39.135704 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:39.135679    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-665f9d595b-84wff_63bba13c-e48d-4752-8b3e-4f5a38784df9/manager/0.log"
Sep 05 07:03:39.153831 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:39.153810    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-665f9d595b-84wff_63bba13c-e48d-4752-8b3e-4f5a38784df9/copy-manifests/0.log"
Sep 05 07:03:40.633926 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:40.633896    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-688d76797b-np4pr_1c88d6af-8b4a-416b-9f44-a8e31947965e/manager/0.log"
Sep 05 07:03:41.293020 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:41.292986    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz_71a7ecb0-e5cf-4b09-9511-0afd1c132cbe/istio-proxy/0.log"
Sep 05 07:03:41.589475 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:41.589399    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6ff6468b6c-8k468_ddccbaf7-3774-407d-abe9-694d2db3a112/kube-auth-proxy/0.log"
Sep 05 07:03:41.629925 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:41.629892    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-6v9xh_5ce163ec-61e7-445e-96a7-8a90054949e8/istio-proxy/0.log"
Sep 05 07:03:41.648085 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:41.648063    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-6v9xh_5ce163ec-61e7-445e-96a7-8a90054949e8/istio-proxy/1.log"
Sep 05 07:03:41.719088 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:41.719068    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5885f47846-fxgw4_2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4/router/0.log"
Sep 05 07:03:43.197992 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:43.197955    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz_71a7ecb0-e5cf-4b09-9511-0afd1c132cbe/istio-proxy/0.log"
Sep 05 07:03:43.494976 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:43.494868    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6ff6468b6c-8k468_ddccbaf7-3774-407d-abe9-694d2db3a112/kube-auth-proxy/0.log"
Sep 05 07:03:43.536825 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:43.536796    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-6v9xh_5ce163ec-61e7-445e-96a7-8a90054949e8/istio-proxy/0.log"
Sep 05 07:03:43.555294 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:43.555272    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-6v9xh_5ce163ec-61e7-445e-96a7-8a90054949e8/istio-proxy/1.log"
Sep 05 07:03:43.639172 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:43.639133    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5885f47846-fxgw4_2a44b8ba-bd6c-48fd-890d-bf1e34cc6dd4/router/0.log"
Sep 05 07:03:46.148494 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:46.148460    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-9l7k2_a65ba1aa-6e50-451b-85ba-e38e380ecd68/kube-storage-version-migrator-operator/1.log"
Sep 05 07:03:46.149878 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:46.149850    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-9l7k2_a65ba1aa-6e50-451b-85ba-e38e380ecd68/kube-storage-version-migrator-operator/0.log"
Sep 05 07:03:47.117597 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:47.117570    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d6lsz_78512c00-0c79-4b8a-8f76-7c852a909337/kube-multus-additional-cni-plugins/0.log"
Sep 05 07:03:47.139257 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:47.139229    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d6lsz_78512c00-0c79-4b8a-8f76-7c852a909337/egress-router-binary-copy/0.log"
Sep 05 07:03:47.158326 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:47.158306    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d6lsz_78512c00-0c79-4b8a-8f76-7c852a909337/cni-plugins/0.log"
Sep 05 07:03:47.178003 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:47.177979    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d6lsz_78512c00-0c79-4b8a-8f76-7c852a909337/bond-cni-plugin/0.log"
Sep 05 07:03:47.198256 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:47.198231    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d6lsz_78512c00-0c79-4b8a-8f76-7c852a909337/routeoverride-cni/0.log"
Sep 05 07:03:47.217273 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:47.217252    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d6lsz_78512c00-0c79-4b8a-8f76-7c852a909337/whereabouts-cni-bincopy/0.log"
Sep 05 07:03:47.236372 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:47.236352    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d6lsz_78512c00-0c79-4b8a-8f76-7c852a909337/whereabouts-cni/0.log"
Sep 05 07:03:47.638201 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:47.638173    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vzbwh_c2189095-f1cc-411d-b6ec-7ddc003732f7/kube-multus/0.log"
Sep 05 07:03:47.748472 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:47.748448    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sdsjs_b63a35b8-5230-4b6a-8237-e7afcaf6182e/network-metrics-daemon/0.log"
Sep 05 07:03:47.763613 ip-10-0-141-49 kubenswrapper[2567]: I0905 07:03:47.763589    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sdsjs_b63a35b8-5230-4b6a-8237-e7afcaf6182e/kube-rbac-proxy/0.log"