Jul 28 19:29:45.390351 ip-10-0-131-248 systemd[1]: Starting Kubernetes Kubelet...
Jul 28 19:29:45.756509 ip-10-0-131-248 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 19:29:45.756509 ip-10-0-131-248 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 28 19:29:45.756509 ip-10-0-131-248 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 19:29:45.756509 ip-10-0-131-248 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 28 19:29:45.756509 ip-10-0-131-248 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 19:29:45.758901 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.758815    2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 28 19:29:45.763101 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763082    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 19:29:45.763101 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763098    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 19:29:45.763101 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763102    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 19:29:45.763101 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763107    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 19:29:45.763330 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763112    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 19:29:45.763330 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763116    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 19:29:45.763330 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763120    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 19:29:45.763330 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763124    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 19:29:45.763330 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763128    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 19:29:45.763330 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763132    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 19:29:45.763330 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763136    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 19:29:45.763330 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763140    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 19:29:45.763330 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763144    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 19:29:45.763330 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763148    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 19:29:45.763330 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763151    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 19:29:45.763330 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763155    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 19:29:45.763330 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763161    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 19:29:45.763330 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763164    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 19:29:45.763330 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763168    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 19:29:45.763330 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763172    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 19:29:45.763330 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763176    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 19:29:45.763330 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763180    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 19:29:45.763330 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763186    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 19:29:45.763330 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763191    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 19:29:45.764290 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763195    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 19:29:45.764290 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763200    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 19:29:45.764290 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763204    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 19:29:45.764290 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763208    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 19:29:45.764290 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763212    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 19:29:45.764290 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763216    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 19:29:45.764290 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763220    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 19:29:45.764290 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763224    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 19:29:45.764290 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763229    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 19:29:45.764290 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763233    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 19:29:45.764290 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763237    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 19:29:45.764290 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763241    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 19:29:45.764290 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763245    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 19:29:45.764290 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763250    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 19:29:45.764290 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763254    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 19:29:45.764290 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763259    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 19:29:45.764290 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763263    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 19:29:45.764290 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763268    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 19:29:45.764290 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763272    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 19:29:45.765123 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763276    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 19:29:45.765123 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763280    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 19:29:45.765123 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763284    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 19:29:45.765123 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763288    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 19:29:45.765123 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763293    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 19:29:45.765123 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763297    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 19:29:45.765123 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763301    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 19:29:45.765123 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763306    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 19:29:45.765123 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763310    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 19:29:45.765123 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763317    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 19:29:45.765123 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763322    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 19:29:45.765123 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763327    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 19:29:45.765123 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763331    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 19:29:45.765123 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763337    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 19:29:45.765123 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763342    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 19:29:45.765123 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763348    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 19:29:45.765123 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763352    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 19:29:45.765123 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763356    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 19:29:45.765123 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763360    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 19:29:45.765881 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763364    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 19:29:45.765881 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763368    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 19:29:45.765881 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763372    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 19:29:45.765881 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763376    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 19:29:45.765881 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763381    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 19:29:45.765881 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763385    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 19:29:45.765881 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763393    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 19:29:45.765881 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763400    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 19:29:45.765881 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763405    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 19:29:45.765881 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763412    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 19:29:45.765881 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763417    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 19:29:45.765881 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763421    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 19:29:45.765881 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763426    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 19:29:45.765881 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763430    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 19:29:45.765881 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763436    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 19:29:45.765881 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763441    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 19:29:45.765881 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763445    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 19:29:45.765881 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763449    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 19:29:45.765881 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763453    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 19:29:45.766710 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763458    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 19:29:45.766710 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763462    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 19:29:45.766710 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763466    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 19:29:45.766710 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763470    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 19:29:45.766710 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763474    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 19:29:45.766710 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763478    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 19:29:45.766710 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763483    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 19:29:45.766710 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763488    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 19:29:45.766710 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763492    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 19:29:45.766710 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763496    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 19:29:45.766710 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763500    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 19:29:45.766710 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763504    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 19:29:45.766710 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763508    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 19:29:45.766710 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763512    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 19:29:45.766710 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763517    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 19:29:45.766710 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763522    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 19:29:45.766710 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763526    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 19:29:45.766710 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.763530    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 19:29:45.766710 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764760    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 19:29:45.766710 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764770    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 19:29:45.767566 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764777    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 19:29:45.767566 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764782    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 19:29:45.767566 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764787    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 19:29:45.767566 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764793    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 19:29:45.767566 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764797    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 19:29:45.767566 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764801    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 19:29:45.767566 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764805    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 19:29:45.767566 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764810    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 19:29:45.767566 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764814    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 19:29:45.767566 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764819    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 19:29:45.767566 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764823    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 19:29:45.767566 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764827    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 19:29:45.767566 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764831    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 19:29:45.767566 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764836    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 19:29:45.767566 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764840    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 19:29:45.767566 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764844    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 19:29:45.767566 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764848    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 19:29:45.767566 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764852    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 19:29:45.767566 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764857    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 19:29:45.767566 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764860    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 19:29:45.768310 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764864    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 19:29:45.768310 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764869    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 19:29:45.768310 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764873    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 19:29:45.768310 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764877    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 19:29:45.768310 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764881    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 19:29:45.768310 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764886    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 19:29:45.768310 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764890    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 19:29:45.768310 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764894    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 19:29:45.768310 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764899    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 19:29:45.768310 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764903    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 19:29:45.768310 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764907    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 19:29:45.768310 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764911    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 19:29:45.768310 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764916    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 19:29:45.768310 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764921    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 19:29:45.768310 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764925    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 19:29:45.768310 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764929    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 19:29:45.768310 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764934    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 19:29:45.768310 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764939    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 19:29:45.768310 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764943    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 19:29:45.768825 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764947    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 19:29:45.768825 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764952    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 19:29:45.768825 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764956    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 19:29:45.768825 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764960    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 19:29:45.768825 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764964    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 19:29:45.768825 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764968    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 19:29:45.768825 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764972    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 19:29:45.768825 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764977    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 19:29:45.768825 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764981    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 19:29:45.768825 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764986    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 19:29:45.768825 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764990    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 19:29:45.768825 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764994    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 19:29:45.768825 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.764998    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 19:29:45.768825 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765002    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 19:29:45.768825 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765007    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 19:29:45.768825 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765025    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 19:29:45.768825 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765030    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 19:29:45.768825 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765034    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 19:29:45.768825 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765038    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 19:29:45.769402 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765043    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 19:29:45.769402 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765047    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 19:29:45.769402 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765051    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 19:29:45.769402 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765055    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 19:29:45.769402 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765059    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 19:29:45.769402 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765065    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 19:29:45.769402 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765072    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 19:29:45.769402 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765077    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 19:29:45.769402 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765081    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 19:29:45.769402 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765085    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 19:29:45.769402 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765089    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 19:29:45.769402 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765095    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 19:29:45.769402 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765099    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 19:29:45.769402 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765103    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 19:29:45.769402 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765107    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 19:29:45.769402 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765112    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 19:29:45.769402 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765118    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 19:29:45.769402 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765123    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 19:29:45.769402 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765128    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 19:29:45.769402 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765135    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 19:29:45.770137 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765139    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 19:29:45.770137 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765143    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 19:29:45.770137 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765147    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 19:29:45.770137 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765151    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 19:29:45.770137 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765155    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 19:29:45.770137 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765159    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 19:29:45.770137 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765164    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 19:29:45.770137 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765168    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 19:29:45.770137 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765172    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 19:29:45.770137 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765176    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 19:29:45.770137 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765181    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 19:29:45.770137 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765185    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 19:29:45.770137 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765190    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 19:29:45.770137 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765196    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 19:29:45.770137 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765202    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 19:29:45.770137 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765206    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 19:29:45.770137 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765211    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 19:29:45.770137 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765216    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 19:29:45.770137 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765221    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 19:29:45.770137 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765972    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 19:29:45.770655 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765981    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 19:29:45.770655 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765987    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 19:29:45.770655 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.765994    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 19:29:45.770655 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766001    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 19:29:45.770655 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766006    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 19:29:45.770655 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766031    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 19:29:45.770655 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766036    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 19:29:45.770655 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766040    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 19:29:45.770655 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766044    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 19:29:45.770655 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766049    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 19:29:45.770655 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766052    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 19:29:45.770655 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766057    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 19:29:45.770655 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766062    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 19:29:45.770655 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766066    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 19:29:45.770655 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766070    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 19:29:45.770655 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766075    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 19:29:45.770655 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766079    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 19:29:45.770655 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766083    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 19:29:45.770655 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766088    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 19:29:45.771195 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766092    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 19:29:45.771195 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766096    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 19:29:45.771195 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766100    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 19:29:45.771195 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766104    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 19:29:45.771195 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766108    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 19:29:45.771195 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766113    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 19:29:45.771195 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766117    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 19:29:45.771195 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766122    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 19:29:45.771195 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766126    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 19:29:45.771195 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766131    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 19:29:45.771195 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766135    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 19:29:45.771195 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766140    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 19:29:45.771195 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766144    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 19:29:45.771195 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766148    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 19:29:45.771195 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766152    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 19:29:45.771195 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766157    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 19:29:45.771195 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766161    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 19:29:45.771195 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766166    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 19:29:45.771195 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766170    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 19:29:45.771195 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766174    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 19:29:45.771713 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766178    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 19:29:45.771713 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766185    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 19:29:45.771713 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766189    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 19:29:45.771713 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766193    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 19:29:45.771713 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766197    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 19:29:45.771713 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766201    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 19:29:45.771713 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766206    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 19:29:45.771713 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766210    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 19:29:45.771713 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766216    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 19:29:45.771713 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766222    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 19:29:45.771713 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766227    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 19:29:45.771713 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766231    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 19:29:45.771713 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766236    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 19:29:45.771713 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766241    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 19:29:45.771713 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766246    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 19:29:45.771713 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766250    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 19:29:45.771713 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766255    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 19:29:45.771713 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766260    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 19:29:45.771713 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766264    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 19:29:45.771713 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766268    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 19:29:45.772265 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766274    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 19:29:45.772265 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766279    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 19:29:45.772265 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766283    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 19:29:45.772265 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766288    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 19:29:45.772265 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766295    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 19:29:45.772265 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766300    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 19:29:45.772265 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766305    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 19:29:45.772265 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766309    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 19:29:45.772265 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766314    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 19:29:45.772265 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766318    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 19:29:45.772265 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766323    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 19:29:45.772265 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766329    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 19:29:45.772265 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766333    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 19:29:45.772265 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766338    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 19:29:45.772265 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766342    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 19:29:45.772265 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766346    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 19:29:45.772265 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766350    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 19:29:45.772265 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766354    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 19:29:45.772265 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766359    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 19:29:45.772265 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766363    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 19:29:45.772745 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766367    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 19:29:45.772745 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766371    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 19:29:45.772745 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766376    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 19:29:45.772745 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766380    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 19:29:45.772745 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766387    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 19:29:45.772745 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766391    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 19:29:45.772745 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766395    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 19:29:45.772745 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766400    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 19:29:45.772745 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766405    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 19:29:45.772745 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766409    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 19:29:45.772745 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766413    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 19:29:45.772745 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766417    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 19:29:45.772745 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766421    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 19:29:45.772745 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766429    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 19:29:45.772745 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766433    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 19:29:45.772745 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766437    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 19:29:45.772745 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766441    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 19:29:45.772745 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766446    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 19:29:45.772745 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.766450    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 19:29:45.773256 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766548    2570 flags.go:64] FLAG: --address="0.0.0.0"
Jul 28 19:29:45.773256 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766560    2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 28 19:29:45.773256 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766569    2570 flags.go:64] FLAG: --anonymous-auth="true"
Jul 28 19:29:45.773256 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766576    2570 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 28 19:29:45.773256 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766584    2570 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 28 19:29:45.773256 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766589    2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 28 19:29:45.773256 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766596    2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 28 19:29:45.773256 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766603    2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 28 19:29:45.773256 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766607    2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 28 19:29:45.773256 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766612    2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 28 19:29:45.773256 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766618    2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 28 19:29:45.773256 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766623    2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 28 19:29:45.773256 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766628    2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 28 19:29:45.773256 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766633    2570 flags.go:64] FLAG: --cgroup-root=""
Jul 28 19:29:45.773256 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766638    2570 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 28 19:29:45.773256 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766644    2570 flags.go:64] FLAG: --client-ca-file=""
Jul 28 19:29:45.773256 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766649    2570 flags.go:64] FLAG: --cloud-provider="external"
Jul 28 19:29:45.773256 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766658    2570 flags.go:64] FLAG: --cluster-dns="[]"
Jul 28 19:29:45.773256 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766665    2570 flags.go:64] FLAG: --cluster-domain=""
Jul 28 19:29:45.773256 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766670    2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 28 19:29:45.773256 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766675    2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 28 19:29:45.773256 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766681    2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 28 19:29:45.773256 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766687    2570 flags.go:64] FLAG: --container-log-max-files="5"
Jul 28 19:29:45.773256 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766693    2570 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 28 19:29:45.773851 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766697    2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 28 19:29:45.773851 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766702    2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 28 19:29:45.773851 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766709    2570 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 28 19:29:45.773851 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766714    2570 flags.go:64] FLAG: --contention-profiling="false"
Jul 28 19:29:45.773851 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766718    2570 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 28 19:29:45.773851 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766722    2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 28 19:29:45.773851 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766727    2570 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 28 19:29:45.773851 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766732    2570 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 28 19:29:45.773851 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766738    2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 28 19:29:45.773851 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766743    2570 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 28 19:29:45.773851 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766748    2570 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 28 19:29:45.773851 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766753    2570 flags.go:64] FLAG: --enable-load-reader="false"
Jul 28 19:29:45.773851 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766758    2570 flags.go:64] FLAG: --enable-server="true"
Jul 28 19:29:45.773851 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766763    2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 28 19:29:45.773851 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766770    2570 flags.go:64] FLAG: --event-burst="100"
Jul 28 19:29:45.773851 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766775    2570 flags.go:64] FLAG: --event-qps="50"
Jul 28 19:29:45.773851 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766779    2570 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 28 19:29:45.773851 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766784    2570 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 28 19:29:45.773851 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766789    2570 flags.go:64] FLAG: --eviction-hard=""
Jul 28 19:29:45.773851 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766796    2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 28 19:29:45.773851 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766801    2570 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 28 19:29:45.773851 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766806    2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 28 19:29:45.773851 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766811    2570 flags.go:64] FLAG: --eviction-soft=""
Jul 28 19:29:45.773851 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766816    2570 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 28 19:29:45.773851 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766821    2570 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 28 19:29:45.774791 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766827    2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 28 19:29:45.774791 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766832    2570 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 28 19:29:45.774791 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766837    2570 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 28 19:29:45.774791 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766842    2570 flags.go:64] FLAG: --fail-swap-on="true"
Jul 28 19:29:45.774791 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766847    2570 flags.go:64] FLAG: --feature-gates=""
Jul 28 19:29:45.774791 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766860    2570 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 28 19:29:45.774791 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766864    2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 28 19:29:45.774791 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766870    2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 28 19:29:45.774791 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766875    2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 28 19:29:45.774791 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766881    2570 flags.go:64] FLAG: --healthz-port="10248"
Jul 28 19:29:45.774791 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766886    2570 flags.go:64] FLAG: --help="false"
Jul 28 19:29:45.774791 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766891    2570 flags.go:64] FLAG: --hostname-override="ip-10-0-131-248.ec2.internal"
Jul 28 19:29:45.774791 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766896    2570 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 28 19:29:45.774791 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766901    2570 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 28 19:29:45.774791 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766906    2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 28 19:29:45.774791 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766912    2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 28 19:29:45.774791 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766917    2570 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 28 19:29:45.774791 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766922    2570 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 28 19:29:45.774791 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766926    2570 flags.go:64] FLAG: --image-service-endpoint=""
Jul 28 19:29:45.774791 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766931    2570 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 28 19:29:45.774791 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766936    2570 flags.go:64] FLAG: --kube-api-burst="100"
Jul 28 19:29:45.774791 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766941    2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 28 19:29:45.774791 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766947    2570 flags.go:64] FLAG: --kube-api-qps="50"
Jul 28 19:29:45.774791 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766952    2570 flags.go:64] FLAG: --kube-reserved=""
Jul 28 19:29:45.775807 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766957    2570 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 28 19:29:45.775807 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766962    2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 28 19:29:45.775807 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766967    2570 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 28 19:29:45.775807 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766972    2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 28 19:29:45.775807 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766977    2570 flags.go:64] FLAG: --lock-file=""
Jul 28 19:29:45.775807 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766982    2570 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 28 19:29:45.775807 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766986    2570 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 28 19:29:45.775807 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.766991    2570 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 28 19:29:45.775807 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767002    2570 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 28 19:29:45.775807 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767006    2570 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 28 19:29:45.775807 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767026    2570 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 28 19:29:45.775807 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767031    2570 flags.go:64] FLAG: --logging-format="text"
Jul 28 19:29:45.775807 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767036    2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 28 19:29:45.775807 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767041    2570 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 28 19:29:45.775807 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767046    2570 flags.go:64] FLAG: --manifest-url=""
Jul 28 19:29:45.775807 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767051    2570 flags.go:64] FLAG: --manifest-url-header=""
Jul 28 19:29:45.775807 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767058    2570 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 28 19:29:45.775807 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767066    2570 flags.go:64] FLAG: --max-open-files="1000000"
Jul 28 19:29:45.775807 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767073    2570 flags.go:64] FLAG: --max-pods="110"
Jul 28 19:29:45.775807 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767078    2570 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 28 19:29:45.775807 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767083    2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 28 19:29:45.775807 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767087    2570 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 28 19:29:45.775807 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767092    2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 28 19:29:45.775807 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767097    2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 28 19:29:45.775807 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767102    2570 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 28 19:29:45.776879 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767107    2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 28 19:29:45.776879 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767119    2570 flags.go:64] FLAG: --node-status-max-images="50"
Jul 28 19:29:45.776879 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767123    2570 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 28 19:29:45.776879 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767128    2570 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 28 19:29:45.776879 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767133    2570 flags.go:64] FLAG: --pod-cidr=""
Jul 28 19:29:45.776879 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767140    2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 28 19:29:45.776879 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767149    2570 flags.go:64] FLAG: --pod-manifest-path=""
Jul 28 19:29:45.776879 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767154    2570 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 28 19:29:45.776879 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767158    2570 flags.go:64] FLAG: --pods-per-core="0"
Jul 28 19:29:45.776879 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767163    2570 flags.go:64] FLAG: --port="10250"
Jul 28 19:29:45.776879 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767168    2570 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 28 19:29:45.776879 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767173    2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c52dcc9d969639de"
Jul 28 19:29:45.776879 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767178    2570 flags.go:64] FLAG: --qos-reserved=""
Jul 28 19:29:45.776879 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767183    2570 flags.go:64] FLAG: --read-only-port="10255"
Jul 28 19:29:45.776879 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767188    2570 flags.go:64] FLAG: --register-node="true"
Jul 28 19:29:45.776879 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767194    2570 flags.go:64] FLAG: --register-with-taints=""
Jul 28 19:29:45.776879 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767201    2570 flags.go:64] FLAG: --registry-burst="10"
Jul 28 19:29:45.776879 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767205    2570 flags.go:64] FLAG: --registry-qps="5"
Jul 28 19:29:45.776879 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767210    2570 flags.go:64] FLAG: --reserved-cpus=""
Jul 28 19:29:45.776879 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767215    2570 flags.go:64] FLAG: --reserved-memory=""
Jul 28 19:29:45.776879 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767221    2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 28 19:29:45.776879 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767226    2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 28 19:29:45.776879 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767231    2570 flags.go:64] FLAG: --rotate-certificates="false"
Jul 28 19:29:45.776879 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767236    2570 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 28 19:29:45.776879 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767240    2570 flags.go:64] FLAG: --runonce="false"
Jul 28 19:29:45.778039 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767246    2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 28 19:29:45.778039 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767251    2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 28 19:29:45.778039 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767257    2570 flags.go:64] FLAG: --seccomp-default="false"
Jul 28 19:29:45.778039 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767261    2570 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 28 19:29:45.778039 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767266    2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 28 19:29:45.778039 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767271    2570 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 28 19:29:45.778039 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767276    2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 28 19:29:45.778039 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767281    2570 flags.go:64] FLAG: --storage-driver-password="root"
Jul 28 19:29:45.778039 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767286    2570 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 28 19:29:45.778039 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767291    2570 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 28 19:29:45.778039 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767295    2570 flags.go:64] FLAG: --storage-driver-user="root"
Jul 28 19:29:45.778039 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767300    2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 28 19:29:45.778039 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767306    2570 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 28 19:29:45.778039 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767311    2570 flags.go:64] FLAG: --system-cgroups=""
Jul 28 19:29:45.778039 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767316    2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 28 19:29:45.778039 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767324    2570 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 28 19:29:45.778039 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767329    2570 flags.go:64] FLAG: --tls-cert-file=""
Jul 28 19:29:45.778039 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767334    2570 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 28 19:29:45.778039 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767341    2570 flags.go:64] FLAG: --tls-min-version=""
Jul 28 19:29:45.778039 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767346    2570 flags.go:64] FLAG: --tls-private-key-file=""
Jul 28 19:29:45.778039 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767351    2570 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 28 19:29:45.778039 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767355    2570 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 28 19:29:45.778039 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767362    2570 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 28 19:29:45.778039 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767367    2570 flags.go:64] FLAG: --v="2"
Jul 28 19:29:45.778039 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767373    2570 flags.go:64] FLAG: --version="false"
Jul 28 19:29:45.778791 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767380    2570 flags.go:64] FLAG: --vmodule=""
Jul 28 19:29:45.778791 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767386    2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 28 19:29:45.778791 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.767392    2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 28 19:29:45.778791 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767586    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 19:29:45.778791 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767592    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 19:29:45.778791 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767598    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 19:29:45.778791 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767603    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 19:29:45.778791 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767609    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 19:29:45.778791 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767613    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 19:29:45.778791 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767618    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 19:29:45.778791 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767622    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 19:29:45.778791 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767626    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 19:29:45.778791 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767630    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 19:29:45.778791 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767634    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 19:29:45.778791 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767639    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 19:29:45.778791 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767644    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 19:29:45.778791 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767648    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 19:29:45.778791 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767653    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 19:29:45.778791 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767657    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 19:29:45.778791 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767661    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 19:29:45.779673 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767665    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 19:29:45.779673 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767670    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 19:29:45.779673 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767674    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 19:29:45.779673 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767679    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 19:29:45.779673 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767683    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 19:29:45.779673 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767687    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 19:29:45.779673 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767691    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 19:29:45.779673 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767695    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 19:29:45.779673 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767699    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 19:29:45.779673 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767705    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 19:29:45.779673 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767710    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 19:29:45.779673 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767715    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 19:29:45.779673 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767719    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 19:29:45.779673 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767723    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 19:29:45.779673 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767727    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 19:29:45.779673 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767732    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 19:29:45.779673 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767737    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 19:29:45.779673 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767741    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 19:29:45.779673 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767745    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 19:29:45.780298 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767751    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 19:29:45.780298 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767755    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 19:29:45.780298 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767759    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 19:29:45.780298 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767763    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 19:29:45.780298 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767767    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 19:29:45.780298 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767772    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 19:29:45.780298 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767776    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 19:29:45.780298 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767780    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 19:29:45.780298 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767784    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 19:29:45.780298 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767788    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 19:29:45.780298 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767793    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 19:29:45.780298 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767797    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 19:29:45.780298 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767801    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 19:29:45.780298 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767805    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 19:29:45.780298 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767809    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 19:29:45.780298 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767814    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 19:29:45.780298 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767818    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 19:29:45.780298 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767823    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 19:29:45.780298 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767827    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 19:29:45.780298 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767831    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 19:29:45.780928 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767836    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 19:29:45.780928 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767840    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 19:29:45.780928 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767845    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 19:29:45.780928 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767849    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 19:29:45.780928 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767853    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 19:29:45.780928 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767858    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 19:29:45.780928 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767862    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 19:29:45.780928 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767868    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 19:29:45.780928 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767874    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 19:29:45.780928 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767878    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 19:29:45.780928 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767885    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 19:29:45.780928 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767890    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 19:29:45.780928 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767897    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 19:29:45.780928 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767901    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 19:29:45.780928 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767905    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 19:29:45.780928 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767910    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 19:29:45.780928 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767915    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 19:29:45.780928 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767919    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 19:29:45.780928 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767923    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 19:29:45.781501 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767927    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 19:29:45.781501 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767931    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 19:29:45.781501 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767935    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 19:29:45.781501 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767940    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 19:29:45.781501 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767944    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 19:29:45.781501 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767949    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 19:29:45.781501 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767953    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 19:29:45.781501 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767957    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 19:29:45.781501 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767961    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 19:29:45.781501 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767966    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 19:29:45.781501 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767970    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 19:29:45.781501 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767974    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 19:29:45.781501 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767979    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 19:29:45.781501 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767983    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 19:29:45.781501 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767987    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 19:29:45.781501 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767993    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 19:29:45.781501 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.767997    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 19:29:45.781501 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.768001    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 19:29:45.781501 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.768004    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 19:29:45.781501 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.768024    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 19:29:45.782055 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.768029    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 19:29:45.782055 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.768033    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 19:29:45.782055 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.768037    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 19:29:45.782055 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.768041    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 19:29:45.782055 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.768686    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 19:29:45.782055 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.776447    2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 28 19:29:45.782055 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.776465    2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 28 19:29:45.782055 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.776497    2570 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 28 19:29:45.782055 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.776507    2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 28 19:29:45.782055 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776590    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 19:29:45.782055 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776598    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 19:29:45.782055 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776603    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 19:29:45.782055 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776608    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 19:29:45.782055 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776613    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 19:29:45.782055 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776617    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 19:29:45.782430 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776622    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 19:29:45.782430 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776627    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 19:29:45.782430 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776632    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 19:29:45.782430 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776637    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 19:29:45.782430 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776642    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 19:29:45.782430 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776646    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 19:29:45.782430 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776651    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 19:29:45.782430 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776656    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 19:29:45.782430 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776660    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 19:29:45.782430 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776665    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 19:29:45.782430 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776672    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 19:29:45.782430 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776678    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 19:29:45.782430 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776683    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 19:29:45.782430 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776688    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 19:29:45.782430 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776693    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 19:29:45.782430 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776697    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 19:29:45.782430 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776702    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 19:29:45.782430 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776706    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 19:29:45.782430 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776710    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 19:29:45.782948 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776714    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 19:29:45.782948 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776718    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 19:29:45.782948 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776723    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 19:29:45.782948 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776728    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 19:29:45.782948 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776733    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 19:29:45.782948 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776737    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 19:29:45.782948 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776741    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 19:29:45.782948 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776746    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 19:29:45.782948 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776750    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 19:29:45.782948 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776754    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 19:29:45.782948 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776758    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 19:29:45.782948 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776763    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 19:29:45.782948 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776767    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 19:29:45.782948 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776771    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 19:29:45.782948 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776776    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 19:29:45.782948 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776780    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 19:29:45.782948 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776784    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 19:29:45.782948 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776788    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 19:29:45.782948 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776792    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 19:29:45.783423 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776797    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 19:29:45.783423 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776801    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 19:29:45.783423 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776806    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 19:29:45.783423 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776811    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 19:29:45.783423 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776815    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 19:29:45.783423 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776819    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 19:29:45.783423 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776823    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 19:29:45.783423 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776827    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 19:29:45.783423 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776831    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 19:29:45.783423 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776835    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 19:29:45.783423 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776839    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 19:29:45.783423 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776844    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 19:29:45.783423 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776848    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 19:29:45.783423 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776852    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 19:29:45.783423 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776857    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 19:29:45.783423 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776861    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 19:29:45.783423 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776865    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 19:29:45.783423 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776869    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 19:29:45.783423 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776877    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 19:29:45.783906 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776882    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 19:29:45.783906 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776886    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 19:29:45.783906 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776890    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 19:29:45.783906 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776895    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 19:29:45.783906 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776899    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 19:29:45.783906 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776903    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 19:29:45.783906 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776907    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 19:29:45.783906 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776911    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 19:29:45.783906 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776915    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 19:29:45.783906 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776920    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 19:29:45.783906 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776925    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 19:29:45.783906 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776929    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 19:29:45.783906 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776933    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 19:29:45.783906 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776938    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 19:29:45.783906 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776942    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 19:29:45.783906 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776947    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 19:29:45.783906 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776951    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 19:29:45.783906 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776955    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 19:29:45.783906 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776961    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 19:29:45.783906 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776968    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 19:29:45.784582 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776972    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 19:29:45.784582 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776977    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 19:29:45.784582 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776981    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 19:29:45.784582 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776985    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 19:29:45.784582 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776990    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 19:29:45.784582 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776994    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 19:29:45.784582 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.776999    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 19:29:45.784582 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777002    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 19:29:45.784582 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777007    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 19:29:45.784582 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777035    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 19:29:45.784582 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777039    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 19:29:45.784582 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777043    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 19:29:45.784582 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777048    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 19:29:45.784582 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777052    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 19:29:45.784582 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777056    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 19:29:45.784582 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777060    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 19:29:45.784990 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.777067    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 19:29:45.784990 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777275    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 19:29:45.784990 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777284    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 19:29:45.784990 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777289    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 19:29:45.784990 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777293    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 19:29:45.784990 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777298    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 19:29:45.784990 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777302    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 19:29:45.784990 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777307    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 19:29:45.784990 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777311    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 19:29:45.784990 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777316    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 19:29:45.784990 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777320    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 19:29:45.784990 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777325    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 19:29:45.784990 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777329    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 19:29:45.784990 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777334    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 19:29:45.784990 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777338    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 19:29:45.785577 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777342    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 19:29:45.785577 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777347    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 19:29:45.785577 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777351    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 19:29:45.785577 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777355    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 19:29:45.785577 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777359    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 19:29:45.785577 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777364    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 19:29:45.785577 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777368    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 19:29:45.785577 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777372    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 19:29:45.785577 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777376    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 19:29:45.785577 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777381    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 19:29:45.785577 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777386    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 19:29:45.785577 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777393    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 19:29:45.785577 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777400    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 19:29:45.785577 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777405    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 19:29:45.785577 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777411    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 19:29:45.785577 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777416    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 19:29:45.785577 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777420    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 19:29:45.785577 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777425    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 19:29:45.785577 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777429    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 19:29:45.786352 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777433    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 19:29:45.786352 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777437    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 19:29:45.786352 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777441    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 19:29:45.786352 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777448    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 19:29:45.786352 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777453    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 19:29:45.786352 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777459    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 19:29:45.786352 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777464    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 19:29:45.786352 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777469    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 19:29:45.786352 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777474    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 19:29:45.786352 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777478    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 19:29:45.786352 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777483    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 19:29:45.786352 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777487    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 19:29:45.786352 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777491    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 19:29:45.786352 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777496    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 19:29:45.786352 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777500    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 19:29:45.786352 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777504    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 19:29:45.786352 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777508    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 19:29:45.786352 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777512    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 19:29:45.786352 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777516    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 19:29:45.786969 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777521    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 19:29:45.786969 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777525    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 19:29:45.786969 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777529    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 19:29:45.786969 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777533    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 19:29:45.786969 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777537    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 19:29:45.786969 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777542    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 19:29:45.786969 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777546    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 19:29:45.786969 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777550    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 19:29:45.786969 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777555    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 19:29:45.786969 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777559    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 19:29:45.786969 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777564    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 19:29:45.786969 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777568    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 19:29:45.786969 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777573    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 19:29:45.786969 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777577    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 19:29:45.786969 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777581    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 19:29:45.786969 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777585    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 19:29:45.786969 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777589    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 19:29:45.786969 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777595    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 19:29:45.786969 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777601    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 19:29:45.786969 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777605    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 19:29:45.787521 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777610    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 19:29:45.787521 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777615    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 19:29:45.787521 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777619    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 19:29:45.787521 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777623    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 19:29:45.787521 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777627    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 19:29:45.787521 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777631    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 19:29:45.787521 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777635    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 19:29:45.787521 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777639    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 19:29:45.787521 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777643    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 19:29:45.787521 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777648    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 19:29:45.787521 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777652    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 19:29:45.787521 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777657    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 19:29:45.787521 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777662    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 19:29:45.787521 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777666    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 19:29:45.787521 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777670    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 19:29:45.787521 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777675    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 19:29:45.787521 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777679    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 19:29:45.787521 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777683    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 19:29:45.787521 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777687    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 19:29:45.787521 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777692    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 19:29:45.788002 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777697    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 19:29:45.788002 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777701    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 19:29:45.788002 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777706    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 19:29:45.788002 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777710    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 19:29:45.788002 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777714    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 19:29:45.788002 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777718    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 19:29:45.788002 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:45.777722    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 19:29:45.788002 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.777729    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 19:29:45.788002 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.777888    2570 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 28 19:29:45.788002 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.780542    2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 28 19:29:45.788002 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.781844    2570 server.go:1019] "Starting client certificate rotation"
Jul 28 19:29:45.788002 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.781949    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 19:29:45.788002 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.781992    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 19:29:45.788436 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.784807    2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 19:29:45.788436 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.788046    2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 19:29:45.800601 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.800582    2570 log.go:25] "Validated CRI v1 runtime API"
Jul 28 19:29:45.802647 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.802630    2570 log.go:25] "Validated CRI v1 image API"
Jul 28 19:29:45.803506 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.803490    2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 28 19:29:45.805864 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.805839    2570 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 94aae707-2ad9-4d12-8b39-7fb9df86958f:/dev/nvme0n1p4 99607f12-e368-469c-8c0d-45838d3556c1:/dev/nvme0n1p3]
Jul 28 19:29:45.805926 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.805864    2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 28 19:29:45.810811 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.810691    2570 manager.go:216] Machine: {Timestamp:2026-07-28 19:29:45.809484556 +0000 UTC m=+0.312478677 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099121 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28ba84b9d4ab9ca87464117d055819 SystemUUID:ec28ba84-b9d4-ab9c-a874-64117d055819 BootID:59de615f-e68c-48f1-8459-90c4c5a8cfa1 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d1:61:b5:3a:f1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d1:61:b5:3a:f1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e6:f1:e1:ab:fa:ed Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 28 19:29:45.810811 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.810802    2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 28 19:29:45.810937 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.810917    2570 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 28 19:29:45.812390 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.812372    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 19:29:45.814159 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.814133    2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 28 19:29:45.814297 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.814161    2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-248.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 28 19:29:45.814881 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.814871    2570 topology_manager.go:138] "Creating topology manager with none policy"
Jul 28 19:29:45.814911 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.814883    2570 container_manager_linux.go:309] "Creating device plugin manager"
Jul 28 19:29:45.814911 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.814891    2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 19:29:45.815433 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.815422    2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 19:29:45.816178 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.816168    2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 28 19:29:45.817922 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.817910    2570 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 19:29:45.818062 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.818053    2570 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 28 19:29:45.818098 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.818083    2570 kubelet.go:486] "Attempting to sync node with API server"
Jul 28 19:29:45.818098 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.818093    2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 28 19:29:45.818169 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.818107    2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 28 19:29:45.818169 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.818117    2570 kubelet.go:398] "Adding apiserver pod source"
Jul 28 19:29:45.818169 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.818126    2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 28 19:29:45.818472 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.818460    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 19:29:45.818528 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.818477    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 19:29:45.821073 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.821044    2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 28 19:29:45.822843 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.822827    2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 28 19:29:45.822905 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.822858    2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 28 19:29:45.825903 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.825733    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 28 19:29:45.826000 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.825989    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 28 19:29:45.826086 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.826004    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 28 19:29:45.826086 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.826029    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 28 19:29:45.826086 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.826045    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 28 19:29:45.826086 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.826056    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 28 19:29:45.826086 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.826068    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 28 19:29:45.826086 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.826077    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 28 19:29:45.826086 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.826089    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 28 19:29:45.826322 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.826107    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 28 19:29:45.826322 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.826120    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 28 19:29:45.826322 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.826129    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 28 19:29:45.827560 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:45.827529    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-248.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 28 19:29:45.827748 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:45.827718    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 28 19:29:45.828063 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.828050    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 28 19:29:45.828121 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.828085    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 28 19:29:45.830296 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.830278    2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-248.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 28 19:29:45.831514 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.831501    2570 server.go:1268] "Started kubelet"
Jul 28 19:29:45.831629 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.831601    2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 28 19:29:45.831695 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.831651    2570 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 28 19:29:45.831752 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.831644    2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 28 19:29:45.832414 ip-10-0-131-248 systemd[1]: Started Kubernetes Kubelet.
Jul 28 19:29:45.833482 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.833388    2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 28 19:29:45.833538 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.833515    2570 server.go:310] "Adding debug handlers to kubelet server"
Jul 28 19:29:45.834353 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.834336    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lvhpm"
Jul 28 19:29:45.836471 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:45.836446    2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 28 19:29:45.839117 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.839099    2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 28 19:29:45.839117 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.839114    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 28 19:29:45.839260 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:45.839220    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-248.ec2.internal\" not found"
Jul 28 19:29:45.839666 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.839625    2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 28 19:29:45.839744 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.839685    2570 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 28 19:29:45.839744 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.839700    2570 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 28 19:29:45.839830 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.839785    2570 reconstruct.go:97] "Volume reconstruction finished"
Jul 28 19:29:45.839830 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.839795    2570 reconciler.go:29] "Reconciler: start to sync state"
Jul 28 19:29:45.839911 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.839899    2570 factory.go:55] Registering systemd factory
Jul 28 19:29:45.839911 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.839911    2570 factory.go:223] Registration of the systemd container factory successfully
Jul 28 19:29:45.840160 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.840147    2570 factory.go:153] Registering CRI-O factory
Jul 28 19:29:45.840160 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.840162    2570 factory.go:223] Registration of the crio container factory successfully
Jul 28 19:29:45.840285 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.840206    2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 28 19:29:45.840285 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.840226    2570 factory.go:103] Registering Raw factory
Jul 28 19:29:45.840285 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.840244    2570 manager.go:1196] Started watching for new ooms in manager
Jul 28 19:29:45.840745 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.840730    2570 manager.go:349] Starting recovery of all containers
Jul 28 19:29:45.845349 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:45.845321    2570 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-248.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 28 19:29:45.845449 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.845375    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lvhpm"
Jul 28 19:29:45.845512 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:45.845451    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 28 19:29:45.845914 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:45.845055    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-248.ec2.internal.18c68add67b78775  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-248.ec2.internal,UID:ip-10-0-131-248.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-248.ec2.internal,},FirstTimestamp:2026-07-28 19:29:45.831466869 +0000 UTC m=+0.334460982,LastTimestamp:2026-07-28 19:29:45.831466869 +0000 UTC m=+0.334460982,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-248.ec2.internal,}"
Jul 28 19:29:45.851110 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.851097    2570 manager.go:354] Recovery completed
Jul 28 19:29:45.852681 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:45.852660    2570 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 28 19:29:45.857190 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.857173    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 19:29:45.859786 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.859768    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-248.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 19:29:45.859864 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.859799    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-248.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 19:29:45.859864 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.859809    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-248.ec2.internal" event="NodeHasSufficientPID"
Jul 28 19:29:45.860447 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.860431    2570 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 28 19:29:45.860447 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.860442    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 19:29:45.860447 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.860446    2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 28 19:29:45.860608 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.860465    2570 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 19:29:45.861271 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.861252    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-248.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 19:29:45.861331 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.861291    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-248.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 19:29:45.861331 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.861308    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-248.ec2.internal" event="NodeHasSufficientPID"
Jul 28 19:29:45.862175 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.862164    2570 policy_none.go:49] "None policy: Start"
Jul 28 19:29:45.862226 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.862181    2570 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 28 19:29:45.862226 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.862192    2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 28 19:29:45.862226 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:45.862136    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-248.ec2.internal.18c68add6967a1fc  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-248.ec2.internal,UID:ip-10-0-131-248.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-248.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-248.ec2.internal,},FirstTimestamp:2026-07-28 19:29:45.859785212 +0000 UTC m=+0.362779323,LastTimestamp:2026-07-28 19:29:45.859785212 +0000 UTC m=+0.362779323,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-248.ec2.internal,}"
Jul 28 19:29:45.863095 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.863081    2570 policy_none.go:47] "Start"
Jul 28 19:29:45.899571 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.899552    2570 manager.go:337] "Starting Device Plugin manager"
Jul 28 19:29:45.899672 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:45.899589    2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 28 19:29:45.899672 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.899603    2570 server.go:87] "Starting device plugin registration server"
Jul 28 19:29:45.899887 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.899871    2570 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 28 19:29:45.899977 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.899887    2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 28 19:29:45.900053 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.899984    2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 28 19:29:45.900122 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.900109    2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 28 19:29:45.900173 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:45.900126    2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 28 19:29:45.900873 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:45.900853    2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 28 19:29:45.900942 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:45.900898    2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-248.ec2.internal\" not found"
Jul 28 19:29:46.000346 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:46.000301    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 19:29:46.001393 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:46.001281    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-248.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 19:29:46.001393 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:46.001314    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-248.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 19:29:46.001393 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:46.001329    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-248.ec2.internal" event="NodeHasSufficientPID"
Jul 28 19:29:46.001393 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:46.001356    2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-248.ec2.internal"
Jul 28 19:29:46.006689 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:46.006651    2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-248.ec2.internal"
Jul 28 19:29:46.006689 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:46.006674    2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-248.ec2.internal\": node \"ip-10-0-131-248.ec2.internal\" not found"
Jul 28 19:29:46.014133 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:46.014099    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 28 19:29:46.015353 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:46.015335    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 28 19:29:46.015469 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:46.015378    2570 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 28 19:29:46.015469 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:46.015401    2570 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 28 19:29:46.015469 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:46.015441    2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 28 19:29:46.017210 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:46.017189    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 19:29:46.023224 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:46.023208    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-248.ec2.internal\" not found"
Jul 28 19:29:46.116445 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:46.116360    2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-248.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-248.ec2.internal"]
Jul 28 19:29:46.116606 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:46.116490    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 19:29:46.117990 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:46.117976    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-248.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 19:29:46.118101 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:46.118003    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-248.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 19:29:46.118101 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:46.118032    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-248.ec2.internal" event="NodeHasSufficientPID"
Jul 28 19:29:46.119296 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:46.119284    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 19:29:46.119410 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:46.119397    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-248.ec2.internal"
Jul 28 19:29:46.119448 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:46.119426    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 19:29:46.120043 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:46.120023    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-248.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 19:29:46.120135 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:46.120056    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-248.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 19:29:46.120135 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:46.120066    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-248.ec2.internal" event="NodeHasSufficientPID"
Jul 28 19:29:46.120135 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:46.120026    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-248.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 19:29:46.120135 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:46.120126    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-248.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 19:29:46.120303 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:46.120139    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-248.ec2.internal" event="NodeHasSufficientPID"
Jul 28 19:29:46.121180 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:46.121165    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-248.ec2.internal"
Jul 28 19:29:46.121241 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:46.121190    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 19:29:46.121857 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:46.121844    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-248.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 19:29:46.121913 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:46.121869    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-248.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 19:29:46.121913 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:46.121879    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-248.ec2.internal" event="NodeHasSufficientPID"
Jul 28 19:29:46.123266 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:46.123247    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-248.ec2.internal\" not found"
Jul 28 19:29:46.146794 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:46.146768    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-248.ec2.internal\" not found" node="ip-10-0-131-248.ec2.internal"
Jul 28 19:29:46.151150 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:46.151133    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-248.ec2.internal\" not found" node="ip-10-0-131-248.ec2.internal"
Jul 28 19:29:46.224315 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:46.224136    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-248.ec2.internal\" not found"
Jul 28 19:29:47.792446 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:47.792417    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/173852bb74b234290637b3e3c7d98ebe-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-248.ec2.internal\" (UID: \"173852bb74b234290637b3e3c7d98ebe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-248.ec2.internal"
Jul 28 19:29:47.792544 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:47.792454    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/173852bb74b234290637b3e3c7d98ebe-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-248.ec2.internal\" (UID: \"173852bb74b234290637b3e3c7d98ebe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-248.ec2.internal"
Jul 28 19:29:47.792544 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:47.792474    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/66c7900c897da2db768e7d8f675c61eb-config\") pod \"kube-apiserver-proxy-ip-10-0-131-248.ec2.internal\" (UID: \"66c7900c897da2db768e7d8f675c61eb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-248.ec2.internal"
Jul 28 19:29:47.875840 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:47.875760    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-248.ec2.internal\" not found"
Jul 28 19:29:47.893141 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:47.893115    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/173852bb74b234290637b3e3c7d98ebe-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-248.ec2.internal\" (UID: \"173852bb74b234290637b3e3c7d98ebe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-248.ec2.internal"
Jul 28 19:29:47.893240 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:47.893153    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/173852bb74b234290637b3e3c7d98ebe-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-248.ec2.internal\" (UID: \"173852bb74b234290637b3e3c7d98ebe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-248.ec2.internal"
Jul 28 19:29:47.893240 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:47.893179    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/66c7900c897da2db768e7d8f675c61eb-config\") pod \"kube-apiserver-proxy-ip-10-0-131-248.ec2.internal\" (UID: \"66c7900c897da2db768e7d8f675c61eb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-248.ec2.internal"
Jul 28 19:29:47.893240 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:47.893223    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/173852bb74b234290637b3e3c7d98ebe-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-248.ec2.internal\" (UID: \"173852bb74b234290637b3e3c7d98ebe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-248.ec2.internal"
Jul 28 19:29:47.893339 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:47.893224    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/66c7900c897da2db768e7d8f675c61eb-config\") pod \"kube-apiserver-proxy-ip-10-0-131-248.ec2.internal\" (UID: \"66c7900c897da2db768e7d8f675c61eb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-248.ec2.internal"
Jul 28 19:29:47.893339 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:47.893224    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/173852bb74b234290637b3e3c7d98ebe-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-248.ec2.internal\" (UID: \"173852bb74b234290637b3e3c7d98ebe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-248.ec2.internal"
Jul 28 19:29:47.976314 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:47.976270    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-248.ec2.internal\" not found"
Jul 28 19:29:48.000842 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:48.000816    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-248.ec2.internal"
Jul 28 19:29:48.005637 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:48.005619    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-248.ec2.internal"
Jul 28 19:29:48.077075 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:48.077037    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-248.ec2.internal\" not found"
Jul 28 19:29:48.177595 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:48.177552    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-248.ec2.internal\" not found"
Jul 28 19:29:48.278061 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:48.278027    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-248.ec2.internal\" not found"
Jul 28 19:29:48.332638 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:48.332603    2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 28 19:29:48.333132 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:48.332752    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 19:29:48.379082 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:48.379039    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-248.ec2.internal\" not found"
Jul 28 19:29:48.401225 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:48.401185    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 19:24:47 +0000 UTC" deadline="2028-03-18 15:06:22.417362224 +0000 UTC"
Jul 28 19:29:48.401225 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:48.401214    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14371h36m34.016150836s"
Jul 28 19:29:48.479522 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:48.479495    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-248.ec2.internal\" not found"
Jul 28 19:29:48.556098 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:48.556063    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod173852bb74b234290637b3e3c7d98ebe.slice/crio-057df6b4779d20e63fe8aee5589a9cbd6201d9eb29410e90811d367cef5b009e WatchSource:0}: Error finding container 057df6b4779d20e63fe8aee5589a9cbd6201d9eb29410e90811d367cef5b009e: Status 404 returned error can't find the container with id 057df6b4779d20e63fe8aee5589a9cbd6201d9eb29410e90811d367cef5b009e
Jul 28 19:29:48.556619 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:48.556591    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66c7900c897da2db768e7d8f675c61eb.slice/crio-cf4c22023b66098ee8c354dbb90dc445a65522427d1f2b776f4b7e5817c544b6 WatchSource:0}: Error finding container cf4c22023b66098ee8c354dbb90dc445a65522427d1f2b776f4b7e5817c544b6: Status 404 returned error can't find the container with id cf4c22023b66098ee8c354dbb90dc445a65522427d1f2b776f4b7e5817c544b6
Jul 28 19:29:48.561098 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:48.561083    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 19:29:48.569368 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:48.569322    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-248.ec2.internal" event={"ID":"66c7900c897da2db768e7d8f675c61eb","Type":"ContainerStarted","Data":"cf4c22023b66098ee8c354dbb90dc445a65522427d1f2b776f4b7e5817c544b6"}
Jul 28 19:29:48.570285 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:48.570257    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-248.ec2.internal" event={"ID":"173852bb74b234290637b3e3c7d98ebe","Type":"ContainerStarted","Data":"057df6b4779d20e63fe8aee5589a9cbd6201d9eb29410e90811d367cef5b009e"}
Jul 28 19:29:48.580027 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:48.580010    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-248.ec2.internal\" not found"
Jul 28 19:29:48.583150 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:48.583133    2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 19:29:48.680499 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:48.680468    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-248.ec2.internal\" not found"
Jul 28 19:29:48.715449 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:48.715379    2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 19:29:48.775734 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:48.775704    2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 19:29:48.790744 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:48.790714    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-248.ec2.internal"
Jul 28 19:29:48.803809 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:48.803788    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 19:29:48.804604 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:48.804591    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-248.ec2.internal"
Jul 28 19:29:48.812128 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:48.812108    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 19:29:49.282847 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.282812    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 19:29:49.370212 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.370179    2570 apiserver.go:52] "Watching apiserver"
Jul 28 19:29:49.378290 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.378260    2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 28 19:29:49.378710 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.378682    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-248.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zvlf","openshift-dns/node-resolver-msmdc","openshift-image-registry/node-ca-7dtx2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-248.ec2.internal","openshift-multus/multus-additional-cni-plugins-sjp5l","openshift-cluster-node-tuning-operator/tuned-62m88","openshift-multus/multus-xl9mh","openshift-multus/network-metrics-daemon-dc8tz","openshift-network-diagnostics/network-check-target-m9dh6","openshift-network-operator/iptables-alerter-d44kh","openshift-ovn-kubernetes/ovnkube-node-ttffx","kube-system/global-pull-secret-syncer-4qqck","kube-system/konnectivity-agent-w2bkk"]
Jul 28 19:29:49.380247 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.380222    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.381383 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.381353    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d44kh"
Jul 28 19:29:49.382829 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.382807    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 28 19:29:49.383287 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.383095    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 28 19:29:49.383445 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.383290    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nm4d9\""
Jul 28 19:29:49.383552 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.383520    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-msmdc"
Jul 28 19:29:49.383884 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.383860    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 28 19:29:49.383884 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.383882    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7dtx2"
Jul 28 19:29:49.384089 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.384008    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 28 19:29:49.384554 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.384310    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 28 19:29:49.384554 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.384395    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lskxq\""
Jul 28 19:29:49.385061 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.385045    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w2bkk"
Jul 28 19:29:49.385756 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.385737    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 28 19:29:49.386205 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.386033    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7kwwt\""
Jul 28 19:29:49.386205 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.386122    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 28 19:29:49.386674 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.386252    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6zlp5\""
Jul 28 19:29:49.386674 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.386300    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 28 19:29:49.386674 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.386522    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 28 19:29:49.386674 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.386560    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 28 19:29:49.386863 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.386809    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sjp5l"
Jul 28 19:29:49.387348 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.387319    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zljrt\""
Jul 28 19:29:49.387477 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.387459    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 28 19:29:49.387566 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.387494    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 28 19:29:49.388385 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.388348    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dc8tz"
Jul 28 19:29:49.388481 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:49.388429    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dc8tz" podUID="42aea3ba-db99-4d52-b3a0-dfea4a5d436d"
Jul 28 19:29:49.388849 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.388820    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 28 19:29:49.389025 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.389008    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 28 19:29:49.389144 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.389130    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 28 19:29:49.389211 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.389132    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 28 19:29:49.389274 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.389239    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zxskh\""
Jul 28 19:29:49.389789 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.389432    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 28 19:29:49.390081 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.390063    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qqck"
Jul 28 19:29:49.390161 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:49.390130    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qqck" podUID="e6ef696c-5387-4f59-9157-de961fedb6de"
Jul 28 19:29:49.390443 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.390217    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 28 19:29:49.391590 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.391293    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zvlf"
Jul 28 19:29:49.392634 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.392618    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9dh6"
Jul 28 19:29:49.393360 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:49.392689    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9dh6" podUID="ecf7120c-270a-4dd7-aa6e-3dc0cce3b533"
Jul 28 19:29:49.393461 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.393401    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 28 19:29:49.394406 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.393674    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 28 19:29:49.394406 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.393855    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 28 19:29:49.395190 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.395173    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pxpfr\""
Jul 28 19:29:49.397181 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.396222    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.397850 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.397831    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.398316 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.398300    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 28 19:29:49.398534 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.398520    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8fzhd\""
Jul 28 19:29:49.400121 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.400101    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 28 19:29:49.400297 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.400276    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 28 19:29:49.400297 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.400294    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 28 19:29:49.400433 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.400140    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 28 19:29:49.400524 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.400505    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jvhr5\""
Jul 28 19:29:49.400910 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.400889    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b06b9cd0-9672-452d-b310-bcbb04b7a3d9-serviceca\") pod \"node-ca-7dtx2\" (UID: \"b06b9cd0-9672-452d-b310-bcbb04b7a3d9\") " pod="openshift-image-registry/node-ca-7dtx2"
Jul 28 19:29:49.401015 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.400921    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e9322115-695d-40b0-92d0-fd38e1e99ee2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sjp5l\" (UID: \"e9322115-695d-40b0-92d0-fd38e1e99ee2\") " pod="openshift-multus/multus-additional-cni-plugins-sjp5l"
Jul 28 19:29:49.401015 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.400946    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpcvw\" (UniqueName: \"kubernetes.io/projected/e9322115-695d-40b0-92d0-fd38e1e99ee2-kube-api-access-zpcvw\") pod \"multus-additional-cni-plugins-sjp5l\" (UID: \"e9322115-695d-40b0-92d0-fd38e1e99ee2\") " pod="openshift-multus/multus-additional-cni-plugins-sjp5l"
Jul 28 19:29:49.401015 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.400988    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42aea3ba-db99-4d52-b3a0-dfea4a5d436d-metrics-certs\") pod \"network-metrics-daemon-dc8tz\" (UID: \"42aea3ba-db99-4d52-b3a0-dfea4a5d436d\") " pod="openshift-multus/network-metrics-daemon-dc8tz"
Jul 28 19:29:49.401176 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.401014    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/555f2c2f-5529-4431-8b2c-70d81efc607c-socket-dir\") pod \"aws-ebs-csi-driver-node-6zvlf\" (UID: \"555f2c2f-5529-4431-8b2c-70d81efc607c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zvlf"
Jul 28 19:29:49.401176 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.401034    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 28 19:29:49.401176 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.401039    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/555f2c2f-5529-4431-8b2c-70d81efc607c-etc-selinux\") pod \"aws-ebs-csi-driver-node-6zvlf\" (UID: \"555f2c2f-5529-4431-8b2c-70d81efc607c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zvlf"
Jul 28 19:29:49.401176 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.401062    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-etc-sysctl-conf\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.401176 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.401085    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/470cb015-80ed-44e2-a6ab-864b5b6dc967-iptables-alerter-script\") pod \"iptables-alerter-d44kh\" (UID: \"470cb015-80ed-44e2-a6ab-864b5b6dc967\") " pod="openshift-network-operator/iptables-alerter-d44kh"
Jul 28 19:29:49.401176 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.401130    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9322115-695d-40b0-92d0-fd38e1e99ee2-cnibin\") pod \"multus-additional-cni-plugins-sjp5l\" (UID: \"e9322115-695d-40b0-92d0-fd38e1e99ee2\") " pod="openshift-multus/multus-additional-cni-plugins-sjp5l"
Jul 28 19:29:49.401176 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.401154    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/673e4708-36af-4e9f-8157-d34e64c16ef8-agent-certs\") pod \"konnectivity-agent-w2bkk\" (UID: \"673e4708-36af-4e9f-8157-d34e64c16ef8\") " pod="kube-system/konnectivity-agent-w2bkk"
Jul 28 19:29:49.401503 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.401186    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e9322115-695d-40b0-92d0-fd38e1e99ee2-os-release\") pod \"multus-additional-cni-plugins-sjp5l\" (UID: \"e9322115-695d-40b0-92d0-fd38e1e99ee2\") " pod="openshift-multus/multus-additional-cni-plugins-sjp5l"
Jul 28 19:29:49.401503 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.401212    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e9322115-695d-40b0-92d0-fd38e1e99ee2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sjp5l\" (UID: \"e9322115-695d-40b0-92d0-fd38e1e99ee2\") " pod="openshift-multus/multus-additional-cni-plugins-sjp5l"
Jul 28 19:29:49.401503 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.401236    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r65kg\" (UniqueName: \"kubernetes.io/projected/470cb015-80ed-44e2-a6ab-864b5b6dc967-kube-api-access-r65kg\") pod \"iptables-alerter-d44kh\" (UID: \"470cb015-80ed-44e2-a6ab-864b5b6dc967\") " pod="openshift-network-operator/iptables-alerter-d44kh"
Jul 28 19:29:49.401503 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.401266    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9322115-695d-40b0-92d0-fd38e1e99ee2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sjp5l\" (UID: \"e9322115-695d-40b0-92d0-fd38e1e99ee2\") " pod="openshift-multus/multus-additional-cni-plugins-sjp5l"
Jul 28 19:29:49.401503 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.401297    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e6ef696c-5387-4f59-9157-de961fedb6de-kubelet-config\") pod \"global-pull-secret-syncer-4qqck\" (UID: \"e6ef696c-5387-4f59-9157-de961fedb6de\") " pod="kube-system/global-pull-secret-syncer-4qqck"
Jul 28 19:29:49.401503 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.401321    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-etc-sysconfig\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.401503 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.401343    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-host\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.401503 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.401365    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9322115-695d-40b0-92d0-fd38e1e99ee2-cni-binary-copy\") pod \"multus-additional-cni-plugins-sjp5l\" (UID: \"e9322115-695d-40b0-92d0-fd38e1e99ee2\") " pod="openshift-multus/multus-additional-cni-plugins-sjp5l"
Jul 28 19:29:49.401503 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.401391    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1744c82-4def-4eba-84c8-89528fef43f6-tmp-dir\") pod \"node-resolver-msmdc\" (UID: \"d1744c82-4def-4eba-84c8-89528fef43f6\") " pod="openshift-dns/node-resolver-msmdc"
Jul 28 19:29:49.401503 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.401400    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 28 19:29:49.401503 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.401413    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzh6f\" (UniqueName: \"kubernetes.io/projected/d1744c82-4def-4eba-84c8-89528fef43f6-kube-api-access-tzh6f\") pod \"node-resolver-msmdc\" (UID: \"d1744c82-4def-4eba-84c8-89528fef43f6\") " pod="openshift-dns/node-resolver-msmdc"
Jul 28 19:29:49.401503 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.401436    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/673e4708-36af-4e9f-8157-d34e64c16ef8-konnectivity-ca\") pod \"konnectivity-agent-w2bkk\" (UID: \"673e4708-36af-4e9f-8157-d34e64c16ef8\") " pod="kube-system/konnectivity-agent-w2bkk"
Jul 28 19:29:49.401503 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.401461    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-etc-systemd\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.402155 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.401507    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-run\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.402155 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.401540    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-etc-tuned\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.402155 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.401572    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8zs5\" (UniqueName: \"kubernetes.io/projected/b06b9cd0-9672-452d-b310-bcbb04b7a3d9-kube-api-access-v8zs5\") pod \"node-ca-7dtx2\" (UID: \"b06b9cd0-9672-452d-b310-bcbb04b7a3d9\") " pod="openshift-image-registry/node-ca-7dtx2"
Jul 28 19:29:49.402155 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.401598    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/555f2c2f-5529-4431-8b2c-70d81efc607c-sys-fs\") pod \"aws-ebs-csi-driver-node-6zvlf\" (UID: \"555f2c2f-5529-4431-8b2c-70d81efc607c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zvlf"
Jul 28 19:29:49.402155 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.401632    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz56l\" (UniqueName: \"kubernetes.io/projected/555f2c2f-5529-4431-8b2c-70d81efc607c-kube-api-access-lz56l\") pod \"aws-ebs-csi-driver-node-6zvlf\" (UID: \"555f2c2f-5529-4431-8b2c-70d81efc607c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zvlf"
Jul 28 19:29:49.402155 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.401658    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-etc-kubernetes\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.402155 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.401698    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-lib-modules\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.402155 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.401726    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-var-lib-kubelet\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.402155 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.401761    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn6tw\" (UniqueName: \"kubernetes.io/projected/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-kube-api-access-gn6tw\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.402155 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.401789    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/470cb015-80ed-44e2-a6ab-864b5b6dc967-host-slash\") pod \"iptables-alerter-d44kh\" (UID: \"470cb015-80ed-44e2-a6ab-864b5b6dc967\") " pod="openshift-network-operator/iptables-alerter-d44kh"
Jul 28 19:29:49.402155 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.401809    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6ffx\" (UniqueName: \"kubernetes.io/projected/42aea3ba-db99-4d52-b3a0-dfea4a5d436d-kube-api-access-m6ffx\") pod \"network-metrics-daemon-dc8tz\" (UID: \"42aea3ba-db99-4d52-b3a0-dfea4a5d436d\") " pod="openshift-multus/network-metrics-daemon-dc8tz"
Jul 28 19:29:49.402155 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.401861    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/555f2c2f-5529-4431-8b2c-70d81efc607c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6zvlf\" (UID: \"555f2c2f-5529-4431-8b2c-70d81efc607c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zvlf"
Jul 28 19:29:49.402155 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.401885    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/555f2c2f-5529-4431-8b2c-70d81efc607c-registration-dir\") pod \"aws-ebs-csi-driver-node-6zvlf\" (UID: \"555f2c2f-5529-4431-8b2c-70d81efc607c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zvlf"
Jul 28 19:29:49.402155 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.401925    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d1744c82-4def-4eba-84c8-89528fef43f6-hosts-file\") pod \"node-resolver-msmdc\" (UID: \"d1744c82-4def-4eba-84c8-89528fef43f6\") " pod="openshift-dns/node-resolver-msmdc"
Jul 28 19:29:49.402155 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.401945    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e6ef696c-5387-4f59-9157-de961fedb6de-dbus\") pod \"global-pull-secret-syncer-4qqck\" (UID: \"e6ef696c-5387-4f59-9157-de961fedb6de\") " pod="kube-system/global-pull-secret-syncer-4qqck"
Jul 28 19:29:49.402155 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.401968    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6ef696c-5387-4f59-9157-de961fedb6de-original-pull-secret\") pod \"global-pull-secret-syncer-4qqck\" (UID: \"e6ef696c-5387-4f59-9157-de961fedb6de\") " pod="kube-system/global-pull-secret-syncer-4qqck"
Jul 28 19:29:49.402877 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.402016    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-etc-sysctl-d\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.402877 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.402052    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-sys\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.402877 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.402082    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9322115-695d-40b0-92d0-fd38e1e99ee2-system-cni-dir\") pod \"multus-additional-cni-plugins-sjp5l\" (UID: \"e9322115-695d-40b0-92d0-fd38e1e99ee2\") " pod="openshift-multus/multus-additional-cni-plugins-sjp5l"
Jul 28 19:29:49.402877 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.402126    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/555f2c2f-5529-4431-8b2c-70d81efc607c-device-dir\") pod \"aws-ebs-csi-driver-node-6zvlf\" (UID: \"555f2c2f-5529-4431-8b2c-70d81efc607c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zvlf"
Jul 28 19:29:49.402877 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.402155    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-etc-modprobe-d\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.402877 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.402187    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-tmp\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.402877 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.402234    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b06b9cd0-9672-452d-b310-bcbb04b7a3d9-host\") pod \"node-ca-7dtx2\" (UID: \"b06b9cd0-9672-452d-b310-bcbb04b7a3d9\") " pod="openshift-image-registry/node-ca-7dtx2"
Jul 28 19:29:49.403271 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.403251    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 19:29:49.421966 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.421889    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-86fgv"
Jul 28 19:29:49.429378 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.429354    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-86fgv"
Jul 28 19:29:49.491901 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.491873    2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 28 19:29:49.502820 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.502791    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-host\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.503003 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.502835    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9322115-695d-40b0-92d0-fd38e1e99ee2-cni-binary-copy\") pod \"multus-additional-cni-plugins-sjp5l\" (UID: \"e9322115-695d-40b0-92d0-fd38e1e99ee2\") " pod="openshift-multus/multus-additional-cni-plugins-sjp5l"
Jul 28 19:29:49.503003 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.502864    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-host-run-netns\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.503003 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.502888    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-var-lib-openvswitch\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.503003 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.502889    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-host\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.503003 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.502916    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzh6f\" (UniqueName: \"kubernetes.io/projected/d1744c82-4def-4eba-84c8-89528fef43f6-kube-api-access-tzh6f\") pod \"node-resolver-msmdc\" (UID: \"d1744c82-4def-4eba-84c8-89528fef43f6\") " pod="openshift-dns/node-resolver-msmdc"
Jul 28 19:29:49.503003 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.502941    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-run\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.503003 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.502963    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-etc-tuned\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.503349 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.503168    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-run\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.503349 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.503219    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-system-cni-dir\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.503349 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.503247    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-os-release\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.503349 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.503276    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz56l\" (UniqueName: \"kubernetes.io/projected/555f2c2f-5529-4431-8b2c-70d81efc607c-kube-api-access-lz56l\") pod \"aws-ebs-csi-driver-node-6zvlf\" (UID: \"555f2c2f-5529-4431-8b2c-70d81efc607c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zvlf"
Jul 28 19:29:49.503349 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.503305    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-etc-kubernetes\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.503349 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.503304    2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 28 19:29:49.503349 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.503332    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn6tw\" (UniqueName: \"kubernetes.io/projected/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-kube-api-access-gn6tw\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.503761 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.503359    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6ffx\" (UniqueName: \"kubernetes.io/projected/42aea3ba-db99-4d52-b3a0-dfea4a5d436d-kube-api-access-m6ffx\") pod \"network-metrics-daemon-dc8tz\" (UID: \"42aea3ba-db99-4d52-b3a0-dfea4a5d436d\") " pod="openshift-multus/network-metrics-daemon-dc8tz"
Jul 28 19:29:49.503761 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.503380    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-log-socket\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.503761 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.503399    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hwgj\" (UniqueName: \"kubernetes.io/projected/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-kube-api-access-5hwgj\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.503761 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.503420    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/555f2c2f-5529-4431-8b2c-70d81efc607c-registration-dir\") pod \"aws-ebs-csi-driver-node-6zvlf\" (UID: \"555f2c2f-5529-4431-8b2c-70d81efc607c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zvlf"
Jul 28 19:29:49.503761 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.503440    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d1744c82-4def-4eba-84c8-89528fef43f6-hosts-file\") pod \"node-resolver-msmdc\" (UID: \"d1744c82-4def-4eba-84c8-89528fef43f6\") " pod="openshift-dns/node-resolver-msmdc"
Jul 28 19:29:49.503761 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.503463    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6ef696c-5387-4f59-9157-de961fedb6de-original-pull-secret\") pod \"global-pull-secret-syncer-4qqck\" (UID: \"e6ef696c-5387-4f59-9157-de961fedb6de\") " pod="kube-system/global-pull-secret-syncer-4qqck"
Jul 28 19:29:49.503761 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.503483    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-sys\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.503761 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.503540    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-etc-kubernetes\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.503761 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.503556    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/555f2c2f-5529-4431-8b2c-70d81efc607c-registration-dir\") pod \"aws-ebs-csi-driver-node-6zvlf\" (UID: \"555f2c2f-5529-4431-8b2c-70d81efc607c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zvlf"
Jul 28 19:29:49.503761 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.503572    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9322115-695d-40b0-92d0-fd38e1e99ee2-cni-binary-copy\") pod \"multus-additional-cni-plugins-sjp5l\" (UID: \"e9322115-695d-40b0-92d0-fd38e1e99ee2\") " pod="openshift-multus/multus-additional-cni-plugins-sjp5l"
Jul 28 19:29:49.503761 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.503578    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9322115-695d-40b0-92d0-fd38e1e99ee2-system-cni-dir\") pod \"multus-additional-cni-plugins-sjp5l\" (UID: \"e9322115-695d-40b0-92d0-fd38e1e99ee2\") " pod="openshift-multus/multus-additional-cni-plugins-sjp5l"
Jul 28 19:29:49.503761 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.503612    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/555f2c2f-5529-4431-8b2c-70d81efc607c-device-dir\") pod \"aws-ebs-csi-driver-node-6zvlf\" (UID: \"555f2c2f-5529-4431-8b2c-70d81efc607c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zvlf"
Jul 28 19:29:49.503761 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.503630    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d1744c82-4def-4eba-84c8-89528fef43f6-hosts-file\") pod \"node-resolver-msmdc\" (UID: \"d1744c82-4def-4eba-84c8-89528fef43f6\") " pod="openshift-dns/node-resolver-msmdc"
Jul 28 19:29:49.503761 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.503639    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b06b9cd0-9672-452d-b310-bcbb04b7a3d9-host\") pod \"node-ca-7dtx2\" (UID: \"b06b9cd0-9672-452d-b310-bcbb04b7a3d9\") " pod="openshift-image-registry/node-ca-7dtx2"
Jul 28 19:29:49.503761 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.503670    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e9322115-695d-40b0-92d0-fd38e1e99ee2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sjp5l\" (UID: \"e9322115-695d-40b0-92d0-fd38e1e99ee2\") " pod="openshift-multus/multus-additional-cni-plugins-sjp5l"
Jul 28 19:29:49.503761 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.503699    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-host-var-lib-cni-multus\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.503761 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:49.503718    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 19:29:49.504587 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.503725    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-ovnkube-script-lib\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.504587 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.503751    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9322115-695d-40b0-92d0-fd38e1e99ee2-cnibin\") pod \"multus-additional-cni-plugins-sjp5l\" (UID: \"e9322115-695d-40b0-92d0-fd38e1e99ee2\") " pod="openshift-multus/multus-additional-cni-plugins-sjp5l"
Jul 28 19:29:49.504587 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.503775    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-host-kubelet\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.504587 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.503782    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-sys\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.504587 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:49.503791    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6ef696c-5387-4f59-9157-de961fedb6de-original-pull-secret podName:e6ef696c-5387-4f59-9157-de961fedb6de nodeName:}" failed. No retries permitted until 2026-07-28 19:29:50.003769331 +0000 UTC m=+2.955801662 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e6ef696c-5387-4f59-9157-de961fedb6de-original-pull-secret") pod "global-pull-secret-syncer-4qqck" (UID: "e6ef696c-5387-4f59-9157-de961fedb6de") : object "kube-system"/"original-pull-secret" not registered
Jul 28 19:29:49.504587 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.503819    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9322115-695d-40b0-92d0-fd38e1e99ee2-system-cni-dir\") pod \"multus-additional-cni-plugins-sjp5l\" (UID: \"e9322115-695d-40b0-92d0-fd38e1e99ee2\") " pod="openshift-multus/multus-additional-cni-plugins-sjp5l"
Jul 28 19:29:49.504587 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.503841    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-host-slash\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.504587 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.503873    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/673e4708-36af-4e9f-8157-d34e64c16ef8-agent-certs\") pod \"konnectivity-agent-w2bkk\" (UID: \"673e4708-36af-4e9f-8157-d34e64c16ef8\") " pod="kube-system/konnectivity-agent-w2bkk"
Jul 28 19:29:49.504587 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.503902    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5w76\" (UniqueName: \"kubernetes.io/projected/ecf7120c-270a-4dd7-aa6e-3dc0cce3b533-kube-api-access-q5w76\") pod \"network-check-target-m9dh6\" (UID: \"ecf7120c-270a-4dd7-aa6e-3dc0cce3b533\") " pod="openshift-network-diagnostics/network-check-target-m9dh6"
Jul 28 19:29:49.504587 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.503911    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9322115-695d-40b0-92d0-fd38e1e99ee2-cnibin\") pod \"multus-additional-cni-plugins-sjp5l\" (UID: \"e9322115-695d-40b0-92d0-fd38e1e99ee2\") " pod="openshift-multus/multus-additional-cni-plugins-sjp5l"
Jul 28 19:29:49.504587 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.504547    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-multus-socket-dir-parent\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.504587 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.504588    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-host-var-lib-cni-bin\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.504964 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.504619    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-multus-conf-dir\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.504964 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.504648    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-run-systemd\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.504964 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.504680    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-run-ovn\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.504964 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.504709    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9322115-695d-40b0-92d0-fd38e1e99ee2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sjp5l\" (UID: \"e9322115-695d-40b0-92d0-fd38e1e99ee2\") " pod="openshift-multus/multus-additional-cni-plugins-sjp5l"
Jul 28 19:29:49.504964 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.504930    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/555f2c2f-5529-4431-8b2c-70d81efc607c-device-dir\") pod \"aws-ebs-csi-driver-node-6zvlf\" (UID: \"555f2c2f-5529-4431-8b2c-70d81efc607c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zvlf"
Jul 28 19:29:49.505148 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.505009    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b06b9cd0-9672-452d-b310-bcbb04b7a3d9-host\") pod \"node-ca-7dtx2\" (UID: \"b06b9cd0-9672-452d-b310-bcbb04b7a3d9\") " pod="openshift-image-registry/node-ca-7dtx2"
Jul 28 19:29:49.505148 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.505027    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e9322115-695d-40b0-92d0-fd38e1e99ee2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sjp5l\" (UID: \"e9322115-695d-40b0-92d0-fd38e1e99ee2\") " pod="openshift-multus/multus-additional-cni-plugins-sjp5l"
Jul 28 19:29:49.505148 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.505126    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-etc-kubernetes\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.505271 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.505174    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-node-log\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.505271 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.505223    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-host-run-ovn-kubernetes\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.505368 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.505312    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-host-cni-bin\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.505368 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.505352    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e6ef696c-5387-4f59-9157-de961fedb6de-kubelet-config\") pod \"global-pull-secret-syncer-4qqck\" (UID: \"e6ef696c-5387-4f59-9157-de961fedb6de\") " pod="kube-system/global-pull-secret-syncer-4qqck"
Jul 28 19:29:49.505515 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.505378    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9322115-695d-40b0-92d0-fd38e1e99ee2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sjp5l\" (UID: \"e9322115-695d-40b0-92d0-fd38e1e99ee2\") " pod="openshift-multus/multus-additional-cni-plugins-sjp5l"
Jul 28 19:29:49.505515 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.505406    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-host-run-multus-certs\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.505515 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.505433    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-run-openvswitch\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.505515 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.505439    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e6ef696c-5387-4f59-9157-de961fedb6de-kubelet-config\") pod \"global-pull-secret-syncer-4qqck\" (UID: \"e6ef696c-5387-4f59-9157-de961fedb6de\") " pod="kube-system/global-pull-secret-syncer-4qqck"
Jul 28 19:29:49.505515 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.505494    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1744c82-4def-4eba-84c8-89528fef43f6-tmp-dir\") pod \"node-resolver-msmdc\" (UID: \"d1744c82-4def-4eba-84c8-89528fef43f6\") " pod="openshift-dns/node-resolver-msmdc"
Jul 28 19:29:49.505905 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.505829    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1744c82-4def-4eba-84c8-89528fef43f6-tmp-dir\") pod \"node-resolver-msmdc\" (UID: \"d1744c82-4def-4eba-84c8-89528fef43f6\") " pod="openshift-dns/node-resolver-msmdc"
Jul 28 19:29:49.505905 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.505836    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/673e4708-36af-4e9f-8157-d34e64c16ef8-konnectivity-ca\") pod \"konnectivity-agent-w2bkk\" (UID: \"673e4708-36af-4e9f-8157-d34e64c16ef8\") " pod="kube-system/konnectivity-agent-w2bkk"
Jul 28 19:29:49.506748 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.506106    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-etc-systemd\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.506748 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.506149    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8zs5\" (UniqueName: \"kubernetes.io/projected/b06b9cd0-9672-452d-b310-bcbb04b7a3d9-kube-api-access-v8zs5\") pod \"node-ca-7dtx2\" (UID: \"b06b9cd0-9672-452d-b310-bcbb04b7a3d9\") " pod="openshift-image-registry/node-ca-7dtx2"
Jul 28 19:29:49.506748 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.506177    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-systemd-units\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.506748 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.506207    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-env-overrides\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.506748 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.506240    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/555f2c2f-5529-4431-8b2c-70d81efc607c-sys-fs\") pod \"aws-ebs-csi-driver-node-6zvlf\" (UID: \"555f2c2f-5529-4431-8b2c-70d81efc607c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zvlf"
Jul 28 19:29:49.506748 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.506270    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-lib-modules\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.506748 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.506302    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-var-lib-kubelet\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.506748 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.506329    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/470cb015-80ed-44e2-a6ab-864b5b6dc967-host-slash\") pod \"iptables-alerter-d44kh\" (UID: \"470cb015-80ed-44e2-a6ab-864b5b6dc967\") " pod="openshift-network-operator/iptables-alerter-d44kh"
Jul 28 19:29:49.506748 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.506359    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/673e4708-36af-4e9f-8157-d34e64c16ef8-konnectivity-ca\") pod \"konnectivity-agent-w2bkk\" (UID: \"673e4708-36af-4e9f-8157-d34e64c16ef8\") " pod="kube-system/konnectivity-agent-w2bkk"
Jul 28 19:29:49.506748 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.506361    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6de26f27-955a-4c80-ae21-74098f18a778-multus-daemon-config\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.506748 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.506424    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-host-run-k8s-cni-cncf-io\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.506748 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.506428    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-etc-systemd\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.506748 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.506461    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/555f2c2f-5529-4431-8b2c-70d81efc607c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6zvlf\" (UID: \"555f2c2f-5529-4431-8b2c-70d81efc607c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zvlf"
Jul 28 19:29:49.506748 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.506491    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e6ef696c-5387-4f59-9157-de961fedb6de-dbus\") pod \"global-pull-secret-syncer-4qqck\" (UID: \"e6ef696c-5387-4f59-9157-de961fedb6de\") " pod="kube-system/global-pull-secret-syncer-4qqck"
Jul 28 19:29:49.506748 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.506520    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-etc-sysctl-d\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.506748 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.506546    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpcvw\" (UniqueName: \"kubernetes.io/projected/e9322115-695d-40b0-92d0-fd38e1e99ee2-kube-api-access-zpcvw\") pod \"multus-additional-cni-plugins-sjp5l\" (UID: \"e9322115-695d-40b0-92d0-fd38e1e99ee2\") " pod="openshift-multus/multus-additional-cni-plugins-sjp5l"
Jul 28 19:29:49.506748 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.506576    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-cnibin\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.507606 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.506604    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-host-run-netns\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.507606 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.506634    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95hss\" (UniqueName: \"kubernetes.io/projected/6de26f27-955a-4c80-ae21-74098f18a778-kube-api-access-95hss\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.507606 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.506661    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-etc-modprobe-d\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.507606 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.506689    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-tmp\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.507606 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.506699    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/555f2c2f-5529-4431-8b2c-70d81efc607c-sys-fs\") pod \"aws-ebs-csi-driver-node-6zvlf\" (UID: \"555f2c2f-5529-4431-8b2c-70d81efc607c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zvlf"
Jul 28 19:29:49.507606 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.506717    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b06b9cd0-9672-452d-b310-bcbb04b7a3d9-serviceca\") pod \"node-ca-7dtx2\" (UID: \"b06b9cd0-9672-452d-b310-bcbb04b7a3d9\") " pod="openshift-image-registry/node-ca-7dtx2"
Jul 28 19:29:49.507606 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.506921    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42aea3ba-db99-4d52-b3a0-dfea4a5d436d-metrics-certs\") pod \"network-metrics-daemon-dc8tz\" (UID: \"42aea3ba-db99-4d52-b3a0-dfea4a5d436d\") " pod="openshift-multus/network-metrics-daemon-dc8tz"
Jul 28 19:29:49.507606 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.506963    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-multus-cni-dir\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.507606 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.507015    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-ovn-node-metrics-cert\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.507606 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.507054    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/555f2c2f-5529-4431-8b2c-70d81efc607c-socket-dir\") pod \"aws-ebs-csi-driver-node-6zvlf\" (UID: \"555f2c2f-5529-4431-8b2c-70d81efc607c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zvlf"
Jul 28 19:29:49.507606 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.507248    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e6ef696c-5387-4f59-9157-de961fedb6de-dbus\") pod \"global-pull-secret-syncer-4qqck\" (UID: \"e6ef696c-5387-4f59-9157-de961fedb6de\") " pod="kube-system/global-pull-secret-syncer-4qqck"
Jul 28 19:29:49.507606 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.507305    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-etc-tuned\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.507606 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.507351    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-etc-sysctl-d\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.507606 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:49.507449    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:29:49.507606 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.507457    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-lib-modules\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.507606 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.507499    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/470cb015-80ed-44e2-a6ab-864b5b6dc967-host-slash\") pod \"iptables-alerter-d44kh\" (UID: \"470cb015-80ed-44e2-a6ab-864b5b6dc967\") " pod="openshift-network-operator/iptables-alerter-d44kh"
Jul 28 19:29:49.507606 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:49.507520    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42aea3ba-db99-4d52-b3a0-dfea4a5d436d-metrics-certs podName:42aea3ba-db99-4d52-b3a0-dfea4a5d436d nodeName:}" failed. No retries permitted until 2026-07-28 19:29:50.007501957 +0000 UTC m=+2.959534282 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42aea3ba-db99-4d52-b3a0-dfea4a5d436d-metrics-certs") pod "network-metrics-daemon-dc8tz" (UID: "42aea3ba-db99-4d52-b3a0-dfea4a5d436d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:29:49.508398 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.507542    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/673e4708-36af-4e9f-8157-d34e64c16ef8-agent-certs\") pod \"konnectivity-agent-w2bkk\" (UID: \"673e4708-36af-4e9f-8157-d34e64c16ef8\") " pod="kube-system/konnectivity-agent-w2bkk"
Jul 28 19:29:49.508398 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.507553    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b06b9cd0-9672-452d-b310-bcbb04b7a3d9-serviceca\") pod \"node-ca-7dtx2\" (UID: \"b06b9cd0-9672-452d-b310-bcbb04b7a3d9\") " pod="openshift-image-registry/node-ca-7dtx2"
Jul 28 19:29:49.508398 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.507575    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-etc-modprobe-d\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.508398 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.507609    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/555f2c2f-5529-4431-8b2c-70d81efc607c-etc-selinux\") pod \"aws-ebs-csi-driver-node-6zvlf\" (UID: \"555f2c2f-5529-4431-8b2c-70d81efc607c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zvlf"
Jul 28 19:29:49.508398 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.507663    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/555f2c2f-5529-4431-8b2c-70d81efc607c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6zvlf\" (UID: \"555f2c2f-5529-4431-8b2c-70d81efc607c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zvlf"
Jul 28 19:29:49.508398 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.507668    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-etc-sysctl-conf\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.508398 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.507673    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/555f2c2f-5529-4431-8b2c-70d81efc607c-socket-dir\") pod \"aws-ebs-csi-driver-node-6zvlf\" (UID: \"555f2c2f-5529-4431-8b2c-70d81efc607c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zvlf"
Jul 28 19:29:49.508398 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.507714    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/470cb015-80ed-44e2-a6ab-864b5b6dc967-iptables-alerter-script\") pod \"iptables-alerter-d44kh\" (UID: \"470cb015-80ed-44e2-a6ab-864b5b6dc967\") " pod="openshift-network-operator/iptables-alerter-d44kh"
Jul 28 19:29:49.508398 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.507771    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-hostroot\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.508398 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.507786    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/555f2c2f-5529-4431-8b2c-70d81efc607c-etc-selinux\") pod \"aws-ebs-csi-driver-node-6zvlf\" (UID: \"555f2c2f-5529-4431-8b2c-70d81efc607c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zvlf"
Jul 28 19:29:49.508398 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.507806    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-host-cni-netd\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.508398 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.507813    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-etc-sysctl-conf\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.508398 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.507846    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-ovnkube-config\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.508398 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.507958    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e9322115-695d-40b0-92d0-fd38e1e99ee2-os-release\") pod \"multus-additional-cni-plugins-sjp5l\" (UID: \"e9322115-695d-40b0-92d0-fd38e1e99ee2\") " pod="openshift-multus/multus-additional-cni-plugins-sjp5l"
Jul 28 19:29:49.508398 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.508010    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e9322115-695d-40b0-92d0-fd38e1e99ee2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sjp5l\" (UID: \"e9322115-695d-40b0-92d0-fd38e1e99ee2\") " pod="openshift-multus/multus-additional-cni-plugins-sjp5l"
Jul 28 19:29:49.508398 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.508070    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6de26f27-955a-4c80-ae21-74098f18a778-cni-binary-copy\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.508398 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.508105    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-host-var-lib-kubelet\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.509217 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.508145    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r65kg\" (UniqueName: \"kubernetes.io/projected/470cb015-80ed-44e2-a6ab-864b5b6dc967-kube-api-access-r65kg\") pod \"iptables-alerter-d44kh\" (UID: \"470cb015-80ed-44e2-a6ab-864b5b6dc967\") " pod="openshift-network-operator/iptables-alerter-d44kh"
Jul 28 19:29:49.509217 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.508179    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-etc-openvswitch\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.509217 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.508258    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.509217 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.508296    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-etc-sysconfig\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.509217 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.508413    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-etc-sysconfig\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.509217 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.508501    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/470cb015-80ed-44e2-a6ab-864b5b6dc967-iptables-alerter-script\") pod \"iptables-alerter-d44kh\" (UID: \"470cb015-80ed-44e2-a6ab-864b5b6dc967\") " pod="openshift-network-operator/iptables-alerter-d44kh"
Jul 28 19:29:49.509217 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.508872    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e9322115-695d-40b0-92d0-fd38e1e99ee2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sjp5l\" (UID: \"e9322115-695d-40b0-92d0-fd38e1e99ee2\") " pod="openshift-multus/multus-additional-cni-plugins-sjp5l"
Jul 28 19:29:49.509217 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.508959    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e9322115-695d-40b0-92d0-fd38e1e99ee2-os-release\") pod \"multus-additional-cni-plugins-sjp5l\" (UID: \"e9322115-695d-40b0-92d0-fd38e1e99ee2\") " pod="openshift-multus/multus-additional-cni-plugins-sjp5l"
Jul 28 19:29:49.510511 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.509646    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-var-lib-kubelet\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.510511 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.509818    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-tmp\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.511699 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.511590    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn6tw\" (UniqueName: \"kubernetes.io/projected/149aa37e-88c6-464c-91e4-e47ecdb9e3fc-kube-api-access-gn6tw\") pod \"tuned-62m88\" (UID: \"149aa37e-88c6-464c-91e4-e47ecdb9e3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.514226 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.514203    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzh6f\" (UniqueName: \"kubernetes.io/projected/d1744c82-4def-4eba-84c8-89528fef43f6-kube-api-access-tzh6f\") pod \"node-resolver-msmdc\" (UID: \"d1744c82-4def-4eba-84c8-89528fef43f6\") " pod="openshift-dns/node-resolver-msmdc"
Jul 28 19:29:49.515428 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.515369    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8zs5\" (UniqueName: \"kubernetes.io/projected/b06b9cd0-9672-452d-b310-bcbb04b7a3d9-kube-api-access-v8zs5\") pod \"node-ca-7dtx2\" (UID: \"b06b9cd0-9672-452d-b310-bcbb04b7a3d9\") " pod="openshift-image-registry/node-ca-7dtx2"
Jul 28 19:29:49.515428 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.515378    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz56l\" (UniqueName: \"kubernetes.io/projected/555f2c2f-5529-4431-8b2c-70d81efc607c-kube-api-access-lz56l\") pod \"aws-ebs-csi-driver-node-6zvlf\" (UID: \"555f2c2f-5529-4431-8b2c-70d81efc607c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zvlf"
Jul 28 19:29:49.515925 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.515871    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpcvw\" (UniqueName: \"kubernetes.io/projected/e9322115-695d-40b0-92d0-fd38e1e99ee2-kube-api-access-zpcvw\") pod \"multus-additional-cni-plugins-sjp5l\" (UID: \"e9322115-695d-40b0-92d0-fd38e1e99ee2\") " pod="openshift-multus/multus-additional-cni-plugins-sjp5l"
Jul 28 19:29:49.516214 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.516190    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6ffx\" (UniqueName: \"kubernetes.io/projected/42aea3ba-db99-4d52-b3a0-dfea4a5d436d-kube-api-access-m6ffx\") pod \"network-metrics-daemon-dc8tz\" (UID: \"42aea3ba-db99-4d52-b3a0-dfea4a5d436d\") " pod="openshift-multus/network-metrics-daemon-dc8tz"
Jul 28 19:29:49.516344 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.516327    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r65kg\" (UniqueName: \"kubernetes.io/projected/470cb015-80ed-44e2-a6ab-864b5b6dc967-kube-api-access-r65kg\") pod \"iptables-alerter-d44kh\" (UID: \"470cb015-80ed-44e2-a6ab-864b5b6dc967\") " pod="openshift-network-operator/iptables-alerter-d44kh"
Jul 28 19:29:49.609264 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609166    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-host-kubelet\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.609264 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609203    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-host-slash\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.609264 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609230    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5w76\" (UniqueName: \"kubernetes.io/projected/ecf7120c-270a-4dd7-aa6e-3dc0cce3b533-kube-api-access-q5w76\") pod \"network-check-target-m9dh6\" (UID: \"ecf7120c-270a-4dd7-aa6e-3dc0cce3b533\") " pod="openshift-network-diagnostics/network-check-target-m9dh6"
Jul 28 19:29:49.609533 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609285    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-multus-socket-dir-parent\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.609533 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609303    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-host-slash\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.609533 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609328    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-host-var-lib-cni-bin\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.609533 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609362    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-multus-conf-dir\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.609533 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609368    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-host-var-lib-cni-bin\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.609533 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609387    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-run-systemd\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.609533 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609391    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-host-kubelet\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.609533 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609398    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-multus-socket-dir-parent\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.609533 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609409    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-multus-conf-dir\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.609533 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609411    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-run-ovn\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.609533 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609441    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-run-ovn\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.609533 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609444    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-etc-kubernetes\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.609533 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609456    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-run-systemd\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.609533 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609472    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-node-log\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.609533 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609498    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-host-run-ovn-kubernetes\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.609533 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609526    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-host-cni-bin\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.609533 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609539    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-node-log\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.610326 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609552    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-host-run-multus-certs\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.610326 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609554    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-host-run-ovn-kubernetes\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.610326 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609572    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-etc-kubernetes\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.610326 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609613    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-host-run-multus-certs\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.610326 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609623    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-run-openvswitch\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.610326 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609651    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-host-cni-bin\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.610326 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609671    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-systemd-units\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.610326 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609691    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-run-openvswitch\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.610326 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609695    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-env-overrides\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.610326 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609735    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6de26f27-955a-4c80-ae21-74098f18a778-multus-daemon-config\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.610326 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609749    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-systemd-units\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.610326 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609757    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-host-run-k8s-cni-cncf-io\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.610326 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609787    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-cnibin\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.610326 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609807    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-host-run-netns\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.610326 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609834    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-host-run-k8s-cni-cncf-io\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.610326 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609849    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95hss\" (UniqueName: \"kubernetes.io/projected/6de26f27-955a-4c80-ae21-74098f18a778-kube-api-access-95hss\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.610326 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609875    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-cnibin\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.610326 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609898    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-multus-cni-dir\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.611180 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609911    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-host-run-netns\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.611180 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609924    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-ovn-node-metrics-cert\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.611180 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609952    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-hostroot\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.611180 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609966    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-multus-cni-dir\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.611180 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.609992    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-host-cni-netd\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.611180 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.610018    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-ovnkube-config\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.611180 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.610043    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6de26f27-955a-4c80-ae21-74098f18a778-cni-binary-copy\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.611180 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.610066    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-host-var-lib-kubelet\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.611180 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.610115    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-etc-openvswitch\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.611180 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.610141    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.611180 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.610176    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-host-run-netns\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.611180 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.610200    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-var-lib-openvswitch\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.611180 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.610228    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-system-cni-dir\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.611180 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.610251    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-os-release\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.611180 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.610264    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.611180 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.610279    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-log-socket\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.611180 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.610319    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-etc-openvswitch\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.611180 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.610334    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-hostroot\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.611781 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.610337    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-var-lib-openvswitch\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.611781 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.610365    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-host-cni-netd\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.611781 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.610340    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6de26f27-955a-4c80-ae21-74098f18a778-multus-daemon-config\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.611781 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.610360    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-host-run-netns\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.611781 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.610402    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-log-socket\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.611781 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.610407    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-system-cni-dir\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.611781 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.610219    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-env-overrides\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.611781 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.610418    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-os-release\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.611781 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.610444    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hwgj\" (UniqueName: \"kubernetes.io/projected/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-kube-api-access-5hwgj\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.611781 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.610455    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-host-var-lib-kubelet\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.611781 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.610503    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-host-var-lib-cni-multus\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.611781 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.610529    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-ovnkube-script-lib\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.611781 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.610555    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6de26f27-955a-4c80-ae21-74098f18a778-host-var-lib-cni-multus\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.611781 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.610587    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6de26f27-955a-4c80-ae21-74098f18a778-cni-binary-copy\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.611781 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.610758    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-ovnkube-config\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.611781 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.611078    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-ovnkube-script-lib\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.612378 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.612357    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-ovn-node-metrics-cert\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.615565 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:49.615540    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 19:29:49.615818 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:49.615569    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 19:29:49.615818 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:49.615594    2570 projected.go:196] Error preparing data for projected volume kube-api-access-q5w76 for pod openshift-network-diagnostics/network-check-target-m9dh6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:29:49.615818 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:49.615675    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecf7120c-270a-4dd7-aa6e-3dc0cce3b533-kube-api-access-q5w76 podName:ecf7120c-270a-4dd7-aa6e-3dc0cce3b533 nodeName:}" failed. No retries permitted until 2026-07-28 19:29:50.11565632 +0000 UTC m=+3.067688851 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-q5w76" (UniqueName: "kubernetes.io/projected/ecf7120c-270a-4dd7-aa6e-3dc0cce3b533-kube-api-access-q5w76") pod "network-check-target-m9dh6" (UID: "ecf7120c-270a-4dd7-aa6e-3dc0cce3b533") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:29:49.617863 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.617843    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95hss\" (UniqueName: \"kubernetes.io/projected/6de26f27-955a-4c80-ae21-74098f18a778-kube-api-access-95hss\") pod \"multus-xl9mh\" (UID: \"6de26f27-955a-4c80-ae21-74098f18a778\") " pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.618329 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.618312    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hwgj\" (UniqueName: \"kubernetes.io/projected/62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a-kube-api-access-5hwgj\") pod \"ovnkube-node-ttffx\" (UID: \"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:49.696312 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.696273    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-62m88"
Jul 28 19:29:49.704758 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.704734    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d44kh"
Jul 28 19:29:49.713608 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.713586    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-msmdc"
Jul 28 19:29:49.720266 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.720239    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7dtx2"
Jul 28 19:29:49.727815 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.727793    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w2bkk"
Jul 28 19:29:49.736466 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.736441    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sjp5l"
Jul 28 19:29:49.743257 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.743224    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zvlf"
Jul 28 19:29:49.750000 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.749968    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xl9mh"
Jul 28 19:29:49.761895 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:49.761860    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:29:50.014305 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:50.014263    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42aea3ba-db99-4d52-b3a0-dfea4a5d436d-metrics-certs\") pod \"network-metrics-daemon-dc8tz\" (UID: \"42aea3ba-db99-4d52-b3a0-dfea4a5d436d\") " pod="openshift-multus/network-metrics-daemon-dc8tz"
Jul 28 19:29:50.014497 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:50.014331    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6ef696c-5387-4f59-9157-de961fedb6de-original-pull-secret\") pod \"global-pull-secret-syncer-4qqck\" (UID: \"e6ef696c-5387-4f59-9157-de961fedb6de\") " pod="kube-system/global-pull-secret-syncer-4qqck"
Jul 28 19:29:50.014497 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:50.014392    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:29:50.014497 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:50.014471    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 19:29:50.014643 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:50.014476    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42aea3ba-db99-4d52-b3a0-dfea4a5d436d-metrics-certs podName:42aea3ba-db99-4d52-b3a0-dfea4a5d436d nodeName:}" failed. No retries permitted until 2026-07-28 19:29:51.014455578 +0000 UTC m=+3.966487892 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42aea3ba-db99-4d52-b3a0-dfea4a5d436d-metrics-certs") pod "network-metrics-daemon-dc8tz" (UID: "42aea3ba-db99-4d52-b3a0-dfea4a5d436d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:29:50.014643 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:50.014533    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6ef696c-5387-4f59-9157-de961fedb6de-original-pull-secret podName:e6ef696c-5387-4f59-9157-de961fedb6de nodeName:}" failed. No retries permitted until 2026-07-28 19:29:51.014514939 +0000 UTC m=+3.966547251 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e6ef696c-5387-4f59-9157-de961fedb6de-original-pull-secret") pod "global-pull-secret-syncer-4qqck" (UID: "e6ef696c-5387-4f59-9157-de961fedb6de") : object "kube-system"/"original-pull-secret" not registered
Jul 28 19:29:50.215395 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:50.215363    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5w76\" (UniqueName: \"kubernetes.io/projected/ecf7120c-270a-4dd7-aa6e-3dc0cce3b533-kube-api-access-q5w76\") pod \"network-check-target-m9dh6\" (UID: \"ecf7120c-270a-4dd7-aa6e-3dc0cce3b533\") " pod="openshift-network-diagnostics/network-check-target-m9dh6"
Jul 28 19:29:50.215589 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:50.215538    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 19:29:50.215589 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:50.215559    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 19:29:50.215589 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:50.215586    2570 projected.go:196] Error preparing data for projected volume kube-api-access-q5w76 for pod openshift-network-diagnostics/network-check-target-m9dh6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:29:50.215749 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:50.215643    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecf7120c-270a-4dd7-aa6e-3dc0cce3b533-kube-api-access-q5w76 podName:ecf7120c-270a-4dd7-aa6e-3dc0cce3b533 nodeName:}" failed. No retries permitted until 2026-07-28 19:29:51.215624405 +0000 UTC m=+4.167656714 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-q5w76" (UniqueName: "kubernetes.io/projected/ecf7120c-270a-4dd7-aa6e-3dc0cce3b533-kube-api-access-q5w76") pod "network-check-target-m9dh6" (UID: "ecf7120c-270a-4dd7-aa6e-3dc0cce3b533") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:29:50.431740 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:50.431698    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 19:24:49 +0000 UTC" deadline="2027-12-28 19:40:44.638529328 +0000 UTC"
Jul 28 19:29:50.431740 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:50.431729    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12432h10m54.206803004s"
Jul 28 19:29:50.445890 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:50.445863    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod673e4708_36af_4e9f_8157_d34e64c16ef8.slice/crio-ceb09618085d2f4b0b209e4f0c7f15e69ff3037e07630f6bb617f6e5f543cb30 WatchSource:0}: Error finding container ceb09618085d2f4b0b209e4f0c7f15e69ff3037e07630f6bb617f6e5f543cb30: Status 404 returned error can't find the container with id ceb09618085d2f4b0b209e4f0c7f15e69ff3037e07630f6bb617f6e5f543cb30
Jul 28 19:29:50.447588 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:50.447564    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod149aa37e_88c6_464c_91e4_e47ecdb9e3fc.slice/crio-bf62e61cbb74a650844eda378e1c8e619a90f5acec6251b76ad59026e299d39a WatchSource:0}: Error finding container bf62e61cbb74a650844eda378e1c8e619a90f5acec6251b76ad59026e299d39a: Status 404 returned error can't find the container with id bf62e61cbb74a650844eda378e1c8e619a90f5acec6251b76ad59026e299d39a
Jul 28 19:29:50.448824 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:50.448790    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb06b9cd0_9672_452d_b310_bcbb04b7a3d9.slice/crio-db1fc06e02b0cbc82726b18c204fddcc211d20b54e4bc8e06ec6b876406dd86e WatchSource:0}: Error finding container db1fc06e02b0cbc82726b18c204fddcc211d20b54e4bc8e06ec6b876406dd86e: Status 404 returned error can't find the container with id db1fc06e02b0cbc82726b18c204fddcc211d20b54e4bc8e06ec6b876406dd86e
Jul 28 19:29:50.450410 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:50.450051    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62bde7e5_af62_4ebc_a4c5_cdd0d1b6ed9a.slice/crio-8a472a7d4067720b69c43a4bc0b61636394a61f63ce87331c2ada14db9915bd1 WatchSource:0}: Error finding container 8a472a7d4067720b69c43a4bc0b61636394a61f63ce87331c2ada14db9915bd1: Status 404 returned error can't find the container with id 8a472a7d4067720b69c43a4bc0b61636394a61f63ce87331c2ada14db9915bd1
Jul 28 19:29:50.451969 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:50.451944    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod470cb015_80ed_44e2_a6ab_864b5b6dc967.slice/crio-1a7f83ce651a47397dd65101208584e520eed55db6004e3c4f8c995f16a06c0c WatchSource:0}: Error finding container 1a7f83ce651a47397dd65101208584e520eed55db6004e3c4f8c995f16a06c0c: Status 404 returned error can't find the container with id 1a7f83ce651a47397dd65101208584e520eed55db6004e3c4f8c995f16a06c0c
Jul 28 19:29:50.454063 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:50.454041    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6de26f27_955a_4c80_ae21_74098f18a778.slice/crio-d874bea5d85ad9c0639b96ecc13a7fee67446765d1e03134a5f3a278cc0359a5 WatchSource:0}: Error finding container d874bea5d85ad9c0639b96ecc13a7fee67446765d1e03134a5f3a278cc0359a5: Status 404 returned error can't find the container with id d874bea5d85ad9c0639b96ecc13a7fee67446765d1e03134a5f3a278cc0359a5
Jul 28 19:29:50.455381 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:50.455267    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod555f2c2f_5529_4431_8b2c_70d81efc607c.slice/crio-4f8624ed9121ffb4a2a460cac1801dad8e223d2443fdd9f85a5bec656eafc4a8 WatchSource:0}: Error finding container 4f8624ed9121ffb4a2a460cac1801dad8e223d2443fdd9f85a5bec656eafc4a8: Status 404 returned error can't find the container with id 4f8624ed9121ffb4a2a460cac1801dad8e223d2443fdd9f85a5bec656eafc4a8
Jul 28 19:29:50.456659 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:50.456628    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1744c82_4def_4eba_84c8_89528fef43f6.slice/crio-106ce21332ff3965ba81aba11030ed168b972c91e8d405c08090063fd9ef0e34 WatchSource:0}: Error finding container 106ce21332ff3965ba81aba11030ed168b972c91e8d405c08090063fd9ef0e34: Status 404 returned error can't find the container with id 106ce21332ff3965ba81aba11030ed168b972c91e8d405c08090063fd9ef0e34
Jul 28 19:29:50.459262 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:29:50.459157    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9322115_695d_40b0_92d0_fd38e1e99ee2.slice/crio-23e3e41d18c28dbf4e755d902f65016dc2ef615860cf7f0af78f91e53c5268f6 WatchSource:0}: Error finding container 23e3e41d18c28dbf4e755d902f65016dc2ef615860cf7f0af78f91e53c5268f6: Status 404 returned error can't find the container with id 23e3e41d18c28dbf4e755d902f65016dc2ef615860cf7f0af78f91e53c5268f6
Jul 28 19:29:50.567512 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:50.567482    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dc8tz"
Jul 28 19:29:50.567706 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:50.567618    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dc8tz" podUID="42aea3ba-db99-4d52-b3a0-dfea4a5d436d"
Jul 28 19:29:50.575777 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:50.575666    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7dtx2" event={"ID":"b06b9cd0-9672-452d-b310-bcbb04b7a3d9","Type":"ContainerStarted","Data":"db1fc06e02b0cbc82726b18c204fddcc211d20b54e4bc8e06ec6b876406dd86e"}
Jul 28 19:29:50.579053 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:50.579023    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xl9mh" event={"ID":"6de26f27-955a-4c80-ae21-74098f18a778","Type":"ContainerStarted","Data":"d874bea5d85ad9c0639b96ecc13a7fee67446765d1e03134a5f3a278cc0359a5"}
Jul 28 19:29:50.580212 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:50.580185    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttffx" event={"ID":"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a","Type":"ContainerStarted","Data":"8a472a7d4067720b69c43a4bc0b61636394a61f63ce87331c2ada14db9915bd1"}
Jul 28 19:29:50.581938 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:50.581916    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w2bkk" event={"ID":"673e4708-36af-4e9f-8157-d34e64c16ef8","Type":"ContainerStarted","Data":"ceb09618085d2f4b0b209e4f0c7f15e69ff3037e07630f6bb617f6e5f543cb30"}
Jul 28 19:29:50.583031 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:50.583007    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sjp5l" event={"ID":"e9322115-695d-40b0-92d0-fd38e1e99ee2","Type":"ContainerStarted","Data":"23e3e41d18c28dbf4e755d902f65016dc2ef615860cf7f0af78f91e53c5268f6"}
Jul 28 19:29:50.584093 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:50.584070    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-msmdc" event={"ID":"d1744c82-4def-4eba-84c8-89528fef43f6","Type":"ContainerStarted","Data":"106ce21332ff3965ba81aba11030ed168b972c91e8d405c08090063fd9ef0e34"}
Jul 28 19:29:50.585164 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:50.585136    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d44kh" event={"ID":"470cb015-80ed-44e2-a6ab-864b5b6dc967","Type":"ContainerStarted","Data":"1a7f83ce651a47397dd65101208584e520eed55db6004e3c4f8c995f16a06c0c"}
Jul 28 19:29:50.586456 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:50.586431    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-62m88" event={"ID":"149aa37e-88c6-464c-91e4-e47ecdb9e3fc","Type":"ContainerStarted","Data":"bf62e61cbb74a650844eda378e1c8e619a90f5acec6251b76ad59026e299d39a"}
Jul 28 19:29:50.588919 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:50.588886    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-248.ec2.internal" event={"ID":"66c7900c897da2db768e7d8f675c61eb","Type":"ContainerStarted","Data":"376d92c767df3fbcce17f3a3f5c0c99b5520b3fafd85d96acfa90bcf4db9ff70"}
Jul 28 19:29:50.590042 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:50.590016    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zvlf" event={"ID":"555f2c2f-5529-4431-8b2c-70d81efc607c","Type":"ContainerStarted","Data":"4f8624ed9121ffb4a2a460cac1801dad8e223d2443fdd9f85a5bec656eafc4a8"}
Jul 28 19:29:50.601924 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:50.601867    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-248.ec2.internal" podStartSLOduration=2.601851687 podStartE2EDuration="2.601851687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:29:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:29:50.601716246 +0000 UTC m=+3.553748577" watchObservedRunningTime="2026-07-28 19:29:50.601851687 +0000 UTC m=+3.553884017"
Jul 28 19:29:51.020049 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:51.020004    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6ef696c-5387-4f59-9157-de961fedb6de-original-pull-secret\") pod \"global-pull-secret-syncer-4qqck\" (UID: \"e6ef696c-5387-4f59-9157-de961fedb6de\") " pod="kube-system/global-pull-secret-syncer-4qqck"
Jul 28 19:29:51.020306 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:51.020107    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42aea3ba-db99-4d52-b3a0-dfea4a5d436d-metrics-certs\") pod \"network-metrics-daemon-dc8tz\" (UID: \"42aea3ba-db99-4d52-b3a0-dfea4a5d436d\") " pod="openshift-multus/network-metrics-daemon-dc8tz"
Jul 28 19:29:51.020306 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:51.020234    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:29:51.020306 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:51.020298    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42aea3ba-db99-4d52-b3a0-dfea4a5d436d-metrics-certs podName:42aea3ba-db99-4d52-b3a0-dfea4a5d436d nodeName:}" failed. No retries permitted until 2026-07-28 19:29:53.020278113 +0000 UTC m=+5.972310437 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42aea3ba-db99-4d52-b3a0-dfea4a5d436d-metrics-certs") pod "network-metrics-daemon-dc8tz" (UID: "42aea3ba-db99-4d52-b3a0-dfea4a5d436d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:29:51.020708 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:51.020685    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 19:29:51.020881 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:51.020745    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6ef696c-5387-4f59-9157-de961fedb6de-original-pull-secret podName:e6ef696c-5387-4f59-9157-de961fedb6de nodeName:}" failed. No retries permitted until 2026-07-28 19:29:53.020728158 +0000 UTC m=+5.972760467 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e6ef696c-5387-4f59-9157-de961fedb6de-original-pull-secret") pod "global-pull-secret-syncer-4qqck" (UID: "e6ef696c-5387-4f59-9157-de961fedb6de") : object "kube-system"/"original-pull-secret" not registered
Jul 28 19:29:51.221854 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:51.221812    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5w76\" (UniqueName: \"kubernetes.io/projected/ecf7120c-270a-4dd7-aa6e-3dc0cce3b533-kube-api-access-q5w76\") pod \"network-check-target-m9dh6\" (UID: \"ecf7120c-270a-4dd7-aa6e-3dc0cce3b533\") " pod="openshift-network-diagnostics/network-check-target-m9dh6"
Jul 28 19:29:51.222080 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:51.222017    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 19:29:51.222080 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:51.222043    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 19:29:51.222080 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:51.222057    2570 projected.go:196] Error preparing data for projected volume kube-api-access-q5w76 for pod openshift-network-diagnostics/network-check-target-m9dh6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:29:51.222259 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:51.222126    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecf7120c-270a-4dd7-aa6e-3dc0cce3b533-kube-api-access-q5w76 podName:ecf7120c-270a-4dd7-aa6e-3dc0cce3b533 nodeName:}" failed. No retries permitted until 2026-07-28 19:29:53.222106718 +0000 UTC m=+6.174139029 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-q5w76" (UniqueName: "kubernetes.io/projected/ecf7120c-270a-4dd7-aa6e-3dc0cce3b533-kube-api-access-q5w76") pod "network-check-target-m9dh6" (UID: "ecf7120c-270a-4dd7-aa6e-3dc0cce3b533") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:29:51.432150 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:51.432082    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 19:24:49 +0000 UTC" deadline="2028-03-12 14:41:06.236464091 +0000 UTC"
Jul 28 19:29:51.432150 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:51.432148    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14227h11m14.804320266s"
Jul 28 19:29:51.569684 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:51.567712    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qqck"
Jul 28 19:29:51.569684 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:51.567846    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qqck" podUID="e6ef696c-5387-4f59-9157-de961fedb6de"
Jul 28 19:29:51.569684 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:51.568286    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9dh6"
Jul 28 19:29:51.569684 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:51.568420    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9dh6" podUID="ecf7120c-270a-4dd7-aa6e-3dc0cce3b533"
Jul 28 19:29:51.605041 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:51.604735    2570 generic.go:356] "Generic (PLEG): container finished" podID="173852bb74b234290637b3e3c7d98ebe" containerID="5d90453cde0b811177cbfdfe209b2667f3448f8ae0ea382feebf5c46ce16bc0a" exitCode=0
Jul 28 19:29:51.605926 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:51.605856    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-248.ec2.internal" event={"ID":"173852bb74b234290637b3e3c7d98ebe","Type":"ContainerDied","Data":"5d90453cde0b811177cbfdfe209b2667f3448f8ae0ea382feebf5c46ce16bc0a"}
Jul 28 19:29:52.567147 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:52.567112    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dc8tz"
Jul 28 19:29:52.567635 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:52.567271    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dc8tz" podUID="42aea3ba-db99-4d52-b3a0-dfea4a5d436d"
Jul 28 19:29:52.619708 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:52.619040    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-248.ec2.internal" event={"ID":"173852bb74b234290637b3e3c7d98ebe","Type":"ContainerStarted","Data":"93a97012eee4eb4237c14092a104302d50e93ea58d0188511634133c301b9ed0"}
Jul 28 19:29:52.636272 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:52.635615    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-248.ec2.internal" podStartSLOduration=4.635595157 podStartE2EDuration="4.635595157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:29:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:29:52.635240662 +0000 UTC m=+5.587272990" watchObservedRunningTime="2026-07-28 19:29:52.635595157 +0000 UTC m=+5.587627491"
Jul 28 19:29:53.039123 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:53.039082    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42aea3ba-db99-4d52-b3a0-dfea4a5d436d-metrics-certs\") pod \"network-metrics-daemon-dc8tz\" (UID: \"42aea3ba-db99-4d52-b3a0-dfea4a5d436d\") " pod="openshift-multus/network-metrics-daemon-dc8tz"
Jul 28 19:29:53.039301 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:53.039157    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6ef696c-5387-4f59-9157-de961fedb6de-original-pull-secret\") pod \"global-pull-secret-syncer-4qqck\" (UID: \"e6ef696c-5387-4f59-9157-de961fedb6de\") " pod="kube-system/global-pull-secret-syncer-4qqck"
Jul 28 19:29:53.039377 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:53.039358    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:29:53.039448 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:53.039436    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42aea3ba-db99-4d52-b3a0-dfea4a5d436d-metrics-certs podName:42aea3ba-db99-4d52-b3a0-dfea4a5d436d nodeName:}" failed. No retries permitted until 2026-07-28 19:29:57.039412558 +0000 UTC m=+9.991444868 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42aea3ba-db99-4d52-b3a0-dfea4a5d436d-metrics-certs") pod "network-metrics-daemon-dc8tz" (UID: "42aea3ba-db99-4d52-b3a0-dfea4a5d436d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:29:53.039512 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:53.039443    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 19:29:53.039627 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:53.039566    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6ef696c-5387-4f59-9157-de961fedb6de-original-pull-secret podName:e6ef696c-5387-4f59-9157-de961fedb6de nodeName:}" failed. No retries permitted until 2026-07-28 19:29:57.039546854 +0000 UTC m=+9.991579176 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e6ef696c-5387-4f59-9157-de961fedb6de-original-pull-secret") pod "global-pull-secret-syncer-4qqck" (UID: "e6ef696c-5387-4f59-9157-de961fedb6de") : object "kube-system"/"original-pull-secret" not registered
Jul 28 19:29:53.241436 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:53.241396    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5w76\" (UniqueName: \"kubernetes.io/projected/ecf7120c-270a-4dd7-aa6e-3dc0cce3b533-kube-api-access-q5w76\") pod \"network-check-target-m9dh6\" (UID: \"ecf7120c-270a-4dd7-aa6e-3dc0cce3b533\") " pod="openshift-network-diagnostics/network-check-target-m9dh6"
Jul 28 19:29:53.241624 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:53.241583    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 19:29:53.241624 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:53.241609    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 19:29:53.241624 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:53.241621    2570 projected.go:196] Error preparing data for projected volume kube-api-access-q5w76 for pod openshift-network-diagnostics/network-check-target-m9dh6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:29:53.241770 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:53.241685    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecf7120c-270a-4dd7-aa6e-3dc0cce3b533-kube-api-access-q5w76 podName:ecf7120c-270a-4dd7-aa6e-3dc0cce3b533 nodeName:}" failed. No retries permitted until 2026-07-28 19:29:57.241662645 +0000 UTC m=+10.193694973 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-q5w76" (UniqueName: "kubernetes.io/projected/ecf7120c-270a-4dd7-aa6e-3dc0cce3b533-kube-api-access-q5w76") pod "network-check-target-m9dh6" (UID: "ecf7120c-270a-4dd7-aa6e-3dc0cce3b533") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:29:53.567160 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:53.567005    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9dh6"
Jul 28 19:29:53.567160 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:53.567044    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qqck"
Jul 28 19:29:53.567160 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:53.567154    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9dh6" podUID="ecf7120c-270a-4dd7-aa6e-3dc0cce3b533"
Jul 28 19:29:53.567856 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:53.567280    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qqck" podUID="e6ef696c-5387-4f59-9157-de961fedb6de"
Jul 28 19:29:54.566644 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:54.566596    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dc8tz"
Jul 28 19:29:54.566838 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:54.566766    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dc8tz" podUID="42aea3ba-db99-4d52-b3a0-dfea4a5d436d"
Jul 28 19:29:55.568640 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:55.568087    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qqck"
Jul 28 19:29:55.568640 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:55.568214    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qqck" podUID="e6ef696c-5387-4f59-9157-de961fedb6de"
Jul 28 19:29:55.569202 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:55.568754    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9dh6"
Jul 28 19:29:55.569202 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:55.568864    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9dh6" podUID="ecf7120c-270a-4dd7-aa6e-3dc0cce3b533"
Jul 28 19:29:56.567289 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:56.567253    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dc8tz"
Jul 28 19:29:56.567473 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:56.567405    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dc8tz" podUID="42aea3ba-db99-4d52-b3a0-dfea4a5d436d"
Jul 28 19:29:57.074755 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:57.074713    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42aea3ba-db99-4d52-b3a0-dfea4a5d436d-metrics-certs\") pod \"network-metrics-daemon-dc8tz\" (UID: \"42aea3ba-db99-4d52-b3a0-dfea4a5d436d\") " pod="openshift-multus/network-metrics-daemon-dc8tz"
Jul 28 19:29:57.075281 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:57.074783    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6ef696c-5387-4f59-9157-de961fedb6de-original-pull-secret\") pod \"global-pull-secret-syncer-4qqck\" (UID: \"e6ef696c-5387-4f59-9157-de961fedb6de\") " pod="kube-system/global-pull-secret-syncer-4qqck"
Jul 28 19:29:57.075281 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:57.074912    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 19:29:57.075281 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:57.074956    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:29:57.075281 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:57.074998    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6ef696c-5387-4f59-9157-de961fedb6de-original-pull-secret podName:e6ef696c-5387-4f59-9157-de961fedb6de nodeName:}" failed. No retries permitted until 2026-07-28 19:30:05.074963715 +0000 UTC m=+18.026996045 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e6ef696c-5387-4f59-9157-de961fedb6de-original-pull-secret") pod "global-pull-secret-syncer-4qqck" (UID: "e6ef696c-5387-4f59-9157-de961fedb6de") : object "kube-system"/"original-pull-secret" not registered
Jul 28 19:29:57.075281 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:57.075039    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42aea3ba-db99-4d52-b3a0-dfea4a5d436d-metrics-certs podName:42aea3ba-db99-4d52-b3a0-dfea4a5d436d nodeName:}" failed. No retries permitted until 2026-07-28 19:30:05.075019908 +0000 UTC m=+18.027052231 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42aea3ba-db99-4d52-b3a0-dfea4a5d436d-metrics-certs") pod "network-metrics-daemon-dc8tz" (UID: "42aea3ba-db99-4d52-b3a0-dfea4a5d436d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:29:57.276640 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:57.276594    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5w76\" (UniqueName: \"kubernetes.io/projected/ecf7120c-270a-4dd7-aa6e-3dc0cce3b533-kube-api-access-q5w76\") pod \"network-check-target-m9dh6\" (UID: \"ecf7120c-270a-4dd7-aa6e-3dc0cce3b533\") " pod="openshift-network-diagnostics/network-check-target-m9dh6"
Jul 28 19:29:57.276809 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:57.276791    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 19:29:57.276939 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:57.276818    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 19:29:57.276939 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:57.276831    2570 projected.go:196] Error preparing data for projected volume kube-api-access-q5w76 for pod openshift-network-diagnostics/network-check-target-m9dh6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:29:57.276939 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:57.276893    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecf7120c-270a-4dd7-aa6e-3dc0cce3b533-kube-api-access-q5w76 podName:ecf7120c-270a-4dd7-aa6e-3dc0cce3b533 nodeName:}" failed. No retries permitted until 2026-07-28 19:30:05.276874204 +0000 UTC m=+18.228906529 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-q5w76" (UniqueName: "kubernetes.io/projected/ecf7120c-270a-4dd7-aa6e-3dc0cce3b533-kube-api-access-q5w76") pod "network-check-target-m9dh6" (UID: "ecf7120c-270a-4dd7-aa6e-3dc0cce3b533") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:29:57.568151 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:57.568089    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qqck"
Jul 28 19:29:57.568335 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:57.568200    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qqck" podUID="e6ef696c-5387-4f59-9157-de961fedb6de"
Jul 28 19:29:57.568533 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:57.568513    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9dh6"
Jul 28 19:29:57.568644 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:57.568617    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9dh6" podUID="ecf7120c-270a-4dd7-aa6e-3dc0cce3b533"
Jul 28 19:29:58.567560 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:58.567140    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dc8tz"
Jul 28 19:29:58.568808 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:58.568374    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dc8tz" podUID="42aea3ba-db99-4d52-b3a0-dfea4a5d436d"
Jul 28 19:29:59.566732 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:59.566701    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qqck"
Jul 28 19:29:59.566899 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:59.566815    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qqck" podUID="e6ef696c-5387-4f59-9157-de961fedb6de"
Jul 28 19:29:59.566899 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:29:59.566877    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9dh6"
Jul 28 19:29:59.567022 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:29:59.567000    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9dh6" podUID="ecf7120c-270a-4dd7-aa6e-3dc0cce3b533"
Jul 28 19:30:00.567450 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:00.567410    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dc8tz"
Jul 28 19:30:00.567855 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:00.567566    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dc8tz" podUID="42aea3ba-db99-4d52-b3a0-dfea4a5d436d"
Jul 28 19:30:01.567257 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:01.567125    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qqck"
Jul 28 19:30:01.567420 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:01.567125    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9dh6"
Jul 28 19:30:01.567420 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:01.567375    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9dh6" podUID="ecf7120c-270a-4dd7-aa6e-3dc0cce3b533"
Jul 28 19:30:01.567420 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:01.567270    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qqck" podUID="e6ef696c-5387-4f59-9157-de961fedb6de"
Jul 28 19:30:02.566545 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:02.566513    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dc8tz"
Jul 28 19:30:02.566735 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:02.566668    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dc8tz" podUID="42aea3ba-db99-4d52-b3a0-dfea4a5d436d"
Jul 28 19:30:03.567415 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:03.567379    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9dh6"
Jul 28 19:30:03.567949 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:03.567379    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qqck"
Jul 28 19:30:03.567949 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:03.567509    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9dh6" podUID="ecf7120c-270a-4dd7-aa6e-3dc0cce3b533"
Jul 28 19:30:03.567949 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:03.567590    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qqck" podUID="e6ef696c-5387-4f59-9157-de961fedb6de"
Jul 28 19:30:04.566949 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:04.566913    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dc8tz"
Jul 28 19:30:04.567166 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:04.567078    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dc8tz" podUID="42aea3ba-db99-4d52-b3a0-dfea4a5d436d"
Jul 28 19:30:05.142917 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:05.142872    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42aea3ba-db99-4d52-b3a0-dfea4a5d436d-metrics-certs\") pod \"network-metrics-daemon-dc8tz\" (UID: \"42aea3ba-db99-4d52-b3a0-dfea4a5d436d\") " pod="openshift-multus/network-metrics-daemon-dc8tz"
Jul 28 19:30:05.143418 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:05.142938    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6ef696c-5387-4f59-9157-de961fedb6de-original-pull-secret\") pod \"global-pull-secret-syncer-4qqck\" (UID: \"e6ef696c-5387-4f59-9157-de961fedb6de\") " pod="kube-system/global-pull-secret-syncer-4qqck"
Jul 28 19:30:05.143418 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:05.143024    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:30:05.143418 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:05.143051    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 19:30:05.143418 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:05.143096    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42aea3ba-db99-4d52-b3a0-dfea4a5d436d-metrics-certs podName:42aea3ba-db99-4d52-b3a0-dfea4a5d436d nodeName:}" failed. No retries permitted until 2026-07-28 19:30:21.143072784 +0000 UTC m=+34.095105111 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42aea3ba-db99-4d52-b3a0-dfea4a5d436d-metrics-certs") pod "network-metrics-daemon-dc8tz" (UID: "42aea3ba-db99-4d52-b3a0-dfea4a5d436d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:30:05.143418 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:05.143113    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6ef696c-5387-4f59-9157-de961fedb6de-original-pull-secret podName:e6ef696c-5387-4f59-9157-de961fedb6de nodeName:}" failed. No retries permitted until 2026-07-28 19:30:21.143106768 +0000 UTC m=+34.095139076 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e6ef696c-5387-4f59-9157-de961fedb6de-original-pull-secret") pod "global-pull-secret-syncer-4qqck" (UID: "e6ef696c-5387-4f59-9157-de961fedb6de") : object "kube-system"/"original-pull-secret" not registered
Jul 28 19:30:05.344423 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:05.344383    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5w76\" (UniqueName: \"kubernetes.io/projected/ecf7120c-270a-4dd7-aa6e-3dc0cce3b533-kube-api-access-q5w76\") pod \"network-check-target-m9dh6\" (UID: \"ecf7120c-270a-4dd7-aa6e-3dc0cce3b533\") " pod="openshift-network-diagnostics/network-check-target-m9dh6"
Jul 28 19:30:05.344601 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:05.344578    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 19:30:05.344662 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:05.344608    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 19:30:05.344662 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:05.344622    2570 projected.go:196] Error preparing data for projected volume kube-api-access-q5w76 for pod openshift-network-diagnostics/network-check-target-m9dh6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:30:05.344773 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:05.344688    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecf7120c-270a-4dd7-aa6e-3dc0cce3b533-kube-api-access-q5w76 podName:ecf7120c-270a-4dd7-aa6e-3dc0cce3b533 nodeName:}" failed. No retries permitted until 2026-07-28 19:30:21.344669819 +0000 UTC m=+34.296702151 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-q5w76" (UniqueName: "kubernetes.io/projected/ecf7120c-270a-4dd7-aa6e-3dc0cce3b533-kube-api-access-q5w76") pod "network-check-target-m9dh6" (UID: "ecf7120c-270a-4dd7-aa6e-3dc0cce3b533") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:30:05.567003 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:05.566923    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qqck"
Jul 28 19:30:05.567174 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:05.567074    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qqck" podUID="e6ef696c-5387-4f59-9157-de961fedb6de"
Jul 28 19:30:05.567296 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:05.567265    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9dh6"
Jul 28 19:30:05.567434 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:05.567385    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9dh6" podUID="ecf7120c-270a-4dd7-aa6e-3dc0cce3b533"
Jul 28 19:30:06.567384 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:06.567350    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dc8tz"
Jul 28 19:30:06.567852 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:06.567480    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dc8tz" podUID="42aea3ba-db99-4d52-b3a0-dfea4a5d436d"
Jul 28 19:30:07.567704 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:07.567663    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qqck"
Jul 28 19:30:07.568191 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:07.567833    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qqck" podUID="e6ef696c-5387-4f59-9157-de961fedb6de"
Jul 28 19:30:07.568191 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:07.567872    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9dh6"
Jul 28 19:30:07.568191 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:07.567959    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9dh6" podUID="ecf7120c-270a-4dd7-aa6e-3dc0cce3b533"
Jul 28 19:30:08.566768 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:08.566727    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dc8tz"
Jul 28 19:30:08.566944 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:08.566863    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dc8tz" podUID="42aea3ba-db99-4d52-b3a0-dfea4a5d436d"
Jul 28 19:30:09.566930 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:09.566563    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qqck"
Jul 28 19:30:09.567783 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:09.566589    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9dh6"
Jul 28 19:30:09.567783 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:09.567051    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qqck" podUID="e6ef696c-5387-4f59-9157-de961fedb6de"
Jul 28 19:30:09.567783 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:09.567098    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9dh6" podUID="ecf7120c-270a-4dd7-aa6e-3dc0cce3b533"
Jul 28 19:30:09.654206 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:09.654124    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zvlf" event={"ID":"555f2c2f-5529-4431-8b2c-70d81efc607c","Type":"ContainerStarted","Data":"36e1c9e79dc9163325a0d190ca23ed522a720e2936221b34ab55b399c7d27e9b"}
Jul 28 19:30:09.655672 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:09.655634    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7dtx2" event={"ID":"b06b9cd0-9672-452d-b310-bcbb04b7a3d9","Type":"ContainerStarted","Data":"96a4b07176a1957f65599c9e490a500b5b002caec5923098cb936072dd6c83a6"}
Jul 28 19:30:09.657373 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:09.657334    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xl9mh" event={"ID":"6de26f27-955a-4c80-ae21-74098f18a778","Type":"ContainerStarted","Data":"6f03d27fe171e780ba0827001ec5df17ac4b60d5d72cec538a70c725bdc648c4"}
Jul 28 19:30:09.660776 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:09.660748    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttffx" event={"ID":"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a","Type":"ContainerStarted","Data":"dbf04c65af378ccf3316b7cfa92fc55507060c1a37b0fa4a6f4ddb74d87510ff"}
Jul 28 19:30:09.660902 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:09.660841    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttffx" event={"ID":"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a","Type":"ContainerStarted","Data":"3d2a43c5c86d68e50933ed29e23adba2dbd27eabc57baf7d26613324c0167125"}
Jul 28 19:30:09.660902 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:09.660890    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttffx" event={"ID":"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a","Type":"ContainerStarted","Data":"6757547f0fd824c9ccde9a6c9909bba700e4afc1b1511b3f6b98e3341e9ac2a2"}
Jul 28 19:30:09.661046 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:09.660936    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttffx" event={"ID":"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a","Type":"ContainerStarted","Data":"b64dbe14b174392afbd59f64280f0ae478062a9b22628faac036c21cbfab78c0"}
Jul 28 19:30:09.661046 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:09.661000    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttffx" event={"ID":"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a","Type":"ContainerStarted","Data":"40268b12dff14e7ba8960d2006848134a56bab02d73918417f5200a8ba0627a6"}
Jul 28 19:30:09.661135 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:09.661047    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttffx" event={"ID":"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a","Type":"ContainerStarted","Data":"0c0113a27a97cf93f74cec0b155deea75d69aeb11876b511a8840efa68c9bc66"}
Jul 28 19:30:09.662272 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:09.662249    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w2bkk" event={"ID":"673e4708-36af-4e9f-8157-d34e64c16ef8","Type":"ContainerStarted","Data":"d84dba2feed7bdfcc4339e30ccee582a3d5bd826c7d6f67062603af637fd0241"}
Jul 28 19:30:09.663849 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:09.663818    2570 generic.go:356] "Generic (PLEG): container finished" podID="e9322115-695d-40b0-92d0-fd38e1e99ee2" containerID="f3d4487ed9da43d1023997db808346a4f6938eb01c237656eb1abf31820ca8ac" exitCode=0
Jul 28 19:30:09.663940 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:09.663882    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sjp5l" event={"ID":"e9322115-695d-40b0-92d0-fd38e1e99ee2","Type":"ContainerDied","Data":"f3d4487ed9da43d1023997db808346a4f6938eb01c237656eb1abf31820ca8ac"}
Jul 28 19:30:09.665585 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:09.665543    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-msmdc" event={"ID":"d1744c82-4def-4eba-84c8-89528fef43f6","Type":"ContainerStarted","Data":"77b0c3fef9d2a54a5294c06488b3be452f3dce31f1bf022a28daf4305c6f95cb"}
Jul 28 19:30:09.667127 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:09.667111    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-62m88" event={"ID":"149aa37e-88c6-464c-91e4-e47ecdb9e3fc","Type":"ContainerStarted","Data":"1ac02b2d002e7fe0fd7543abc586f5ded9791b781962ac520b18050fa3c19e5c"}
Jul 28 19:30:09.670221 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:09.670183    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7dtx2" podStartSLOduration=4.268266563 podStartE2EDuration="22.67017031s" totalImagesPullingTime="18.401903747s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:29:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:30:09.66952482 +0000 UTC m=+22.621557151" watchObservedRunningTime="2026-07-28 19:30:09.67017031 +0000 UTC m=+22.622202639"
Jul 28 19:30:09.684179 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:09.684142    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-62m88" podStartSLOduration=4.287821569 podStartE2EDuration="22.684130188s" totalImagesPullingTime="18.396308619s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:29:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:30:09.683901181 +0000 UTC m=+22.635933514" watchObservedRunningTime="2026-07-28 19:30:09.684130188 +0000 UTC m=+22.636162517"
Jul 28 19:30:09.730222 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:09.730169    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xl9mh" podStartSLOduration=4.285233567 podStartE2EDuration="22.73015467s" totalImagesPullingTime="18.444921103s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:29:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:30:09.729930748 +0000 UTC m=+22.681963079" watchObservedRunningTime="2026-07-28 19:30:09.73015467 +0000 UTC m=+22.682187000"
Jul 28 19:30:09.746404 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:09.746351    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-msmdc" podStartSLOduration=4.354009377 podStartE2EDuration="22.746336244s" totalImagesPullingTime="18.392326867s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:29:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:30:09.745733335 +0000 UTC m=+22.697765689" watchObservedRunningTime="2026-07-28 19:30:09.746336244 +0000 UTC m=+22.698368573"
Jul 28 19:30:09.761342 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:09.761295    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-w2bkk" podStartSLOduration=4.363425472 podStartE2EDuration="22.761278684s" totalImagesPullingTime="18.397853212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:29:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:30:09.760557809 +0000 UTC m=+22.712590138" watchObservedRunningTime="2026-07-28 19:30:09.761278684 +0000 UTC m=+22.713311013"
Jul 28 19:30:10.396749 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:10.396718    2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 28 19:30:10.464341 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:10.464222    2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T19:30:10.396741411Z","UUID":"25fd6a80-329c-401b-a741-89a336f35ef5","Handler":null,"Name":"","Endpoint":""}
Jul 28 19:30:10.467410 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:10.467385    2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 28 19:30:10.467558 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:10.467433    2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 28 19:30:10.567197 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:10.567153    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dc8tz"
Jul 28 19:30:10.567604 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:10.567313    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dc8tz" podUID="42aea3ba-db99-4d52-b3a0-dfea4a5d436d"
Jul 28 19:30:10.671165 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:10.671127    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d44kh" event={"ID":"470cb015-80ed-44e2-a6ab-864b5b6dc967","Type":"ContainerStarted","Data":"cc04fd7a8a9d858de43944bc8ee17bf8041df55c04c7ae807b6e984a45246f0b"}
Jul 28 19:30:10.673234 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:10.673208    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zvlf" event={"ID":"555f2c2f-5529-4431-8b2c-70d81efc607c","Type":"ContainerStarted","Data":"80ae429fcba1400f8341a0ef5109b8fb91337bb2b1cab1de39c6083dd6ed5852"}
Jul 28 19:30:10.685717 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:10.685648    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-d44kh" podStartSLOduration=5.279841779 podStartE2EDuration="23.685635257s" totalImagesPullingTime="18.405793478s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:29:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:30:10.68550339 +0000 UTC m=+23.637535721" watchObservedRunningTime="2026-07-28 19:30:10.685635257 +0000 UTC m=+23.637667588"
Jul 28 19:30:11.567081 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:11.567054    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qqck"
Jul 28 19:30:11.567081 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:11.567073    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9dh6"
Jul 28 19:30:11.567263 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:11.567188    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qqck" podUID="e6ef696c-5387-4f59-9157-de961fedb6de"
Jul 28 19:30:11.567581 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:11.567345    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9dh6" podUID="ecf7120c-270a-4dd7-aa6e-3dc0cce3b533"
Jul 28 19:30:11.679452 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:11.679417    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttffx" event={"ID":"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a","Type":"ContainerStarted","Data":"e61c46cc04bb584388f154eeb64acf2b567f50224e9e8fce8ad563cb49dfebb5"}
Jul 28 19:30:11.681859 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:11.681821    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zvlf" event={"ID":"555f2c2f-5529-4431-8b2c-70d81efc607c","Type":"ContainerStarted","Data":"df50258a70eb1ce35d44769ff706a13ef8f31a1bfa7c5dbd7ff3a879e8973551"}
Jul 28 19:30:11.699003 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:11.698935    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zvlf" podStartSLOduration=4.129536498 podStartE2EDuration="24.698916252s" totalImagesPullingTime="20.569379754s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:29:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:30:11.698596694 +0000 UTC m=+24.650629024" watchObservedRunningTime="2026-07-28 19:30:11.698916252 +0000 UTC m=+24.650948585"
Jul 28 19:30:12.567305 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:12.567272    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dc8tz"
Jul 28 19:30:12.567767 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:12.567400    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dc8tz" podUID="42aea3ba-db99-4d52-b3a0-dfea4a5d436d"
Jul 28 19:30:12.933051 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:12.933011    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-w2bkk"
Jul 28 19:30:12.933603 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:12.933582    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-w2bkk"
Jul 28 19:30:13.567339 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:13.567076    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qqck"
Jul 28 19:30:13.567794 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:13.567136    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9dh6"
Jul 28 19:30:13.567794 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:13.567438    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qqck" podUID="e6ef696c-5387-4f59-9157-de961fedb6de"
Jul 28 19:30:13.567794 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:13.567499    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9dh6" podUID="ecf7120c-270a-4dd7-aa6e-3dc0cce3b533"
Jul 28 19:30:13.687731 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:13.687692    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-w2bkk"
Jul 28 19:30:13.688276 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:13.688250    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-w2bkk"
Jul 28 19:30:14.566727 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:14.566699    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dc8tz"
Jul 28 19:30:14.566925 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:14.566796    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dc8tz" podUID="42aea3ba-db99-4d52-b3a0-dfea4a5d436d"
Jul 28 19:30:14.693336 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:14.693300    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttffx" event={"ID":"62bde7e5-af62-4ebc-a4c5-cdd0d1b6ed9a","Type":"ContainerStarted","Data":"6491b6f4e60bf4a198151c69a2bb9b7448af7fce6621d68264f3bd49cafecc69"}
Jul 28 19:30:14.694045 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:14.693730    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:30:14.694045 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:14.693805    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:30:14.695298 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:14.695270    2570 generic.go:356] "Generic (PLEG): container finished" podID="e9322115-695d-40b0-92d0-fd38e1e99ee2" containerID="c2bcd02078ca2a123d1b56545e5bf32ce20c0f3acfc843d82d21e0892e1e1688" exitCode=0
Jul 28 19:30:14.695416 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:14.695356    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sjp5l" event={"ID":"e9322115-695d-40b0-92d0-fd38e1e99ee2","Type":"ContainerDied","Data":"c2bcd02078ca2a123d1b56545e5bf32ce20c0f3acfc843d82d21e0892e1e1688"}
Jul 28 19:30:14.708992 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:14.708960    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:30:14.709110 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:14.709099    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:30:14.718781 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:14.718743    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ttffx" podStartSLOduration=9.265011434 podStartE2EDuration="27.718730266s" totalImagesPullingTime="18.453718832s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:29:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:30:14.717372086 +0000 UTC m=+27.669404416" watchObservedRunningTime="2026-07-28 19:30:14.718730266 +0000 UTC m=+27.670762596"
Jul 28 19:30:15.566857 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:15.566830    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qqck"
Jul 28 19:30:15.567051 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:15.566940    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qqck" podUID="e6ef696c-5387-4f59-9157-de961fedb6de"
Jul 28 19:30:15.567177 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:15.567150    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9dh6"
Jul 28 19:30:15.567276 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:15.567258    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9dh6" podUID="ecf7120c-270a-4dd7-aa6e-3dc0cce3b533"
Jul 28 19:30:15.700211 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:15.700177    2570 generic.go:356] "Generic (PLEG): container finished" podID="e9322115-695d-40b0-92d0-fd38e1e99ee2" containerID="45a023fee38df3b19656f24b8c964321f3a965a326c4c8397e01497d58912f14" exitCode=0
Jul 28 19:30:15.700598 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:15.700260    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sjp5l" event={"ID":"e9322115-695d-40b0-92d0-fd38e1e99ee2","Type":"ContainerDied","Data":"45a023fee38df3b19656f24b8c964321f3a965a326c4c8397e01497d58912f14"}
Jul 28 19:30:15.700598 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:15.700366    2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 28 19:30:15.897327 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:15.897157    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m9dh6"]
Jul 28 19:30:15.897327 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:15.897274    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9dh6"
Jul 28 19:30:15.897632 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:15.897382    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9dh6" podUID="ecf7120c-270a-4dd7-aa6e-3dc0cce3b533"
Jul 28 19:30:15.897830 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:15.897812    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4qqck"]
Jul 28 19:30:15.897914 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:15.897900    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qqck"
Jul 28 19:30:15.898021 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:15.898003    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qqck" podUID="e6ef696c-5387-4f59-9157-de961fedb6de"
Jul 28 19:30:15.900243 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:15.900218    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dc8tz"]
Jul 28 19:30:15.900349 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:15.900316    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dc8tz"
Jul 28 19:30:15.900421 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:15.900404    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dc8tz" podUID="42aea3ba-db99-4d52-b3a0-dfea4a5d436d"
Jul 28 19:30:16.702620 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:16.702593    2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 28 19:30:17.568072 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:17.568036    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9dh6"
Jul 28 19:30:17.568263 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:17.568126    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9dh6" podUID="ecf7120c-270a-4dd7-aa6e-3dc0cce3b533"
Jul 28 19:30:17.568396 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:17.568166    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dc8tz"
Jul 28 19:30:17.571004 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:17.568680    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qqck"
Jul 28 19:30:17.571004 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:17.568802    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qqck" podUID="e6ef696c-5387-4f59-9157-de961fedb6de"
Jul 28 19:30:17.571004 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:17.568843    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dc8tz" podUID="42aea3ba-db99-4d52-b3a0-dfea4a5d436d"
Jul 28 19:30:17.572462 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:17.572445    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:30:17.707400 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:17.707366    2570 generic.go:356] "Generic (PLEG): container finished" podID="e9322115-695d-40b0-92d0-fd38e1e99ee2" containerID="1b7eb0a26c7e5f4bbc0a7b40e6aa2657dfe3012d1d02517e462a4262c20957c5" exitCode=0
Jul 28 19:30:17.707832 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:17.707442    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sjp5l" event={"ID":"e9322115-695d-40b0-92d0-fd38e1e99ee2","Type":"ContainerDied","Data":"1b7eb0a26c7e5f4bbc0a7b40e6aa2657dfe3012d1d02517e462a4262c20957c5"}
Jul 28 19:30:19.567053 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:19.566796    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qqck"
Jul 28 19:30:19.567532 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:19.566799    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dc8tz"
Jul 28 19:30:19.567532 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:19.567163    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qqck" podUID="e6ef696c-5387-4f59-9157-de961fedb6de"
Jul 28 19:30:19.567532 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:19.566843    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9dh6"
Jul 28 19:30:19.567532 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:19.567267    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dc8tz" podUID="42aea3ba-db99-4d52-b3a0-dfea4a5d436d"
Jul 28 19:30:19.567532 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:19.567369    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9dh6" podUID="ecf7120c-270a-4dd7-aa6e-3dc0cce3b533"
Jul 28 19:30:21.159821 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:21.159787    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42aea3ba-db99-4d52-b3a0-dfea4a5d436d-metrics-certs\") pod \"network-metrics-daemon-dc8tz\" (UID: \"42aea3ba-db99-4d52-b3a0-dfea4a5d436d\") " pod="openshift-multus/network-metrics-daemon-dc8tz"
Jul 28 19:30:21.160316 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:21.159835    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6ef696c-5387-4f59-9157-de961fedb6de-original-pull-secret\") pod \"global-pull-secret-syncer-4qqck\" (UID: \"e6ef696c-5387-4f59-9157-de961fedb6de\") " pod="kube-system/global-pull-secret-syncer-4qqck"
Jul 28 19:30:21.160316 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:21.159927    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 19:30:21.160316 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:21.159947    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:30:21.160316 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:21.160000    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6ef696c-5387-4f59-9157-de961fedb6de-original-pull-secret podName:e6ef696c-5387-4f59-9157-de961fedb6de nodeName:}" failed. No retries permitted until 2026-07-28 19:30:53.15996486 +0000 UTC m=+66.111997188 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e6ef696c-5387-4f59-9157-de961fedb6de-original-pull-secret") pod "global-pull-secret-syncer-4qqck" (UID: "e6ef696c-5387-4f59-9157-de961fedb6de") : object "kube-system"/"original-pull-secret" not registered
Jul 28 19:30:21.160316 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:21.160018    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42aea3ba-db99-4d52-b3a0-dfea4a5d436d-metrics-certs podName:42aea3ba-db99-4d52-b3a0-dfea4a5d436d nodeName:}" failed. No retries permitted until 2026-07-28 19:30:53.160008938 +0000 UTC m=+66.112041251 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42aea3ba-db99-4d52-b3a0-dfea4a5d436d-metrics-certs") pod "network-metrics-daemon-dc8tz" (UID: "42aea3ba-db99-4d52-b3a0-dfea4a5d436d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:30:21.362295 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:21.362026    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5w76\" (UniqueName: \"kubernetes.io/projected/ecf7120c-270a-4dd7-aa6e-3dc0cce3b533-kube-api-access-q5w76\") pod \"network-check-target-m9dh6\" (UID: \"ecf7120c-270a-4dd7-aa6e-3dc0cce3b533\") " pod="openshift-network-diagnostics/network-check-target-m9dh6"
Jul 28 19:30:21.362295 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:21.362184    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 19:30:21.362295 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:21.362203    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 19:30:21.362295 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:21.362216    2570 projected.go:196] Error preparing data for projected volume kube-api-access-q5w76 for pod openshift-network-diagnostics/network-check-target-m9dh6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:30:21.362295 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:21.362281    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecf7120c-270a-4dd7-aa6e-3dc0cce3b533-kube-api-access-q5w76 podName:ecf7120c-270a-4dd7-aa6e-3dc0cce3b533 nodeName:}" failed. No retries permitted until 2026-07-28 19:30:53.362261917 +0000 UTC m=+66.314294237 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-q5w76" (UniqueName: "kubernetes.io/projected/ecf7120c-270a-4dd7-aa6e-3dc0cce3b533-kube-api-access-q5w76") pod "network-check-target-m9dh6" (UID: "ecf7120c-270a-4dd7-aa6e-3dc0cce3b533") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:30:21.566638 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:21.566617    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9dh6"
Jul 28 19:30:21.566731 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:21.566619    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dc8tz"
Jul 28 19:30:21.566823 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:21.566736    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9dh6" podUID="ecf7120c-270a-4dd7-aa6e-3dc0cce3b533"
Jul 28 19:30:21.566823 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:21.566619    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qqck"
Jul 28 19:30:21.566908 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:21.566829    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dc8tz" podUID="42aea3ba-db99-4d52-b3a0-dfea4a5d436d"
Jul 28 19:30:21.566945 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:21.566914    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qqck" podUID="e6ef696c-5387-4f59-9157-de961fedb6de"
Jul 28 19:30:21.722053 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:21.722023    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sjp5l" event={"ID":"e9322115-695d-40b0-92d0-fd38e1e99ee2","Type":"ContainerStarted","Data":"52bc6b523326df6e712b38fc25c7455438ca55e50512797ac182e9aea95e8017"}
Jul 28 19:30:21.863411 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:21.863332    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-248.ec2.internal" event="NodeReady"
Jul 28 19:30:21.863544 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:21.863468    2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 28 19:30:21.903867 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:21.903831    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-djnj4"]
Jul 28 19:30:21.905786 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:21.905764    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-djnj4"
Jul 28 19:30:21.907119 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:21.907093    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5v2j9"]
Jul 28 19:30:21.908396 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:21.908375    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 28 19:30:21.908500 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:21.908428    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 28 19:30:21.908500 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:21.908387    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pwrtc\""
Jul 28 19:30:21.908890 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:21.908876    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5v2j9"
Jul 28 19:30:21.911170 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:21.911142    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 28 19:30:21.911281 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:21.911147    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-75bnq\""
Jul 28 19:30:21.911281 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:21.911147    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 28 19:30:21.911506 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:21.911493    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 28 19:30:21.916761 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:21.916738    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-djnj4"]
Jul 28 19:30:21.919837 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:21.919816    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5v2j9"]
Jul 28 19:30:22.066803 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:22.066770    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/874474d2-7dc6-411c-a19f-7bd31b13376d-tmp-dir\") pod \"dns-default-djnj4\" (UID: \"874474d2-7dc6-411c-a19f-7bd31b13376d\") " pod="openshift-dns/dns-default-djnj4"
Jul 28 19:30:22.066803 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:22.066804    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxr6h\" (UniqueName: \"kubernetes.io/projected/874474d2-7dc6-411c-a19f-7bd31b13376d-kube-api-access-wxr6h\") pod \"dns-default-djnj4\" (UID: \"874474d2-7dc6-411c-a19f-7bd31b13376d\") " pod="openshift-dns/dns-default-djnj4"
Jul 28 19:30:22.067062 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:22.066825    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/874474d2-7dc6-411c-a19f-7bd31b13376d-config-volume\") pod \"dns-default-djnj4\" (UID: \"874474d2-7dc6-411c-a19f-7bd31b13376d\") " pod="openshift-dns/dns-default-djnj4"
Jul 28 19:30:22.067062 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:22.066839    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bbf2a53c-71f8-469f-9fb4-d5aa608b3dbf-cert\") pod \"ingress-canary-5v2j9\" (UID: \"bbf2a53c-71f8-469f-9fb4-d5aa608b3dbf\") " pod="openshift-ingress-canary/ingress-canary-5v2j9"
Jul 28 19:30:22.067062 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:22.066862    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls95x\" (UniqueName: \"kubernetes.io/projected/bbf2a53c-71f8-469f-9fb4-d5aa608b3dbf-kube-api-access-ls95x\") pod \"ingress-canary-5v2j9\" (UID: \"bbf2a53c-71f8-469f-9fb4-d5aa608b3dbf\") " pod="openshift-ingress-canary/ingress-canary-5v2j9"
Jul 28 19:30:22.067062 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:22.066960    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/874474d2-7dc6-411c-a19f-7bd31b13376d-metrics-tls\") pod \"dns-default-djnj4\" (UID: \"874474d2-7dc6-411c-a19f-7bd31b13376d\") " pod="openshift-dns/dns-default-djnj4"
Jul 28 19:30:22.168186 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:22.168155    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/874474d2-7dc6-411c-a19f-7bd31b13376d-metrics-tls\") pod \"dns-default-djnj4\" (UID: \"874474d2-7dc6-411c-a19f-7bd31b13376d\") " pod="openshift-dns/dns-default-djnj4"
Jul 28 19:30:22.168893 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:22.168206    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/874474d2-7dc6-411c-a19f-7bd31b13376d-tmp-dir\") pod \"dns-default-djnj4\" (UID: \"874474d2-7dc6-411c-a19f-7bd31b13376d\") " pod="openshift-dns/dns-default-djnj4"
Jul 28 19:30:22.168893 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:22.168230    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxr6h\" (UniqueName: \"kubernetes.io/projected/874474d2-7dc6-411c-a19f-7bd31b13376d-kube-api-access-wxr6h\") pod \"dns-default-djnj4\" (UID: \"874474d2-7dc6-411c-a19f-7bd31b13376d\") " pod="openshift-dns/dns-default-djnj4"
Jul 28 19:30:22.168893 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:22.168259    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/874474d2-7dc6-411c-a19f-7bd31b13376d-config-volume\") pod \"dns-default-djnj4\" (UID: \"874474d2-7dc6-411c-a19f-7bd31b13376d\") " pod="openshift-dns/dns-default-djnj4"
Jul 28 19:30:22.168893 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:22.168281    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bbf2a53c-71f8-469f-9fb4-d5aa608b3dbf-cert\") pod \"ingress-canary-5v2j9\" (UID: \"bbf2a53c-71f8-469f-9fb4-d5aa608b3dbf\") " pod="openshift-ingress-canary/ingress-canary-5v2j9"
Jul 28 19:30:22.168893 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:22.168319    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 19:30:22.168893 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:22.168358    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls95x\" (UniqueName: \"kubernetes.io/projected/bbf2a53c-71f8-469f-9fb4-d5aa608b3dbf-kube-api-access-ls95x\") pod \"ingress-canary-5v2j9\" (UID: \"bbf2a53c-71f8-469f-9fb4-d5aa608b3dbf\") " pod="openshift-ingress-canary/ingress-canary-5v2j9"
Jul 28 19:30:22.168893 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:22.168386    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/874474d2-7dc6-411c-a19f-7bd31b13376d-metrics-tls podName:874474d2-7dc6-411c-a19f-7bd31b13376d nodeName:}" failed. No retries permitted until 2026-07-28 19:30:22.668363392 +0000 UTC m=+35.620395705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/874474d2-7dc6-411c-a19f-7bd31b13376d-metrics-tls") pod "dns-default-djnj4" (UID: "874474d2-7dc6-411c-a19f-7bd31b13376d") : secret "dns-default-metrics-tls" not found
Jul 28 19:30:22.168893 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:22.168572    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/874474d2-7dc6-411c-a19f-7bd31b13376d-tmp-dir\") pod \"dns-default-djnj4\" (UID: \"874474d2-7dc6-411c-a19f-7bd31b13376d\") " pod="openshift-dns/dns-default-djnj4"
Jul 28 19:30:22.168893 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:22.168826    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/874474d2-7dc6-411c-a19f-7bd31b13376d-config-volume\") pod \"dns-default-djnj4\" (UID: \"874474d2-7dc6-411c-a19f-7bd31b13376d\") " pod="openshift-dns/dns-default-djnj4"
Jul 28 19:30:22.172510 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:22.172487    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bbf2a53c-71f8-469f-9fb4-d5aa608b3dbf-cert\") pod \"ingress-canary-5v2j9\" (UID: \"bbf2a53c-71f8-469f-9fb4-d5aa608b3dbf\") " pod="openshift-ingress-canary/ingress-canary-5v2j9"
Jul 28 19:30:22.177894 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:22.177869    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxr6h\" (UniqueName: \"kubernetes.io/projected/874474d2-7dc6-411c-a19f-7bd31b13376d-kube-api-access-wxr6h\") pod \"dns-default-djnj4\" (UID: \"874474d2-7dc6-411c-a19f-7bd31b13376d\") " pod="openshift-dns/dns-default-djnj4"
Jul 28 19:30:22.178015 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:22.177995    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls95x\" (UniqueName: \"kubernetes.io/projected/bbf2a53c-71f8-469f-9fb4-d5aa608b3dbf-kube-api-access-ls95x\") pod \"ingress-canary-5v2j9\" (UID: \"bbf2a53c-71f8-469f-9fb4-d5aa608b3dbf\") " pod="openshift-ingress-canary/ingress-canary-5v2j9"
Jul 28 19:30:22.222093 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:22.222057    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5v2j9"
Jul 28 19:30:22.350616 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:22.350447    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5v2j9"]
Jul 28 19:30:22.353683 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:30:22.353654    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbf2a53c_71f8_469f_9fb4_d5aa608b3dbf.slice/crio-71872947ec80b4f26805c61a90a5cee0105e6202b745d7625ef8fbc6d77e5295 WatchSource:0}: Error finding container 71872947ec80b4f26805c61a90a5cee0105e6202b745d7625ef8fbc6d77e5295: Status 404 returned error can't find the container with id 71872947ec80b4f26805c61a90a5cee0105e6202b745d7625ef8fbc6d77e5295
Jul 28 19:30:22.672539 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:22.672505    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/874474d2-7dc6-411c-a19f-7bd31b13376d-metrics-tls\") pod \"dns-default-djnj4\" (UID: \"874474d2-7dc6-411c-a19f-7bd31b13376d\") " pod="openshift-dns/dns-default-djnj4"
Jul 28 19:30:22.672688 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:22.672653    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 19:30:22.672749 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:22.672718    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/874474d2-7dc6-411c-a19f-7bd31b13376d-metrics-tls podName:874474d2-7dc6-411c-a19f-7bd31b13376d nodeName:}" failed. No retries permitted until 2026-07-28 19:30:23.672699163 +0000 UTC m=+36.624731474 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/874474d2-7dc6-411c-a19f-7bd31b13376d-metrics-tls") pod "dns-default-djnj4" (UID: "874474d2-7dc6-411c-a19f-7bd31b13376d") : secret "dns-default-metrics-tls" not found
Jul 28 19:30:22.725607 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:22.725570    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5v2j9" event={"ID":"bbf2a53c-71f8-469f-9fb4-d5aa608b3dbf","Type":"ContainerStarted","Data":"71872947ec80b4f26805c61a90a5cee0105e6202b745d7625ef8fbc6d77e5295"}
Jul 28 19:30:22.728190 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:22.728166    2570 generic.go:356] "Generic (PLEG): container finished" podID="e9322115-695d-40b0-92d0-fd38e1e99ee2" containerID="52bc6b523326df6e712b38fc25c7455438ca55e50512797ac182e9aea95e8017" exitCode=0
Jul 28 19:30:22.728310 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:22.728205    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sjp5l" event={"ID":"e9322115-695d-40b0-92d0-fd38e1e99ee2","Type":"ContainerDied","Data":"52bc6b523326df6e712b38fc25c7455438ca55e50512797ac182e9aea95e8017"}
Jul 28 19:30:23.567064 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:23.567029    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qqck"
Jul 28 19:30:23.567064 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:23.567066    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9dh6"
Jul 28 19:30:23.567730 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:23.567029    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dc8tz"
Jul 28 19:30:23.570802 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:23.570782    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 19:30:23.570925 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:23.570849    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zz5d7\""
Jul 28 19:30:23.570925 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:23.570783    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 19:30:23.571067 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:23.570948    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 19:30:23.571116 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:23.571087    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b8krh\""
Jul 28 19:30:23.571176 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:23.571118    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 19:30:23.677922 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:23.677888    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/874474d2-7dc6-411c-a19f-7bd31b13376d-metrics-tls\") pod \"dns-default-djnj4\" (UID: \"874474d2-7dc6-411c-a19f-7bd31b13376d\") " pod="openshift-dns/dns-default-djnj4"
Jul 28 19:30:23.678121 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:23.678054    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 19:30:23.678185 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:23.678129    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/874474d2-7dc6-411c-a19f-7bd31b13376d-metrics-tls podName:874474d2-7dc6-411c-a19f-7bd31b13376d nodeName:}" failed. No retries permitted until 2026-07-28 19:30:25.678108677 +0000 UTC m=+38.630140985 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/874474d2-7dc6-411c-a19f-7bd31b13376d-metrics-tls") pod "dns-default-djnj4" (UID: "874474d2-7dc6-411c-a19f-7bd31b13376d") : secret "dns-default-metrics-tls" not found
Jul 28 19:30:23.733738 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:23.733702    2570 generic.go:356] "Generic (PLEG): container finished" podID="e9322115-695d-40b0-92d0-fd38e1e99ee2" containerID="18c88c584cafbc93d6402c99e4bf5ad83c7d9abcd70058fa06abafc0e10d9e5c" exitCode=0
Jul 28 19:30:23.733914 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:23.733764    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sjp5l" event={"ID":"e9322115-695d-40b0-92d0-fd38e1e99ee2","Type":"ContainerDied","Data":"18c88c584cafbc93d6402c99e4bf5ad83c7d9abcd70058fa06abafc0e10d9e5c"}
Jul 28 19:30:24.740624 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:24.740586    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sjp5l" event={"ID":"e9322115-695d-40b0-92d0-fd38e1e99ee2","Type":"ContainerStarted","Data":"59052bb4f5a25698e635c132eace7ff4ffe0db3a3d4247ed15dff3371fa55962"}
Jul 28 19:30:24.763094 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:24.763043    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-sjp5l" podStartSLOduration=9.355067275 podStartE2EDuration="37.763024538s" totalImagesPullingTime="28.407957263s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:29:47 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:30:24.761479247 +0000 UTC m=+37.713511579" watchObservedRunningTime="2026-07-28 19:30:24.763024538 +0000 UTC m=+37.715056887"
Jul 28 19:30:25.694224 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:25.694064    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/874474d2-7dc6-411c-a19f-7bd31b13376d-metrics-tls\") pod \"dns-default-djnj4\" (UID: \"874474d2-7dc6-411c-a19f-7bd31b13376d\") " pod="openshift-dns/dns-default-djnj4"
Jul 28 19:30:25.694353 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:25.694237    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 19:30:25.694353 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:25.694313    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/874474d2-7dc6-411c-a19f-7bd31b13376d-metrics-tls podName:874474d2-7dc6-411c-a19f-7bd31b13376d nodeName:}" failed. No retries permitted until 2026-07-28 19:30:29.694292821 +0000 UTC m=+42.646325155 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/874474d2-7dc6-411c-a19f-7bd31b13376d-metrics-tls") pod "dns-default-djnj4" (UID: "874474d2-7dc6-411c-a19f-7bd31b13376d") : secret "dns-default-metrics-tls" not found
Jul 28 19:30:25.744794 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:25.744760    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5v2j9" event={"ID":"bbf2a53c-71f8-469f-9fb4-d5aa608b3dbf","Type":"ContainerStarted","Data":"d1afe1f1bb8972684cebdd6da37067076f6d782f982b21f57236406c787d5516"}
Jul 28 19:30:25.760199 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:25.760151    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5v2j9" podStartSLOduration=1.516056164 podStartE2EDuration="4.76013532s" totalImagesPullingTime="3.244079156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:30:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:30:25.759688805 +0000 UTC m=+38.711721153" watchObservedRunningTime="2026-07-28 19:30:25.76013532 +0000 UTC m=+38.712167651"
Jul 28 19:30:29.721433 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:29.721389    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/874474d2-7dc6-411c-a19f-7bd31b13376d-metrics-tls\") pod \"dns-default-djnj4\" (UID: \"874474d2-7dc6-411c-a19f-7bd31b13376d\") " pod="openshift-dns/dns-default-djnj4"
Jul 28 19:30:29.721895 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:29.721536    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 19:30:29.721895 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:29.721597    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/874474d2-7dc6-411c-a19f-7bd31b13376d-metrics-tls podName:874474d2-7dc6-411c-a19f-7bd31b13376d nodeName:}" failed. No retries permitted until 2026-07-28 19:30:37.721581548 +0000 UTC m=+50.673613856 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/874474d2-7dc6-411c-a19f-7bd31b13376d-metrics-tls") pod "dns-default-djnj4" (UID: "874474d2-7dc6-411c-a19f-7bd31b13376d") : secret "dns-default-metrics-tls" not found
Jul 28 19:30:37.778008 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:37.777961    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/874474d2-7dc6-411c-a19f-7bd31b13376d-metrics-tls\") pod \"dns-default-djnj4\" (UID: \"874474d2-7dc6-411c-a19f-7bd31b13376d\") " pod="openshift-dns/dns-default-djnj4"
Jul 28 19:30:37.778456 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:37.778116    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 19:30:37.778456 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:37.778175    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/874474d2-7dc6-411c-a19f-7bd31b13376d-metrics-tls podName:874474d2-7dc6-411c-a19f-7bd31b13376d nodeName:}" failed. No retries permitted until 2026-07-28 19:30:53.778160396 +0000 UTC m=+66.730192704 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/874474d2-7dc6-411c-a19f-7bd31b13376d-metrics-tls") pod "dns-default-djnj4" (UID: "874474d2-7dc6-411c-a19f-7bd31b13376d") : secret "dns-default-metrics-tls" not found
Jul 28 19:30:47.727247 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:47.727213    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ttffx"
Jul 28 19:30:47.842300 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:47.842262    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c77dbf67d-gkm6h"]
Jul 28 19:30:47.861478 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:47.861454    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d456c49cf-b6bt5"]
Jul 28 19:30:47.861660 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:47.861619    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c77dbf67d-gkm6h"
Jul 28 19:30:47.864285 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:47.864263    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 28 19:30:47.864479 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:47.864463    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 28 19:30:47.864529 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:47.864495    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-zc5sr\""
Jul 28 19:30:47.864574 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:47.864540    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 28 19:30:47.864610 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:47.864572    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 28 19:30:47.873304 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:47.873284    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c77dbf67d-gkm6h"]
Jul 28 19:30:47.873396 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:47.873309    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d456c49cf-b6bt5"]
Jul 28 19:30:47.873396 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:47.873378    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d456c49cf-b6bt5"
Jul 28 19:30:47.875698 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:47.875681    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 28 19:30:47.875797 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:47.875723    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 28 19:30:47.875797 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:47.875739    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 28 19:30:47.875890 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:47.875817    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 28 19:30:48.052803 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:48.052714    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tptxw\" (UniqueName: \"kubernetes.io/projected/f5011d91-455e-4ec2-a747-f4a9379fb3ef-kube-api-access-tptxw\") pod \"managed-serviceaccount-addon-agent-5c77dbf67d-gkm6h\" (UID: \"f5011d91-455e-4ec2-a747-f4a9379fb3ef\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c77dbf67d-gkm6h"
Jul 28 19:30:48.052803 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:48.052756    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6h8z\" (UniqueName: \"kubernetes.io/projected/4f9d58b2-725d-45aa-bd76-4040e7b4dfa0-kube-api-access-k6h8z\") pod \"cluster-proxy-proxy-agent-7d456c49cf-b6bt5\" (UID: \"4f9d58b2-725d-45aa-bd76-4040e7b4dfa0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d456c49cf-b6bt5"
Jul 28 19:30:48.052803 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:48.052791    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4f9d58b2-725d-45aa-bd76-4040e7b4dfa0-ca\") pod \"cluster-proxy-proxy-agent-7d456c49cf-b6bt5\" (UID: \"4f9d58b2-725d-45aa-bd76-4040e7b4dfa0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d456c49cf-b6bt5"
Jul 28 19:30:48.053065 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:48.052809    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4f9d58b2-725d-45aa-bd76-4040e7b4dfa0-hub\") pod \"cluster-proxy-proxy-agent-7d456c49cf-b6bt5\" (UID: \"4f9d58b2-725d-45aa-bd76-4040e7b4dfa0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d456c49cf-b6bt5"
Jul 28 19:30:48.053065 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:48.052837    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f9d58b2-725d-45aa-bd76-4040e7b4dfa0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d456c49cf-b6bt5\" (UID: \"4f9d58b2-725d-45aa-bd76-4040e7b4dfa0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d456c49cf-b6bt5"
Jul 28 19:30:48.053065 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:48.052873    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4f9d58b2-725d-45aa-bd76-4040e7b4dfa0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d456c49cf-b6bt5\" (UID: \"4f9d58b2-725d-45aa-bd76-4040e7b4dfa0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d456c49cf-b6bt5"
Jul 28 19:30:48.053065 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:48.052900    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f5011d91-455e-4ec2-a747-f4a9379fb3ef-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5c77dbf67d-gkm6h\" (UID: \"f5011d91-455e-4ec2-a747-f4a9379fb3ef\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c77dbf67d-gkm6h"
Jul 28 19:30:48.053065 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:48.052932    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4f9d58b2-725d-45aa-bd76-4040e7b4dfa0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d456c49cf-b6bt5\" (UID: \"4f9d58b2-725d-45aa-bd76-4040e7b4dfa0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d456c49cf-b6bt5"
Jul 28 19:30:48.154069 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:48.154034    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4f9d58b2-725d-45aa-bd76-4040e7b4dfa0-ca\") pod \"cluster-proxy-proxy-agent-7d456c49cf-b6bt5\" (UID: \"4f9d58b2-725d-45aa-bd76-4040e7b4dfa0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d456c49cf-b6bt5"
Jul 28 19:30:48.154069 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:48.154072    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4f9d58b2-725d-45aa-bd76-4040e7b4dfa0-hub\") pod \"cluster-proxy-proxy-agent-7d456c49cf-b6bt5\" (UID: \"4f9d58b2-725d-45aa-bd76-4040e7b4dfa0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d456c49cf-b6bt5"
Jul 28 19:30:48.154249 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:48.154107    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f9d58b2-725d-45aa-bd76-4040e7b4dfa0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d456c49cf-b6bt5\" (UID: \"4f9d58b2-725d-45aa-bd76-4040e7b4dfa0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d456c49cf-b6bt5"
Jul 28 19:30:48.154249 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:48.154126    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4f9d58b2-725d-45aa-bd76-4040e7b4dfa0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d456c49cf-b6bt5\" (UID: \"4f9d58b2-725d-45aa-bd76-4040e7b4dfa0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d456c49cf-b6bt5"
Jul 28 19:30:48.154249 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:48.154155    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f5011d91-455e-4ec2-a747-f4a9379fb3ef-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5c77dbf67d-gkm6h\" (UID: \"f5011d91-455e-4ec2-a747-f4a9379fb3ef\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c77dbf67d-gkm6h"
Jul 28 19:30:48.154249 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:48.154191    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4f9d58b2-725d-45aa-bd76-4040e7b4dfa0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d456c49cf-b6bt5\" (UID: \"4f9d58b2-725d-45aa-bd76-4040e7b4dfa0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d456c49cf-b6bt5"
Jul 28 19:30:48.154249 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:48.154211    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tptxw\" (UniqueName: \"kubernetes.io/projected/f5011d91-455e-4ec2-a747-f4a9379fb3ef-kube-api-access-tptxw\") pod \"managed-serviceaccount-addon-agent-5c77dbf67d-gkm6h\" (UID: \"f5011d91-455e-4ec2-a747-f4a9379fb3ef\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c77dbf67d-gkm6h"
Jul 28 19:30:48.154249 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:48.154235    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6h8z\" (UniqueName: \"kubernetes.io/projected/4f9d58b2-725d-45aa-bd76-4040e7b4dfa0-kube-api-access-k6h8z\") pod \"cluster-proxy-proxy-agent-7d456c49cf-b6bt5\" (UID: \"4f9d58b2-725d-45aa-bd76-4040e7b4dfa0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d456c49cf-b6bt5"
Jul 28 19:30:48.154917 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:48.154885    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f9d58b2-725d-45aa-bd76-4040e7b4dfa0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d456c49cf-b6bt5\" (UID: \"4f9d58b2-725d-45aa-bd76-4040e7b4dfa0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d456c49cf-b6bt5"
Jul 28 19:30:48.158189 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:48.158166    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4f9d58b2-725d-45aa-bd76-4040e7b4dfa0-ca\") pod \"cluster-proxy-proxy-agent-7d456c49cf-b6bt5\" (UID: \"4f9d58b2-725d-45aa-bd76-4040e7b4dfa0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d456c49cf-b6bt5"
Jul 28 19:30:48.158289 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:48.158188    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f5011d91-455e-4ec2-a747-f4a9379fb3ef-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5c77dbf67d-gkm6h\" (UID: \"f5011d91-455e-4ec2-a747-f4a9379fb3ef\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c77dbf67d-gkm6h"
Jul 28 19:30:48.158289 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:48.158279    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4f9d58b2-725d-45aa-bd76-4040e7b4dfa0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d456c49cf-b6bt5\" (UID: \"4f9d58b2-725d-45aa-bd76-4040e7b4dfa0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d456c49cf-b6bt5"
Jul 28 19:30:48.158359 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:48.158286    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4f9d58b2-725d-45aa-bd76-4040e7b4dfa0-hub\") pod \"cluster-proxy-proxy-agent-7d456c49cf-b6bt5\" (UID: \"4f9d58b2-725d-45aa-bd76-4040e7b4dfa0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d456c49cf-b6bt5"
Jul 28 19:30:48.158359 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:48.158295    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4f9d58b2-725d-45aa-bd76-4040e7b4dfa0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d456c49cf-b6bt5\" (UID: \"4f9d58b2-725d-45aa-bd76-4040e7b4dfa0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d456c49cf-b6bt5"
Jul 28 19:30:48.162232 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:48.162213    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tptxw\" (UniqueName: \"kubernetes.io/projected/f5011d91-455e-4ec2-a747-f4a9379fb3ef-kube-api-access-tptxw\") pod \"managed-serviceaccount-addon-agent-5c77dbf67d-gkm6h\" (UID: \"f5011d91-455e-4ec2-a747-f4a9379fb3ef\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c77dbf67d-gkm6h"
Jul 28 19:30:48.162542 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:48.162520    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6h8z\" (UniqueName: \"kubernetes.io/projected/4f9d58b2-725d-45aa-bd76-4040e7b4dfa0-kube-api-access-k6h8z\") pod \"cluster-proxy-proxy-agent-7d456c49cf-b6bt5\" (UID: \"4f9d58b2-725d-45aa-bd76-4040e7b4dfa0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d456c49cf-b6bt5"
Jul 28 19:30:48.182323 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:48.182299    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c77dbf67d-gkm6h"
Jul 28 19:30:48.188595 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:48.188571    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d456c49cf-b6bt5"
Jul 28 19:30:48.360564 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:48.360526    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c77dbf67d-gkm6h"]
Jul 28 19:30:48.365271 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:30:48.365243    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5011d91_455e_4ec2_a747_f4a9379fb3ef.slice/crio-4416ebde3f451ec3a077e55d00e76828de4dc3c15434a3a49f94cfcaa78420bd WatchSource:0}: Error finding container 4416ebde3f451ec3a077e55d00e76828de4dc3c15434a3a49f94cfcaa78420bd: Status 404 returned error can't find the container with id 4416ebde3f451ec3a077e55d00e76828de4dc3c15434a3a49f94cfcaa78420bd
Jul 28 19:30:48.373562 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:48.373539    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d456c49cf-b6bt5"]
Jul 28 19:30:48.376882 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:30:48.376857    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f9d58b2_725d_45aa_bd76_4040e7b4dfa0.slice/crio-bc9dec771783f23ba0cfe06898d8c70a6bd3bcb254dd9cc70dc3eb25f28a8c32 WatchSource:0}: Error finding container bc9dec771783f23ba0cfe06898d8c70a6bd3bcb254dd9cc70dc3eb25f28a8c32: Status 404 returned error can't find the container with id bc9dec771783f23ba0cfe06898d8c70a6bd3bcb254dd9cc70dc3eb25f28a8c32
Jul 28 19:30:48.798588 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:48.798552    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d456c49cf-b6bt5" event={"ID":"4f9d58b2-725d-45aa-bd76-4040e7b4dfa0","Type":"ContainerStarted","Data":"bc9dec771783f23ba0cfe06898d8c70a6bd3bcb254dd9cc70dc3eb25f28a8c32"}
Jul 28 19:30:48.799608 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:48.799579    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c77dbf67d-gkm6h" event={"ID":"f5011d91-455e-4ec2-a747-f4a9379fb3ef","Type":"ContainerStarted","Data":"4416ebde3f451ec3a077e55d00e76828de4dc3c15434a3a49f94cfcaa78420bd"}
Jul 28 19:30:52.812692 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:52.812599    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c77dbf67d-gkm6h" event={"ID":"f5011d91-455e-4ec2-a747-f4a9379fb3ef","Type":"ContainerStarted","Data":"7f74a42a4cf01f4ad4cbf09aa7cbe73d72935c7cbcb4896091607429f95762a0"}
Jul 28 19:30:52.814650 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:52.814623    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d456c49cf-b6bt5" event={"ID":"4f9d58b2-725d-45aa-bd76-4040e7b4dfa0","Type":"ContainerStarted","Data":"ad124c9f541e2212f1fad7ad5bc54afa79f5ac386ab16e024b2190c5f53248d0"}
Jul 28 19:30:52.814791 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:52.814660    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d456c49cf-b6bt5" event={"ID":"4f9d58b2-725d-45aa-bd76-4040e7b4dfa0","Type":"ContainerStarted","Data":"915c01e301237fd34cf7d323efcca664b334346e86fd9080c07e5c88f8af45d2"}
Jul 28 19:30:52.814791 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:52.814672    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d456c49cf-b6bt5" event={"ID":"4f9d58b2-725d-45aa-bd76-4040e7b4dfa0","Type":"ContainerStarted","Data":"30b5e3d73d05387088de0f59a7ac32e20a4cf8ad7e092f6a5d841fe6419763b4"}
Jul 28 19:30:52.827265 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:52.827211    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c77dbf67d-gkm6h" podStartSLOduration=1.6719376879999999 podStartE2EDuration="5.827187818s" totalImagesPullingTime="4.15525013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:30:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:30:52.826635475 +0000 UTC m=+65.778667807" watchObservedRunningTime="2026-07-28 19:30:52.827187818 +0000 UTC m=+65.779220148"
Jul 28 19:30:52.844150 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:52.844104    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d456c49cf-b6bt5" podStartSLOduration=1.6886671149999999 podStartE2EDuration="5.844087547s" totalImagesPullingTime="4.155420432s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:30:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:30:52.843173237 +0000 UTC m=+65.795205569" watchObservedRunningTime="2026-07-28 19:30:52.844087547 +0000 UTC m=+65.796119876"
Jul 28 19:30:53.187288 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:53.187240    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42aea3ba-db99-4d52-b3a0-dfea4a5d436d-metrics-certs\") pod \"network-metrics-daemon-dc8tz\" (UID: \"42aea3ba-db99-4d52-b3a0-dfea4a5d436d\") " pod="openshift-multus/network-metrics-daemon-dc8tz"
Jul 28 19:30:53.187474 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:53.187315    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6ef696c-5387-4f59-9157-de961fedb6de-original-pull-secret\") pod \"global-pull-secret-syncer-4qqck\" (UID: \"e6ef696c-5387-4f59-9157-de961fedb6de\") " pod="kube-system/global-pull-secret-syncer-4qqck"
Jul 28 19:30:53.190125 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:53.190104    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 19:30:53.190217 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:53.190145    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 19:30:53.198269 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:53.198244    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 28 19:30:53.198373 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:53.198328    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42aea3ba-db99-4d52-b3a0-dfea4a5d436d-metrics-certs podName:42aea3ba-db99-4d52-b3a0-dfea4a5d436d nodeName:}" failed. No retries permitted until 2026-07-28 19:31:57.198305557 +0000 UTC m=+130.150337866 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42aea3ba-db99-4d52-b3a0-dfea4a5d436d-metrics-certs") pod "network-metrics-daemon-dc8tz" (UID: "42aea3ba-db99-4d52-b3a0-dfea4a5d436d") : secret "metrics-daemon-secret" not found
Jul 28 19:30:53.200374 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:53.200356    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6ef696c-5387-4f59-9157-de961fedb6de-original-pull-secret\") pod \"global-pull-secret-syncer-4qqck\" (UID: \"e6ef696c-5387-4f59-9157-de961fedb6de\") " pod="kube-system/global-pull-secret-syncer-4qqck"
Jul 28 19:30:53.279550 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:53.279499    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qqck"
Jul 28 19:30:53.388691 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:53.388656    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5w76\" (UniqueName: \"kubernetes.io/projected/ecf7120c-270a-4dd7-aa6e-3dc0cce3b533-kube-api-access-q5w76\") pod \"network-check-target-m9dh6\" (UID: \"ecf7120c-270a-4dd7-aa6e-3dc0cce3b533\") " pod="openshift-network-diagnostics/network-check-target-m9dh6"
Jul 28 19:30:53.391269 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:53.391251    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 19:30:53.397571 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:53.397549    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4qqck"]
Jul 28 19:30:53.400417 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:30:53.400388    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6ef696c_5387_4f59_9157_de961fedb6de.slice/crio-ca02dd424a9eb547e6ec9bcfb2bdfee06c2446daa043faafc668df3d0bc510da WatchSource:0}: Error finding container ca02dd424a9eb547e6ec9bcfb2bdfee06c2446daa043faafc668df3d0bc510da: Status 404 returned error can't find the container with id ca02dd424a9eb547e6ec9bcfb2bdfee06c2446daa043faafc668df3d0bc510da
Jul 28 19:30:53.401936 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:53.401883    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 19:30:53.412939 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:53.412916    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5w76\" (UniqueName: \"kubernetes.io/projected/ecf7120c-270a-4dd7-aa6e-3dc0cce3b533-kube-api-access-q5w76\") pod \"network-check-target-m9dh6\" (UID: \"ecf7120c-270a-4dd7-aa6e-3dc0cce3b533\") " pod="openshift-network-diagnostics/network-check-target-m9dh6"
Jul 28 19:30:53.592949 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:53.592871    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b8krh\""
Jul 28 19:30:53.600927 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:53.600906    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9dh6"
Jul 28 19:30:53.724174 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:53.724142    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m9dh6"]
Jul 28 19:30:53.728259 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:30:53.728229    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecf7120c_270a_4dd7_aa6e_3dc0cce3b533.slice/crio-7441c50db312cf62d1697019c7af659cb4df1df1d696fe1ef5d63a01e90574ed WatchSource:0}: Error finding container 7441c50db312cf62d1697019c7af659cb4df1df1d696fe1ef5d63a01e90574ed: Status 404 returned error can't find the container with id 7441c50db312cf62d1697019c7af659cb4df1df1d696fe1ef5d63a01e90574ed
Jul 28 19:30:53.790768 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:53.790730    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/874474d2-7dc6-411c-a19f-7bd31b13376d-metrics-tls\") pod \"dns-default-djnj4\" (UID: \"874474d2-7dc6-411c-a19f-7bd31b13376d\") " pod="openshift-dns/dns-default-djnj4"
Jul 28 19:30:53.790934 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:53.790880    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 19:30:53.791037 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:30:53.790952    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/874474d2-7dc6-411c-a19f-7bd31b13376d-metrics-tls podName:874474d2-7dc6-411c-a19f-7bd31b13376d nodeName:}" failed. No retries permitted until 2026-07-28 19:31:25.790934699 +0000 UTC m=+98.742967009 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/874474d2-7dc6-411c-a19f-7bd31b13376d-metrics-tls") pod "dns-default-djnj4" (UID: "874474d2-7dc6-411c-a19f-7bd31b13376d") : secret "dns-default-metrics-tls" not found
Jul 28 19:30:53.818482 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:53.818444    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m9dh6" event={"ID":"ecf7120c-270a-4dd7-aa6e-3dc0cce3b533","Type":"ContainerStarted","Data":"7441c50db312cf62d1697019c7af659cb4df1df1d696fe1ef5d63a01e90574ed"}
Jul 28 19:30:53.819701 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:53.819674    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4qqck" event={"ID":"e6ef696c-5387-4f59-9157-de961fedb6de","Type":"ContainerStarted","Data":"ca02dd424a9eb547e6ec9bcfb2bdfee06c2446daa043faafc668df3d0bc510da"}
Jul 28 19:30:58.835849 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:58.835810    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m9dh6" event={"ID":"ecf7120c-270a-4dd7-aa6e-3dc0cce3b533","Type":"ContainerStarted","Data":"27a6c9c1dd7be8563ef26ab7c011091791de3821841fad1fcc0d862ad87cb4bc"}
Jul 28 19:30:58.836448 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:58.835996    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-m9dh6"
Jul 28 19:30:58.837310 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:58.837288    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4qqck" event={"ID":"e6ef696c-5387-4f59-9157-de961fedb6de","Type":"ContainerStarted","Data":"04759d7a67d9f675218013cd64f5b562e846a0e88fac12aad10b0854bb8d1e98"}
Jul 28 19:30:58.852137 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:30:58.852091    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-m9dh6" podStartSLOduration=67.528425042 podStartE2EDuration="1m11.852076864s" totalImagesPullingTime="4.323651822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:29:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:30:58.850552572 +0000 UTC m=+71.802584933" watchObservedRunningTime="2026-07-28 19:30:58.852076864 +0000 UTC m=+71.804109215"
Jul 28 19:31:25.811844 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:31:25.811735    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/874474d2-7dc6-411c-a19f-7bd31b13376d-metrics-tls\") pod \"dns-default-djnj4\" (UID: \"874474d2-7dc6-411c-a19f-7bd31b13376d\") " pod="openshift-dns/dns-default-djnj4"
Jul 28 19:31:25.812380 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:31:25.811848    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 19:31:25.812380 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:31:25.811903    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/874474d2-7dc6-411c-a19f-7bd31b13376d-metrics-tls podName:874474d2-7dc6-411c-a19f-7bd31b13376d nodeName:}" failed. No retries permitted until 2026-07-28 19:32:29.811887267 +0000 UTC m=+162.763919575 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/874474d2-7dc6-411c-a19f-7bd31b13376d-metrics-tls") pod "dns-default-djnj4" (UID: "874474d2-7dc6-411c-a19f-7bd31b13376d") : secret "dns-default-metrics-tls" not found
Jul 28 19:31:29.842614 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:31:29.842578    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-m9dh6"
Jul 28 19:31:29.859758 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:31:29.859715    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4qqck" podStartSLOduration=98.204151812 podStartE2EDuration="1m42.859682209s" totalImagesPullingTime="4.655530397s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:29:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:30:58.864228702 +0000 UTC m=+71.816261056" watchObservedRunningTime="2026-07-28 19:31:29.859682209 +0000 UTC m=+102.811714537"
Jul 28 19:31:57.232679 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:31:57.232639    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42aea3ba-db99-4d52-b3a0-dfea4a5d436d-metrics-certs\") pod \"network-metrics-daemon-dc8tz\" (UID: \"42aea3ba-db99-4d52-b3a0-dfea4a5d436d\") " pod="openshift-multus/network-metrics-daemon-dc8tz"
Jul 28 19:31:57.233191 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:31:57.232754    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 28 19:31:57.233191 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:31:57.232812    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42aea3ba-db99-4d52-b3a0-dfea4a5d436d-metrics-certs podName:42aea3ba-db99-4d52-b3a0-dfea4a5d436d nodeName:}" failed. No retries permitted until 2026-07-28 19:33:59.232797611 +0000 UTC m=+252.184829919 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42aea3ba-db99-4d52-b3a0-dfea4a5d436d-metrics-certs") pod "network-metrics-daemon-dc8tz" (UID: "42aea3ba-db99-4d52-b3a0-dfea4a5d436d") : secret "metrics-daemon-secret" not found
Jul 28 19:32:24.915745 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:32:24.915685    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-djnj4" podUID="874474d2-7dc6-411c-a19f-7bd31b13376d"
Jul 28 19:32:25.081061 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:32:25.081030    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-djnj4"
Jul 28 19:32:26.585568 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:32:26.585522    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-dc8tz" podUID="42aea3ba-db99-4d52-b3a0-dfea4a5d436d"
Jul 28 19:32:29.867546 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:32:29.867507    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/874474d2-7dc6-411c-a19f-7bd31b13376d-metrics-tls\") pod \"dns-default-djnj4\" (UID: \"874474d2-7dc6-411c-a19f-7bd31b13376d\") " pod="openshift-dns/dns-default-djnj4"
Jul 28 19:32:29.868055 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:32:29.867625    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 19:32:29.868055 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:32:29.867690    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/874474d2-7dc6-411c-a19f-7bd31b13376d-metrics-tls podName:874474d2-7dc6-411c-a19f-7bd31b13376d nodeName:}" failed. No retries permitted until 2026-07-28 19:34:31.867673291 +0000 UTC m=+284.819705617 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/874474d2-7dc6-411c-a19f-7bd31b13376d-metrics-tls") pod "dns-default-djnj4" (UID: "874474d2-7dc6-411c-a19f-7bd31b13376d") : secret "dns-default-metrics-tls" not found
Jul 28 19:32:40.567430 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:32:40.567344    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dc8tz"
Jul 28 19:32:53.160682 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:32:53.160645    2570 generic.go:356] "Generic (PLEG): container finished" podID="f5011d91-455e-4ec2-a747-f4a9379fb3ef" containerID="7f74a42a4cf01f4ad4cbf09aa7cbe73d72935c7cbcb4896091607429f95762a0" exitCode=255
Jul 28 19:32:53.161074 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:32:53.160687    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c77dbf67d-gkm6h" event={"ID":"f5011d91-455e-4ec2-a747-f4a9379fb3ef","Type":"ContainerDied","Data":"7f74a42a4cf01f4ad4cbf09aa7cbe73d72935c7cbcb4896091607429f95762a0"}
Jul 28 19:32:53.161074 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:32:53.161009    2570 scope.go:117] "RemoveContainer" containerID="7f74a42a4cf01f4ad4cbf09aa7cbe73d72935c7cbcb4896091607429f95762a0"
Jul 28 19:32:54.164718 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:32:54.164678    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c77dbf67d-gkm6h" event={"ID":"f5011d91-455e-4ec2-a747-f4a9379fb3ef","Type":"ContainerStarted","Data":"aa29411b5fc7630d5e80632e4c221ac2cab5a0eb047d0de74520a675dff0c770"}
Jul 28 19:33:43.494922 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:43.494887    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hc5np"]
Jul 28 19:33:43.496906 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:43.496891    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hc5np"
Jul 28 19:33:43.502125 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:43.502105    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 28 19:33:43.502125 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:43.502117    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 28 19:33:43.503508 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:43.503487    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 28 19:33:43.503612 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:43.503531    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9sbqm\""
Jul 28 19:33:43.503612 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:43.503531    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 28 19:33:43.517466 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:43.517437    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hc5np"]
Jul 28 19:33:43.578928 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:43.578900    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e43e2c26-51ea-4924-a62d-257b690ca836-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hc5np\" (UID: \"e43e2c26-51ea-4924-a62d-257b690ca836\") " pod="openshift-insights/insights-runtime-extractor-hc5np"
Jul 28 19:33:43.578928 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:43.578930    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x9hd\" (UniqueName: \"kubernetes.io/projected/e43e2c26-51ea-4924-a62d-257b690ca836-kube-api-access-6x9hd\") pod \"insights-runtime-extractor-hc5np\" (UID: \"e43e2c26-51ea-4924-a62d-257b690ca836\") " pod="openshift-insights/insights-runtime-extractor-hc5np"
Jul 28 19:33:43.579137 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:43.578961    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e43e2c26-51ea-4924-a62d-257b690ca836-crio-socket\") pod \"insights-runtime-extractor-hc5np\" (UID: \"e43e2c26-51ea-4924-a62d-257b690ca836\") " pod="openshift-insights/insights-runtime-extractor-hc5np"
Jul 28 19:33:43.579137 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:43.579051    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e43e2c26-51ea-4924-a62d-257b690ca836-data-volume\") pod \"insights-runtime-extractor-hc5np\" (UID: \"e43e2c26-51ea-4924-a62d-257b690ca836\") " pod="openshift-insights/insights-runtime-extractor-hc5np"
Jul 28 19:33:43.579137 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:43.579079    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e43e2c26-51ea-4924-a62d-257b690ca836-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hc5np\" (UID: \"e43e2c26-51ea-4924-a62d-257b690ca836\") " pod="openshift-insights/insights-runtime-extractor-hc5np"
Jul 28 19:33:43.680160 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:43.680120    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e43e2c26-51ea-4924-a62d-257b690ca836-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hc5np\" (UID: \"e43e2c26-51ea-4924-a62d-257b690ca836\") " pod="openshift-insights/insights-runtime-extractor-hc5np"
Jul 28 19:33:43.680362 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:43.680205    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e43e2c26-51ea-4924-a62d-257b690ca836-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hc5np\" (UID: \"e43e2c26-51ea-4924-a62d-257b690ca836\") " pod="openshift-insights/insights-runtime-extractor-hc5np"
Jul 28 19:33:43.680362 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:33:43.680257    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 19:33:43.680362 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:33:43.680275    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 19:33:43.680362 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:33:43.680340    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e43e2c26-51ea-4924-a62d-257b690ca836-kube-rbac-proxy-cm podName:e43e2c26-51ea-4924-a62d-257b690ca836 nodeName:}" failed. No retries permitted until 2026-07-28 19:33:44.180323911 +0000 UTC m=+237.132356219 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e43e2c26-51ea-4924-a62d-257b690ca836-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hc5np" (UID: "e43e2c26-51ea-4924-a62d-257b690ca836") : configmap "kube-rbac-proxy" not found
Jul 28 19:33:43.680362 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:43.680353    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x9hd\" (UniqueName: \"kubernetes.io/projected/e43e2c26-51ea-4924-a62d-257b690ca836-kube-api-access-6x9hd\") pod \"insights-runtime-extractor-hc5np\" (UID: \"e43e2c26-51ea-4924-a62d-257b690ca836\") " pod="openshift-insights/insights-runtime-extractor-hc5np"
Jul 28 19:33:43.680575 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:43.680381    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e43e2c26-51ea-4924-a62d-257b690ca836-crio-socket\") pod \"insights-runtime-extractor-hc5np\" (UID: \"e43e2c26-51ea-4924-a62d-257b690ca836\") " pod="openshift-insights/insights-runtime-extractor-hc5np"
Jul 28 19:33:43.680575 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:43.680399    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e43e2c26-51ea-4924-a62d-257b690ca836-data-volume\") pod \"insights-runtime-extractor-hc5np\" (UID: \"e43e2c26-51ea-4924-a62d-257b690ca836\") " pod="openshift-insights/insights-runtime-extractor-hc5np"
Jul 28 19:33:43.680575 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:33:43.680424    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e43e2c26-51ea-4924-a62d-257b690ca836-insights-runtime-extractor-tls podName:e43e2c26-51ea-4924-a62d-257b690ca836 nodeName:}" failed. No retries permitted until 2026-07-28 19:33:44.180403747 +0000 UTC m=+237.132436074 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e43e2c26-51ea-4924-a62d-257b690ca836-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hc5np" (UID: "e43e2c26-51ea-4924-a62d-257b690ca836") : secret "insights-runtime-extractor-tls" not found
Jul 28 19:33:43.680575 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:43.680524    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e43e2c26-51ea-4924-a62d-257b690ca836-crio-socket\") pod \"insights-runtime-extractor-hc5np\" (UID: \"e43e2c26-51ea-4924-a62d-257b690ca836\") " pod="openshift-insights/insights-runtime-extractor-hc5np"
Jul 28 19:33:43.680734 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:43.680715    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e43e2c26-51ea-4924-a62d-257b690ca836-data-volume\") pod \"insights-runtime-extractor-hc5np\" (UID: \"e43e2c26-51ea-4924-a62d-257b690ca836\") " pod="openshift-insights/insights-runtime-extractor-hc5np"
Jul 28 19:33:43.688626 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:43.688601    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x9hd\" (UniqueName: \"kubernetes.io/projected/e43e2c26-51ea-4924-a62d-257b690ca836-kube-api-access-6x9hd\") pod \"insights-runtime-extractor-hc5np\" (UID: \"e43e2c26-51ea-4924-a62d-257b690ca836\") " pod="openshift-insights/insights-runtime-extractor-hc5np"
Jul 28 19:33:44.183395 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:44.183358    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e43e2c26-51ea-4924-a62d-257b690ca836-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hc5np\" (UID: \"e43e2c26-51ea-4924-a62d-257b690ca836\") " pod="openshift-insights/insights-runtime-extractor-hc5np"
Jul 28 19:33:44.183598 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:44.183428    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e43e2c26-51ea-4924-a62d-257b690ca836-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hc5np\" (UID: \"e43e2c26-51ea-4924-a62d-257b690ca836\") " pod="openshift-insights/insights-runtime-extractor-hc5np"
Jul 28 19:33:44.183598 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:33:44.183486    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 19:33:44.183598 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:33:44.183519    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 19:33:44.183598 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:33:44.183546    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e43e2c26-51ea-4924-a62d-257b690ca836-kube-rbac-proxy-cm podName:e43e2c26-51ea-4924-a62d-257b690ca836 nodeName:}" failed. No retries permitted until 2026-07-28 19:33:45.183530363 +0000 UTC m=+238.135562672 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e43e2c26-51ea-4924-a62d-257b690ca836-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hc5np" (UID: "e43e2c26-51ea-4924-a62d-257b690ca836") : configmap "kube-rbac-proxy" not found
Jul 28 19:33:44.183598 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:33:44.183572    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e43e2c26-51ea-4924-a62d-257b690ca836-insights-runtime-extractor-tls podName:e43e2c26-51ea-4924-a62d-257b690ca836 nodeName:}" failed. No retries permitted until 2026-07-28 19:33:45.183558903 +0000 UTC m=+238.135591212 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e43e2c26-51ea-4924-a62d-257b690ca836-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hc5np" (UID: "e43e2c26-51ea-4924-a62d-257b690ca836") : secret "insights-runtime-extractor-tls" not found
Jul 28 19:33:45.190146 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:45.190100    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e43e2c26-51ea-4924-a62d-257b690ca836-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hc5np\" (UID: \"e43e2c26-51ea-4924-a62d-257b690ca836\") " pod="openshift-insights/insights-runtime-extractor-hc5np"
Jul 28 19:33:45.190146 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:45.190161    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e43e2c26-51ea-4924-a62d-257b690ca836-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hc5np\" (UID: \"e43e2c26-51ea-4924-a62d-257b690ca836\") " pod="openshift-insights/insights-runtime-extractor-hc5np"
Jul 28 19:33:45.190588 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:33:45.190236    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 19:33:45.190588 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:33:45.190273    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 19:33:45.190588 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:33:45.190316    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e43e2c26-51ea-4924-a62d-257b690ca836-insights-runtime-extractor-tls podName:e43e2c26-51ea-4924-a62d-257b690ca836 nodeName:}" failed. No retries permitted until 2026-07-28 19:33:47.190298065 +0000 UTC m=+240.142330373 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e43e2c26-51ea-4924-a62d-257b690ca836-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hc5np" (UID: "e43e2c26-51ea-4924-a62d-257b690ca836") : secret "insights-runtime-extractor-tls" not found
Jul 28 19:33:45.190588 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:33:45.190332    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e43e2c26-51ea-4924-a62d-257b690ca836-kube-rbac-proxy-cm podName:e43e2c26-51ea-4924-a62d-257b690ca836 nodeName:}" failed. No retries permitted until 2026-07-28 19:33:47.190323651 +0000 UTC m=+240.142355958 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e43e2c26-51ea-4924-a62d-257b690ca836-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hc5np" (UID: "e43e2c26-51ea-4924-a62d-257b690ca836") : configmap "kube-rbac-proxy" not found
Jul 28 19:33:45.472114 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:45.472036    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-msmdc_d1744c82-4def-4eba-84c8-89528fef43f6/dns-node-resolver/0.log"
Jul 28 19:33:46.270916 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:46.270887    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7dtx2_b06b9cd0-9672-452d-b310-bcbb04b7a3d9/node-ca/0.log"
Jul 28 19:33:47.073563 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:47.073512    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5v2j9_bbf2a53c-71f8-469f-9fb4-d5aa608b3dbf/serve-healthcheck-canary/0.log"
Jul 28 19:33:47.205760 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:47.205708    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e43e2c26-51ea-4924-a62d-257b690ca836-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hc5np\" (UID: \"e43e2c26-51ea-4924-a62d-257b690ca836\") " pod="openshift-insights/insights-runtime-extractor-hc5np"
Jul 28 19:33:47.205966 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:47.205799    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e43e2c26-51ea-4924-a62d-257b690ca836-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hc5np\" (UID: \"e43e2c26-51ea-4924-a62d-257b690ca836\") " pod="openshift-insights/insights-runtime-extractor-hc5np"
Jul 28 19:33:47.205966 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:33:47.205863    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 19:33:47.205966 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:33:47.205879    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 19:33:47.205966 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:33:47.205929    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e43e2c26-51ea-4924-a62d-257b690ca836-kube-rbac-proxy-cm podName:e43e2c26-51ea-4924-a62d-257b690ca836 nodeName:}" failed. No retries permitted until 2026-07-28 19:33:51.205910978 +0000 UTC m=+244.157943286 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e43e2c26-51ea-4924-a62d-257b690ca836-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hc5np" (UID: "e43e2c26-51ea-4924-a62d-257b690ca836") : configmap "kube-rbac-proxy" not found
Jul 28 19:33:47.206161 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:33:47.206026    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e43e2c26-51ea-4924-a62d-257b690ca836-insights-runtime-extractor-tls podName:e43e2c26-51ea-4924-a62d-257b690ca836 nodeName:}" failed. No retries permitted until 2026-07-28 19:33:51.20600611 +0000 UTC m=+244.158038430 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e43e2c26-51ea-4924-a62d-257b690ca836-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hc5np" (UID: "e43e2c26-51ea-4924-a62d-257b690ca836") : secret "insights-runtime-extractor-tls" not found
Jul 28 19:33:51.235015 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:51.234957    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e43e2c26-51ea-4924-a62d-257b690ca836-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hc5np\" (UID: \"e43e2c26-51ea-4924-a62d-257b690ca836\") " pod="openshift-insights/insights-runtime-extractor-hc5np"
Jul 28 19:33:51.235458 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:51.235064    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e43e2c26-51ea-4924-a62d-257b690ca836-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hc5np\" (UID: \"e43e2c26-51ea-4924-a62d-257b690ca836\") " pod="openshift-insights/insights-runtime-extractor-hc5np"
Jul 28 19:33:51.235458 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:33:51.235109    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 19:33:51.235458 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:33:51.235151    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 19:33:51.235458 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:33:51.235182    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e43e2c26-51ea-4924-a62d-257b690ca836-insights-runtime-extractor-tls podName:e43e2c26-51ea-4924-a62d-257b690ca836 nodeName:}" failed. No retries permitted until 2026-07-28 19:33:59.23516706 +0000 UTC m=+252.187199368 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e43e2c26-51ea-4924-a62d-257b690ca836-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hc5np" (UID: "e43e2c26-51ea-4924-a62d-257b690ca836") : secret "insights-runtime-extractor-tls" not found
Jul 28 19:33:51.235458 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:33:51.235210    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e43e2c26-51ea-4924-a62d-257b690ca836-kube-rbac-proxy-cm podName:e43e2c26-51ea-4924-a62d-257b690ca836 nodeName:}" failed. No retries permitted until 2026-07-28 19:33:59.235194704 +0000 UTC m=+252.187227011 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e43e2c26-51ea-4924-a62d-257b690ca836-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hc5np" (UID: "e43e2c26-51ea-4924-a62d-257b690ca836") : configmap "kube-rbac-proxy" not found
Jul 28 19:33:59.293956 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:59.293913    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e43e2c26-51ea-4924-a62d-257b690ca836-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hc5np\" (UID: \"e43e2c26-51ea-4924-a62d-257b690ca836\") " pod="openshift-insights/insights-runtime-extractor-hc5np"
Jul 28 19:33:59.294378 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:59.293998    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42aea3ba-db99-4d52-b3a0-dfea4a5d436d-metrics-certs\") pod \"network-metrics-daemon-dc8tz\" (UID: \"42aea3ba-db99-4d52-b3a0-dfea4a5d436d\") " pod="openshift-multus/network-metrics-daemon-dc8tz"
Jul 28 19:33:59.294378 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:59.294033    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e43e2c26-51ea-4924-a62d-257b690ca836-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hc5np\" (UID: \"e43e2c26-51ea-4924-a62d-257b690ca836\") " pod="openshift-insights/insights-runtime-extractor-hc5np"
Jul 28 19:33:59.294378 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:33:59.294098    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 19:33:59.294378 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:33:59.294170    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e43e2c26-51ea-4924-a62d-257b690ca836-insights-runtime-extractor-tls podName:e43e2c26-51ea-4924-a62d-257b690ca836 nodeName:}" failed. No retries permitted until 2026-07-28 19:34:15.29415247 +0000 UTC m=+268.246184777 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e43e2c26-51ea-4924-a62d-257b690ca836-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hc5np" (UID: "e43e2c26-51ea-4924-a62d-257b690ca836") : secret "insights-runtime-extractor-tls" not found
Jul 28 19:33:59.294710 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:59.294690    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e43e2c26-51ea-4924-a62d-257b690ca836-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hc5np\" (UID: \"e43e2c26-51ea-4924-a62d-257b690ca836\") " pod="openshift-insights/insights-runtime-extractor-hc5np"
Jul 28 19:33:59.296339 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:59.296319    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42aea3ba-db99-4d52-b3a0-dfea4a5d436d-metrics-certs\") pod \"network-metrics-daemon-dc8tz\" (UID: \"42aea3ba-db99-4d52-b3a0-dfea4a5d436d\") " pod="openshift-multus/network-metrics-daemon-dc8tz"
Jul 28 19:33:59.470697 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:59.470667    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zz5d7\""
Jul 28 19:33:59.478785 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:59.478758    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dc8tz"
Jul 28 19:33:59.598764 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:33:59.598708    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dc8tz"]
Jul 28 19:33:59.601851 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:33:59.601822    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42aea3ba_db99_4d52_b3a0_dfea4a5d436d.slice/crio-2e142e6cca86fd4b950c52073264b63f72eb551b913b659290f1c34f3d9f44b7 WatchSource:0}: Error finding container 2e142e6cca86fd4b950c52073264b63f72eb551b913b659290f1c34f3d9f44b7: Status 404 returned error can't find the container with id 2e142e6cca86fd4b950c52073264b63f72eb551b913b659290f1c34f3d9f44b7
Jul 28 19:34:00.348478 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:00.348435    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dc8tz" event={"ID":"42aea3ba-db99-4d52-b3a0-dfea4a5d436d","Type":"ContainerStarted","Data":"2e142e6cca86fd4b950c52073264b63f72eb551b913b659290f1c34f3d9f44b7"}
Jul 28 19:34:01.353406 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:01.353365    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dc8tz" event={"ID":"42aea3ba-db99-4d52-b3a0-dfea4a5d436d","Type":"ContainerStarted","Data":"5be6fe980fe4ebc4f246f8792e425750c3980aefafe97ecf3d76516d351858e0"}
Jul 28 19:34:01.353792 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:01.353418    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dc8tz" event={"ID":"42aea3ba-db99-4d52-b3a0-dfea4a5d436d","Type":"ContainerStarted","Data":"80fd27e67da39e7a41529e6ee5875f9615f902458d01037603e9b04b4e409a1d"}
Jul 28 19:34:01.369032 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:01.368967    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dc8tz" podStartSLOduration=253.584345639 podStartE2EDuration="4m14.368951211s" totalImagesPullingTime="784.605572ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:29:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:34:01.367782933 +0000 UTC m=+254.319815304" watchObservedRunningTime="2026-07-28 19:34:01.368951211 +0000 UTC m=+254.320983541"
Jul 28 19:34:07.253943 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:07.253905    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-659fddc559-z465b"]
Jul 28 19:34:07.256055 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:07.256039    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-659fddc559-z465b"
Jul 28 19:34:07.260612 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:07.260587    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 28 19:34:07.260738 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:07.260646    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 28 19:34:07.261708 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:07.261685    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 28 19:34:07.261825 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:07.261687    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5qrcf\""
Jul 28 19:34:07.266340 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:07.266320    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 28 19:34:07.272787 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:07.272769    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-659fddc559-z465b"]
Jul 28 19:34:07.353385 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:07.353346    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bcbd5685-8540-4327-9141-3d01e32b41fd-installation-pull-secrets\") pod \"image-registry-659fddc559-z465b\" (UID: \"bcbd5685-8540-4327-9141-3d01e32b41fd\") " pod="openshift-image-registry/image-registry-659fddc559-z465b"
Jul 28 19:34:07.353385 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:07.353387    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd8wn\" (UniqueName: \"kubernetes.io/projected/bcbd5685-8540-4327-9141-3d01e32b41fd-kube-api-access-kd8wn\") pod \"image-registry-659fddc559-z465b\" (UID: \"bcbd5685-8540-4327-9141-3d01e32b41fd\") " pod="openshift-image-registry/image-registry-659fddc559-z465b"
Jul 28 19:34:07.353617 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:07.353422    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bcbd5685-8540-4327-9141-3d01e32b41fd-registry-tls\") pod \"image-registry-659fddc559-z465b\" (UID: \"bcbd5685-8540-4327-9141-3d01e32b41fd\") " pod="openshift-image-registry/image-registry-659fddc559-z465b"
Jul 28 19:34:07.353617 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:07.353456    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bcbd5685-8540-4327-9141-3d01e32b41fd-image-registry-private-configuration\") pod \"image-registry-659fddc559-z465b\" (UID: \"bcbd5685-8540-4327-9141-3d01e32b41fd\") " pod="openshift-image-registry/image-registry-659fddc559-z465b"
Jul 28 19:34:07.353617 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:07.353532    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bcbd5685-8540-4327-9141-3d01e32b41fd-ca-trust-extracted\") pod \"image-registry-659fddc559-z465b\" (UID: \"bcbd5685-8540-4327-9141-3d01e32b41fd\") " pod="openshift-image-registry/image-registry-659fddc559-z465b"
Jul 28 19:34:07.353617 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:07.353607    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bcbd5685-8540-4327-9141-3d01e32b41fd-bound-sa-token\") pod \"image-registry-659fddc559-z465b\" (UID: \"bcbd5685-8540-4327-9141-3d01e32b41fd\") " pod="openshift-image-registry/image-registry-659fddc559-z465b"
Jul 28 19:34:07.353765 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:07.353637    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bcbd5685-8540-4327-9141-3d01e32b41fd-registry-certificates\") pod \"image-registry-659fddc559-z465b\" (UID: \"bcbd5685-8540-4327-9141-3d01e32b41fd\") " pod="openshift-image-registry/image-registry-659fddc559-z465b"
Jul 28 19:34:07.353765 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:07.353660    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bcbd5685-8540-4327-9141-3d01e32b41fd-trusted-ca\") pod \"image-registry-659fddc559-z465b\" (UID: \"bcbd5685-8540-4327-9141-3d01e32b41fd\") " pod="openshift-image-registry/image-registry-659fddc559-z465b"
Jul 28 19:34:07.454326 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:07.454294    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bcbd5685-8540-4327-9141-3d01e32b41fd-registry-tls\") pod \"image-registry-659fddc559-z465b\" (UID: \"bcbd5685-8540-4327-9141-3d01e32b41fd\") " pod="openshift-image-registry/image-registry-659fddc559-z465b"
Jul 28 19:34:07.454490 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:07.454331    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bcbd5685-8540-4327-9141-3d01e32b41fd-image-registry-private-configuration\") pod \"image-registry-659fddc559-z465b\" (UID: \"bcbd5685-8540-4327-9141-3d01e32b41fd\") " pod="openshift-image-registry/image-registry-659fddc559-z465b"
Jul 28 19:34:07.454490 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:07.454376    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bcbd5685-8540-4327-9141-3d01e32b41fd-ca-trust-extracted\") pod \"image-registry-659fddc559-z465b\" (UID: \"bcbd5685-8540-4327-9141-3d01e32b41fd\") " pod="openshift-image-registry/image-registry-659fddc559-z465b"
Jul 28 19:34:07.454560 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:07.454503    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bcbd5685-8540-4327-9141-3d01e32b41fd-bound-sa-token\") pod \"image-registry-659fddc559-z465b\" (UID: \"bcbd5685-8540-4327-9141-3d01e32b41fd\") " pod="openshift-image-registry/image-registry-659fddc559-z465b"
Jul 28 19:34:07.454560 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:07.454544    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bcbd5685-8540-4327-9141-3d01e32b41fd-registry-certificates\") pod \"image-registry-659fddc559-z465b\" (UID: \"bcbd5685-8540-4327-9141-3d01e32b41fd\") " pod="openshift-image-registry/image-registry-659fddc559-z465b"
Jul 28 19:34:07.454654 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:07.454573    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bcbd5685-8540-4327-9141-3d01e32b41fd-trusted-ca\") pod \"image-registry-659fddc559-z465b\" (UID: \"bcbd5685-8540-4327-9141-3d01e32b41fd\") " pod="openshift-image-registry/image-registry-659fddc559-z465b"
Jul 28 19:34:07.455081 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:07.455004    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bcbd5685-8540-4327-9141-3d01e32b41fd-installation-pull-secrets\") pod \"image-registry-659fddc559-z465b\" (UID: \"bcbd5685-8540-4327-9141-3d01e32b41fd\") " pod="openshift-image-registry/image-registry-659fddc559-z465b"
Jul 28 19:34:07.455081 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:07.455054    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd8wn\" (UniqueName: \"kubernetes.io/projected/bcbd5685-8540-4327-9141-3d01e32b41fd-kube-api-access-kd8wn\") pod \"image-registry-659fddc559-z465b\" (UID: \"bcbd5685-8540-4327-9141-3d01e32b41fd\") " pod="openshift-image-registry/image-registry-659fddc559-z465b"
Jul 28 19:34:07.455266 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:07.455252    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bcbd5685-8540-4327-9141-3d01e32b41fd-ca-trust-extracted\") pod \"image-registry-659fddc559-z465b\" (UID: \"bcbd5685-8540-4327-9141-3d01e32b41fd\") " pod="openshift-image-registry/image-registry-659fddc559-z465b"
Jul 28 19:34:07.455969 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:07.455944    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bcbd5685-8540-4327-9141-3d01e32b41fd-registry-certificates\") pod \"image-registry-659fddc559-z465b\" (UID: \"bcbd5685-8540-4327-9141-3d01e32b41fd\") " pod="openshift-image-registry/image-registry-659fddc559-z465b"
Jul 28 19:34:07.460021 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:07.457653    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bcbd5685-8540-4327-9141-3d01e32b41fd-registry-tls\") pod \"image-registry-659fddc559-z465b\" (UID: \"bcbd5685-8540-4327-9141-3d01e32b41fd\") " pod="openshift-image-registry/image-registry-659fddc559-z465b"
Jul 28 19:34:07.460021 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:07.458494    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bcbd5685-8540-4327-9141-3d01e32b41fd-installation-pull-secrets\") pod \"image-registry-659fddc559-z465b\" (UID: \"bcbd5685-8540-4327-9141-3d01e32b41fd\") " pod="openshift-image-registry/image-registry-659fddc559-z465b"
Jul 28 19:34:07.460580 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:07.460560    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bcbd5685-8540-4327-9141-3d01e32b41fd-trusted-ca\") pod \"image-registry-659fddc559-z465b\" (UID: \"bcbd5685-8540-4327-9141-3d01e32b41fd\") " pod="openshift-image-registry/image-registry-659fddc559-z465b"
Jul 28 19:34:07.460729 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:07.460712    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bcbd5685-8540-4327-9141-3d01e32b41fd-image-registry-private-configuration\") pod \"image-registry-659fddc559-z465b\" (UID: \"bcbd5685-8540-4327-9141-3d01e32b41fd\") " pod="openshift-image-registry/image-registry-659fddc559-z465b"
Jul 28 19:34:07.465266 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:07.465242    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bcbd5685-8540-4327-9141-3d01e32b41fd-bound-sa-token\") pod \"image-registry-659fddc559-z465b\" (UID: \"bcbd5685-8540-4327-9141-3d01e32b41fd\") " pod="openshift-image-registry/image-registry-659fddc559-z465b"
Jul 28 19:34:07.465367 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:07.465350    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd8wn\" (UniqueName: \"kubernetes.io/projected/bcbd5685-8540-4327-9141-3d01e32b41fd-kube-api-access-kd8wn\") pod \"image-registry-659fddc559-z465b\" (UID: \"bcbd5685-8540-4327-9141-3d01e32b41fd\") " pod="openshift-image-registry/image-registry-659fddc559-z465b"
Jul 28 19:34:07.564865 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:07.564768    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-659fddc559-z465b"
Jul 28 19:34:07.688699 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:07.688669    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-659fddc559-z465b"]
Jul 28 19:34:07.692114 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:34:07.692075    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcbd5685_8540_4327_9141_3d01e32b41fd.slice/crio-d0949223f21cd44c75b6d7a6f0ed1fc676044d5a476881b1b3f598675886d3a7 WatchSource:0}: Error finding container d0949223f21cd44c75b6d7a6f0ed1fc676044d5a476881b1b3f598675886d3a7: Status 404 returned error can't find the container with id d0949223f21cd44c75b6d7a6f0ed1fc676044d5a476881b1b3f598675886d3a7
Jul 28 19:34:08.375127 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:08.375095    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-659fddc559-z465b" event={"ID":"bcbd5685-8540-4327-9141-3d01e32b41fd","Type":"ContainerStarted","Data":"dc72ff21f8ad26ebb33bb22eedba0631dbbd4606b1085ce8dea28dd46d68981c"}
Jul 28 19:34:08.375624 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:08.375141    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-659fddc559-z465b" event={"ID":"bcbd5685-8540-4327-9141-3d01e32b41fd","Type":"ContainerStarted","Data":"d0949223f21cd44c75b6d7a6f0ed1fc676044d5a476881b1b3f598675886d3a7"}
Jul 28 19:34:08.375624 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:08.375247    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-659fddc559-z465b"
Jul 28 19:34:08.395361 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:08.395312    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-659fddc559-z465b" podStartSLOduration=1.395295152 podStartE2EDuration="1.395295152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:34:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:34:08.393698292 +0000 UTC m=+261.345730677" watchObservedRunningTime="2026-07-28 19:34:08.395295152 +0000 UTC m=+261.347327481"
Jul 28 19:34:15.313100 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:15.312995    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e43e2c26-51ea-4924-a62d-257b690ca836-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hc5np\" (UID: \"e43e2c26-51ea-4924-a62d-257b690ca836\") " pod="openshift-insights/insights-runtime-extractor-hc5np"
Jul 28 19:34:15.315399 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:15.315375    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e43e2c26-51ea-4924-a62d-257b690ca836-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hc5np\" (UID: \"e43e2c26-51ea-4924-a62d-257b690ca836\") " pod="openshift-insights/insights-runtime-extractor-hc5np"
Jul 28 19:34:15.608487 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:15.608405    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9sbqm\""
Jul 28 19:34:15.616720 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:15.616696    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hc5np"
Jul 28 19:34:15.743336 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:15.743305    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hc5np"]
Jul 28 19:34:15.746266 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:34:15.746240    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode43e2c26_51ea_4924_a62d_257b690ca836.slice/crio-177658ba083345af564d2c76dc0c56309c1bdd7fbab9fbf79005e15f84adc332 WatchSource:0}: Error finding container 177658ba083345af564d2c76dc0c56309c1bdd7fbab9fbf79005e15f84adc332: Status 404 returned error can't find the container with id 177658ba083345af564d2c76dc0c56309c1bdd7fbab9fbf79005e15f84adc332
Jul 28 19:34:16.402048 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:16.402002    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hc5np" event={"ID":"e43e2c26-51ea-4924-a62d-257b690ca836","Type":"ContainerStarted","Data":"177658ba083345af564d2c76dc0c56309c1bdd7fbab9fbf79005e15f84adc332"}
Jul 28 19:34:21.421059 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:21.421013    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hc5np" event={"ID":"e43e2c26-51ea-4924-a62d-257b690ca836","Type":"ContainerStarted","Data":"dbf8897947184194d1e497c7955b0df6d1516cee402d93e102c6f06806db4efb"}
Jul 28 19:34:24.434085 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:24.434048    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hc5np" event={"ID":"e43e2c26-51ea-4924-a62d-257b690ca836","Type":"ContainerStarted","Data":"425690fa65c60470a1186cf5fb12bdf5453a980d45cb28f9ac0d3f3e4e889cec"}
Jul 28 19:34:27.570229 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:27.570193    2570 patch_prober.go:28] interesting pod/image-registry-659fddc559-z465b container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 28 19:34:27.570664 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:27.570253    2570 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-659fddc559-z465b" podUID="bcbd5685-8540-4327-9141-3d01e32b41fd" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 19:34:28.085875 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:34:28.082595    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-djnj4" podUID="874474d2-7dc6-411c-a19f-7bd31b13376d"
Jul 28 19:34:28.451607 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:28.451577    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-djnj4"
Jul 28 19:34:28.451784 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:28.451579    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hc5np" event={"ID":"e43e2c26-51ea-4924-a62d-257b690ca836","Type":"ContainerStarted","Data":"ab780d4f0ddf370658fbb5da05a0a7fe24ebaa78149c7df4bb67775d30042b40"}
Jul 28 19:34:28.469987 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:28.469934    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hc5np" podStartSLOduration=33.728144008 podStartE2EDuration="45.469915592s" totalImagesPullingTime="11.741771584s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:33:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:34:28.468321657 +0000 UTC m=+281.420353987" watchObservedRunningTime="2026-07-28 19:34:28.469915592 +0000 UTC m=+281.421947921"
Jul 28 19:34:29.384018 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:29.383964    2570 patch_prober.go:28] interesting pod/image-registry-659fddc559-z465b container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 28 19:34:29.384443 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:29.384037    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-659fddc559-z465b" podUID="bcbd5685-8540-4327-9141-3d01e32b41fd" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 19:34:31.950950 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:31.950909    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/874474d2-7dc6-411c-a19f-7bd31b13376d-metrics-tls\") pod \"dns-default-djnj4\" (UID: \"874474d2-7dc6-411c-a19f-7bd31b13376d\") " pod="openshift-dns/dns-default-djnj4"
Jul 28 19:34:31.953120 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:31.953101    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/874474d2-7dc6-411c-a19f-7bd31b13376d-metrics-tls\") pod \"dns-default-djnj4\" (UID: \"874474d2-7dc6-411c-a19f-7bd31b13376d\") " pod="openshift-dns/dns-default-djnj4"
Jul 28 19:34:32.054725 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:32.054698    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pwrtc\""
Jul 28 19:34:32.062696 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:32.062675    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-djnj4"
Jul 28 19:34:32.185371 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:32.185231    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-djnj4"]
Jul 28 19:34:32.187774 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:34:32.187739    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod874474d2_7dc6_411c_a19f_7bd31b13376d.slice/crio-9a718939f2ab4bb595eb2d8c75b0c34772aad6dc61e689112d7f8d8949157e36 WatchSource:0}: Error finding container 9a718939f2ab4bb595eb2d8c75b0c34772aad6dc61e689112d7f8d8949157e36: Status 404 returned error can't find the container with id 9a718939f2ab4bb595eb2d8c75b0c34772aad6dc61e689112d7f8d8949157e36
Jul 28 19:34:32.463692 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:32.463652    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-djnj4" event={"ID":"874474d2-7dc6-411c-a19f-7bd31b13376d","Type":"ContainerStarted","Data":"9a718939f2ab4bb595eb2d8c75b0c34772aad6dc61e689112d7f8d8949157e36"}
Jul 28 19:34:34.471714 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:34.471677    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-djnj4" event={"ID":"874474d2-7dc6-411c-a19f-7bd31b13376d","Type":"ContainerStarted","Data":"cbeb06f6bf91b4b4fdbca5bcfb37e2141419189b6dfa9564a0cd08b69b71817b"}
Jul 28 19:34:34.472134 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:34.471739    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-djnj4" event={"ID":"874474d2-7dc6-411c-a19f-7bd31b13376d","Type":"ContainerStarted","Data":"ff38f1be0f94db2427742f9bf64acba76b636147fdfa6de20d0c08ec13ee5351"}
Jul 28 19:34:34.472134 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:34.471793    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-djnj4"
Jul 28 19:34:34.488756 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:34.488705    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-djnj4" podStartSLOduration=251.982676408 podStartE2EDuration="4m13.488688083s" totalImagesPullingTime="1.506011675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:30:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:34:34.487615208 +0000 UTC m=+287.439647551" watchObservedRunningTime="2026-07-28 19:34:34.488688083 +0000 UTC m=+287.440720442"
Jul 28 19:34:36.061891 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.061851    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-cpc6v"]
Jul 28 19:34:36.066428 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.066379    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rtm75"]
Jul 28 19:34:36.066842 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.066822    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cpc6v"
Jul 28 19:34:36.069056 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.069033    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rtm75"
Jul 28 19:34:36.069195 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.069173    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 28 19:34:36.069447 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.069426    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 28 19:34:36.069559 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.069551    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-nhd6g\""
Jul 28 19:34:36.069657 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.069644    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 28 19:34:36.069762 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.069753    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 28 19:34:36.070501 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.070484    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 28 19:34:36.070605 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.070596    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 28 19:34:36.071220 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.071205    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 28 19:34:36.071443 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.071429    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 28 19:34:36.071535 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.071474    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ndd7t\""
Jul 28 19:34:36.071535 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.071482    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 28 19:34:36.073497 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.073474    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-cpc6v"]
Jul 28 19:34:36.181790 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.181751    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/785591be-b6ff-4a03-9693-f97139f3d9bc-node-exporter-wtmp\") pod \"node-exporter-rtm75\" (UID: \"785591be-b6ff-4a03-9693-f97139f3d9bc\") " pod="openshift-monitoring/node-exporter-rtm75"
Jul 28 19:34:36.181790 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.181788    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/785591be-b6ff-4a03-9693-f97139f3d9bc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rtm75\" (UID: \"785591be-b6ff-4a03-9693-f97139f3d9bc\") " pod="openshift-monitoring/node-exporter-rtm75"
Jul 28 19:34:36.182036 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.181822    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/785591be-b6ff-4a03-9693-f97139f3d9bc-node-exporter-tls\") pod \"node-exporter-rtm75\" (UID: \"785591be-b6ff-4a03-9693-f97139f3d9bc\") " pod="openshift-monitoring/node-exporter-rtm75"
Jul 28 19:34:36.182036 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.181879    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/785591be-b6ff-4a03-9693-f97139f3d9bc-sys\") pod \"node-exporter-rtm75\" (UID: \"785591be-b6ff-4a03-9693-f97139f3d9bc\") " pod="openshift-monitoring/node-exporter-rtm75"
Jul 28 19:34:36.182036 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.181898    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/785591be-b6ff-4a03-9693-f97139f3d9bc-node-exporter-accelerators-collector-config\") pod \"node-exporter-rtm75\" (UID: \"785591be-b6ff-4a03-9693-f97139f3d9bc\") " pod="openshift-monitoring/node-exporter-rtm75"
Jul 28 19:34:36.182036 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.181939    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e6df31cb-3324-4f86-a181-2924a89f6ca8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-cpc6v\" (UID: \"e6df31cb-3324-4f86-a181-2924a89f6ca8\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cpc6v"
Jul 28 19:34:36.182036 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.181961    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmgws\" (UniqueName: \"kubernetes.io/projected/785591be-b6ff-4a03-9693-f97139f3d9bc-kube-api-access-zmgws\") pod \"node-exporter-rtm75\" (UID: \"785591be-b6ff-4a03-9693-f97139f3d9bc\") " pod="openshift-monitoring/node-exporter-rtm75"
Jul 28 19:34:36.182036 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.182017    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/785591be-b6ff-4a03-9693-f97139f3d9bc-metrics-client-ca\") pod \"node-exporter-rtm75\" (UID: \"785591be-b6ff-4a03-9693-f97139f3d9bc\") " pod="openshift-monitoring/node-exporter-rtm75"
Jul 28 19:34:36.182036 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.182034    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/785591be-b6ff-4a03-9693-f97139f3d9bc-root\") pod \"node-exporter-rtm75\" (UID: \"785591be-b6ff-4a03-9693-f97139f3d9bc\") " pod="openshift-monitoring/node-exporter-rtm75"
Jul 28 19:34:36.182280 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.182057    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/785591be-b6ff-4a03-9693-f97139f3d9bc-node-exporter-textfile\") pod \"node-exporter-rtm75\" (UID: \"785591be-b6ff-4a03-9693-f97139f3d9bc\") " pod="openshift-monitoring/node-exporter-rtm75"
Jul 28 19:34:36.182280 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.182082    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6df31cb-3324-4f86-a181-2924a89f6ca8-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-cpc6v\" (UID: \"e6df31cb-3324-4f86-a181-2924a89f6ca8\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cpc6v"
Jul 28 19:34:36.182280 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.182100    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb2w2\" (UniqueName: \"kubernetes.io/projected/e6df31cb-3324-4f86-a181-2924a89f6ca8-kube-api-access-mb2w2\") pod \"kube-state-metrics-56d9f944b4-cpc6v\" (UID: \"e6df31cb-3324-4f86-a181-2924a89f6ca8\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cpc6v"
Jul 28 19:34:36.182280 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.182127    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6df31cb-3324-4f86-a181-2924a89f6ca8-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-cpc6v\" (UID: \"e6df31cb-3324-4f86-a181-2924a89f6ca8\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cpc6v"
Jul 28 19:34:36.182280 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.182156    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e6df31cb-3324-4f86-a181-2924a89f6ca8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-cpc6v\" (UID: \"e6df31cb-3324-4f86-a181-2924a89f6ca8\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cpc6v"
Jul 28 19:34:36.182280 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.182181    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e6df31cb-3324-4f86-a181-2924a89f6ca8-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-cpc6v\" (UID: \"e6df31cb-3324-4f86-a181-2924a89f6ca8\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cpc6v"
Jul 28 19:34:36.283120 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.283086    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/785591be-b6ff-4a03-9693-f97139f3d9bc-node-exporter-tls\") pod \"node-exporter-rtm75\" (UID: \"785591be-b6ff-4a03-9693-f97139f3d9bc\") " pod="openshift-monitoring/node-exporter-rtm75"
Jul 28 19:34:36.283120 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.283123    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/785591be-b6ff-4a03-9693-f97139f3d9bc-sys\") pod \"node-exporter-rtm75\" (UID: \"785591be-b6ff-4a03-9693-f97139f3d9bc\") " pod="openshift-monitoring/node-exporter-rtm75"
Jul 28 19:34:36.283268 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.283141    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/785591be-b6ff-4a03-9693-f97139f3d9bc-node-exporter-accelerators-collector-config\") pod \"node-exporter-rtm75\" (UID: \"785591be-b6ff-4a03-9693-f97139f3d9bc\") " pod="openshift-monitoring/node-exporter-rtm75"
Jul 28 19:34:36.283268 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.283165    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e6df31cb-3324-4f86-a181-2924a89f6ca8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-cpc6v\" (UID: \"e6df31cb-3324-4f86-a181-2924a89f6ca8\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cpc6v"
Jul 28 19:34:36.283268 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.283208    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/785591be-b6ff-4a03-9693-f97139f3d9bc-sys\") pod \"node-exporter-rtm75\" (UID: \"785591be-b6ff-4a03-9693-f97139f3d9bc\") " pod="openshift-monitoring/node-exporter-rtm75"
Jul 28 19:34:36.283268 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.283264    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmgws\" (UniqueName: \"kubernetes.io/projected/785591be-b6ff-4a03-9693-f97139f3d9bc-kube-api-access-zmgws\") pod \"node-exporter-rtm75\" (UID: \"785591be-b6ff-4a03-9693-f97139f3d9bc\") " pod="openshift-monitoring/node-exporter-rtm75"
Jul 28 19:34:36.283445 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.283297    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/785591be-b6ff-4a03-9693-f97139f3d9bc-metrics-client-ca\") pod \"node-exporter-rtm75\" (UID: \"785591be-b6ff-4a03-9693-f97139f3d9bc\") " pod="openshift-monitoring/node-exporter-rtm75"
Jul 28 19:34:36.283445 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.283319    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/785591be-b6ff-4a03-9693-f97139f3d9bc-root\") pod \"node-exporter-rtm75\" (UID: \"785591be-b6ff-4a03-9693-f97139f3d9bc\") " pod="openshift-monitoring/node-exporter-rtm75"
Jul 28 19:34:36.283445 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.283348    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/785591be-b6ff-4a03-9693-f97139f3d9bc-node-exporter-textfile\") pod \"node-exporter-rtm75\" (UID: \"785591be-b6ff-4a03-9693-f97139f3d9bc\") " pod="openshift-monitoring/node-exporter-rtm75"
Jul 28 19:34:36.283445 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.283373    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6df31cb-3324-4f86-a181-2924a89f6ca8-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-cpc6v\" (UID: \"e6df31cb-3324-4f86-a181-2924a89f6ca8\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cpc6v"
Jul 28 19:34:36.283445 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.283401    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb2w2\" (UniqueName: \"kubernetes.io/projected/e6df31cb-3324-4f86-a181-2924a89f6ca8-kube-api-access-mb2w2\") pod \"kube-state-metrics-56d9f944b4-cpc6v\" (UID: \"e6df31cb-3324-4f86-a181-2924a89f6ca8\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cpc6v"
Jul 28 19:34:36.283445 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.283413    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/785591be-b6ff-4a03-9693-f97139f3d9bc-root\") pod \"node-exporter-rtm75\" (UID: \"785591be-b6ff-4a03-9693-f97139f3d9bc\") " pod="openshift-monitoring/node-exporter-rtm75"
Jul 28 19:34:36.283445 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.283434    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6df31cb-3324-4f86-a181-2924a89f6ca8-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-cpc6v\" (UID: \"e6df31cb-3324-4f86-a181-2924a89f6ca8\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cpc6v"
Jul 28 19:34:36.283772 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.283464    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e6df31cb-3324-4f86-a181-2924a89f6ca8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-cpc6v\" (UID: \"e6df31cb-3324-4f86-a181-2924a89f6ca8\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cpc6v"
Jul 28 19:34:36.283772 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.283499    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e6df31cb-3324-4f86-a181-2924a89f6ca8-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-cpc6v\" (UID: \"e6df31cb-3324-4f86-a181-2924a89f6ca8\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cpc6v"
Jul 28 19:34:36.283772 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.283532    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/785591be-b6ff-4a03-9693-f97139f3d9bc-node-exporter-wtmp\") pod \"node-exporter-rtm75\" (UID: \"785591be-b6ff-4a03-9693-f97139f3d9bc\") " pod="openshift-monitoring/node-exporter-rtm75"
Jul 28 19:34:36.283772 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.283558    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/785591be-b6ff-4a03-9693-f97139f3d9bc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rtm75\" (UID: \"785591be-b6ff-4a03-9693-f97139f3d9bc\") " pod="openshift-monitoring/node-exporter-rtm75"
Jul 28 19:34:36.283772 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.283681    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/785591be-b6ff-4a03-9693-f97139f3d9bc-node-exporter-textfile\") pod \"node-exporter-rtm75\" (UID: \"785591be-b6ff-4a03-9693-f97139f3d9bc\") " pod="openshift-monitoring/node-exporter-rtm75"
Jul 28 19:34:36.284040 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.283870    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/785591be-b6ff-4a03-9693-f97139f3d9bc-node-exporter-accelerators-collector-config\") pod \"node-exporter-rtm75\" (UID: \"785591be-b6ff-4a03-9693-f97139f3d9bc\") " pod="openshift-monitoring/node-exporter-rtm75"
Jul 28 19:34:36.284040 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.283928    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/785591be-b6ff-4a03-9693-f97139f3d9bc-metrics-client-ca\") pod \"node-exporter-rtm75\" (UID: \"785591be-b6ff-4a03-9693-f97139f3d9bc\") " pod="openshift-monitoring/node-exporter-rtm75"
Jul 28 19:34:36.284138 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.284099    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/785591be-b6ff-4a03-9693-f97139f3d9bc-node-exporter-wtmp\") pod \"node-exporter-rtm75\" (UID: \"785591be-b6ff-4a03-9693-f97139f3d9bc\") " pod="openshift-monitoring/node-exporter-rtm75"
Jul 28 19:34:36.284189 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.284165    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6df31cb-3324-4f86-a181-2924a89f6ca8-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-cpc6v\" (UID: \"e6df31cb-3324-4f86-a181-2924a89f6ca8\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cpc6v"
Jul 28 19:34:36.284237 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.284209    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e6df31cb-3324-4f86-a181-2924a89f6ca8-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-cpc6v\" (UID: \"e6df31cb-3324-4f86-a181-2924a89f6ca8\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cpc6v"
Jul 28 19:34:36.284288 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:34:36.284267    2570 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 28 19:34:36.284336 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:34:36.284326    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6df31cb-3324-4f86-a181-2924a89f6ca8-kube-state-metrics-tls podName:e6df31cb-3324-4f86-a181-2924a89f6ca8 nodeName:}" failed. No retries permitted until 2026-07-28 19:34:36.784306732 +0000 UTC m=+289.736339043 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/e6df31cb-3324-4f86-a181-2924a89f6ca8-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-cpc6v" (UID: "e6df31cb-3324-4f86-a181-2924a89f6ca8") : secret "kube-state-metrics-tls" not found
Jul 28 19:34:36.284391 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.284353    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e6df31cb-3324-4f86-a181-2924a89f6ca8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-cpc6v\" (UID: \"e6df31cb-3324-4f86-a181-2924a89f6ca8\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cpc6v"
Jul 28 19:34:36.285751 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.285728    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e6df31cb-3324-4f86-a181-2924a89f6ca8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-cpc6v\" (UID: \"e6df31cb-3324-4f86-a181-2924a89f6ca8\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cpc6v"
Jul 28 19:34:36.285830 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.285800    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/785591be-b6ff-4a03-9693-f97139f3d9bc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rtm75\" (UID: \"785591be-b6ff-4a03-9693-f97139f3d9bc\") " pod="openshift-monitoring/node-exporter-rtm75"
Jul 28 19:34:36.285892 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.285875    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/785591be-b6ff-4a03-9693-f97139f3d9bc-node-exporter-tls\") pod \"node-exporter-rtm75\" (UID: \"785591be-b6ff-4a03-9693-f97139f3d9bc\") " pod="openshift-monitoring/node-exporter-rtm75"
Jul 28 19:34:36.292318 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.292291    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb2w2\" (UniqueName: \"kubernetes.io/projected/e6df31cb-3324-4f86-a181-2924a89f6ca8-kube-api-access-mb2w2\") pod \"kube-state-metrics-56d9f944b4-cpc6v\" (UID: \"e6df31cb-3324-4f86-a181-2924a89f6ca8\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cpc6v"
Jul 28 19:34:36.292870 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.292849    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmgws\" (UniqueName: \"kubernetes.io/projected/785591be-b6ff-4a03-9693-f97139f3d9bc-kube-api-access-zmgws\") pod \"node-exporter-rtm75\" (UID: \"785591be-b6ff-4a03-9693-f97139f3d9bc\") " pod="openshift-monitoring/node-exporter-rtm75"
Jul 28 19:34:36.383358 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.383278    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rtm75"
Jul 28 19:34:36.393201 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:34:36.393174    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod785591be_b6ff_4a03_9693_f97139f3d9bc.slice/crio-8d71a6ab78ff0ae972629f0a4dbef1340920bf4a709fe26c9412f2afbfe9d578 WatchSource:0}: Error finding container 8d71a6ab78ff0ae972629f0a4dbef1340920bf4a709fe26c9412f2afbfe9d578: Status 404 returned error can't find the container with id 8d71a6ab78ff0ae972629f0a4dbef1340920bf4a709fe26c9412f2afbfe9d578
Jul 28 19:34:36.479629 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.479593    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rtm75" event={"ID":"785591be-b6ff-4a03-9693-f97139f3d9bc","Type":"ContainerStarted","Data":"8d71a6ab78ff0ae972629f0a4dbef1340920bf4a709fe26c9412f2afbfe9d578"}
Jul 28 19:34:36.786634 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.786598    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6df31cb-3324-4f86-a181-2924a89f6ca8-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-cpc6v\" (UID: \"e6df31cb-3324-4f86-a181-2924a89f6ca8\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cpc6v"
Jul 28 19:34:36.788916 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.788897    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6df31cb-3324-4f86-a181-2924a89f6ca8-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-cpc6v\" (UID: \"e6df31cb-3324-4f86-a181-2924a89f6ca8\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cpc6v"
Jul 28 19:34:36.978245 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:36.978203    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cpc6v"
Jul 28 19:34:37.125058 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:37.125025    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-cpc6v"]
Jul 28 19:34:37.277451 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:34:37.277410    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6df31cb_3324_4f86_a181_2924a89f6ca8.slice/crio-432098a7361cbc4f5b7443b063433250b766a29e5ec0d388ce4ac1b684de6251 WatchSource:0}: Error finding container 432098a7361cbc4f5b7443b063433250b766a29e5ec0d388ce4ac1b684de6251: Status 404 returned error can't find the container with id 432098a7361cbc4f5b7443b063433250b766a29e5ec0d388ce4ac1b684de6251
Jul 28 19:34:37.484838 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:37.484804    2570 generic.go:356] "Generic (PLEG): container finished" podID="785591be-b6ff-4a03-9693-f97139f3d9bc" containerID="6e662dd12d2a232bc4b5f0fe90efd9141874241358e1e724158e801698ad1426" exitCode=0
Jul 28 19:34:37.485028 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:37.484886    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rtm75" event={"ID":"785591be-b6ff-4a03-9693-f97139f3d9bc","Type":"ContainerDied","Data":"6e662dd12d2a232bc4b5f0fe90efd9141874241358e1e724158e801698ad1426"}
Jul 28 19:34:37.486072 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:37.486051    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cpc6v" event={"ID":"e6df31cb-3324-4f86-a181-2924a89f6ca8","Type":"ContainerStarted","Data":"432098a7361cbc4f5b7443b063433250b766a29e5ec0d388ce4ac1b684de6251"}
Jul 28 19:34:37.569187 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:37.569161    2570 patch_prober.go:28] interesting pod/image-registry-659fddc559-z465b container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 28 19:34:37.569309 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:37.569209    2570 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-659fddc559-z465b" podUID="bcbd5685-8540-4327-9141-3d01e32b41fd" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 19:34:38.492562 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:38.492517    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rtm75" event={"ID":"785591be-b6ff-4a03-9693-f97139f3d9bc","Type":"ContainerStarted","Data":"7bbb7ee06136c6899122caf2e3f8a594dbe23a1762e18ae534ee0b6dcb893909"}
Jul 28 19:34:38.493042 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:38.492584    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rtm75" event={"ID":"785591be-b6ff-4a03-9693-f97139f3d9bc","Type":"ContainerStarted","Data":"0dbf0fe7f8b7cba32bbb9cb04d9e2cc961e1b528e53aef191f6c6ef3cf095210"}
Jul 28 19:34:38.511535 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:38.511164    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rtm75" podStartSLOduration=1.536498825 podStartE2EDuration="2.511146608s" totalImagesPullingTime="910.810923ms" totalInitContainerRuntime="63.83686ms" isStatefulPod=true podCreationTimestamp="2026-07-28 19:34:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:34:38.510051398 +0000 UTC m=+291.462083751" watchObservedRunningTime="2026-07-28 19:34:38.511146608 +0000 UTC m=+291.463178937"
Jul 28 19:34:39.382960 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:39.382923    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-659fddc559-z465b"
Jul 28 19:34:39.497520 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:39.497482    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cpc6v" event={"ID":"e6df31cb-3324-4f86-a181-2924a89f6ca8","Type":"ContainerStarted","Data":"432d88d5f9f6e438751266658fa87859196b60a0bf0f11bc2052db1724ec3c06"}
Jul 28 19:34:39.497893 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:39.497553    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cpc6v" event={"ID":"e6df31cb-3324-4f86-a181-2924a89f6ca8","Type":"ContainerStarted","Data":"034d6fafc1ae7a7e8c08692508e6dc03507bec819a16af931fb11233c76577cb"}
Jul 28 19:34:39.497893 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:39.497583    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cpc6v" event={"ID":"e6df31cb-3324-4f86-a181-2924a89f6ca8","Type":"ContainerStarted","Data":"847428e44759c7d69fe0795bad5a97f07eaa89b1042a73a8a20e371f0cb6ddaf"}
Jul 28 19:34:39.517961 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:39.517914    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cpc6v" podStartSLOduration=2.248559154 podStartE2EDuration="3.517897554s" totalImagesPullingTime="1.2693384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:34:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:34:39.51687404 +0000 UTC m=+292.468906369" watchObservedRunningTime="2026-07-28 19:34:39.517897554 +0000 UTC m=+292.469929939"
Jul 28 19:34:42.297538 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.297507    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 19:34:42.300178 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.300161    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.302825 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.302799    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 28 19:34:42.303027 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.303005    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 28 19:34:42.303119 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.303033    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 28 19:34:42.303181 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.303121    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 28 19:34:42.303333 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.303316    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 28 19:34:42.303610 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.303588    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 28 19:34:42.303765 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.303752    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 28 19:34:42.304049 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.304033    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 28 19:34:42.304234 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.304214    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 28 19:34:42.304451 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.304436    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bfqval51igv5t\""
Jul 28 19:34:42.304629 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.304472    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 28 19:34:42.304706 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.304523    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 28 19:34:42.305031 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.305013    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-s9d7p\""
Jul 28 19:34:42.305144 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.305131    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 28 19:34:42.305246 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.305234    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 28 19:34:42.309354 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.309321    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 28 19:34:42.313351 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.313292    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 28 19:34:42.317365 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.317340    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 19:34:42.430183 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.430140    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-config\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.430183 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.430177    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.430390 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.430201    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.430390 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.430283    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.430390 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.430318    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.430390 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.430344    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.430390 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.430369    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.430390 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.430384    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcwrv\" (UniqueName: \"kubernetes.io/projected/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-kube-api-access-qcwrv\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.430568 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.430401    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-config-out\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.430568 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.430419    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.430568 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.430462    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.430568 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.430492    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.430568 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.430517    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.430568 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.430541    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.430568 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.430566    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.430763 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.430614    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.430763 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.430647    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.430763 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.430681    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.430763 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.430698    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.430763 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.430718    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-web-config\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.531282 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.531236    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.531282 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.531286    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.531542 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.531312    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.531542 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.531345    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.531542 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.531372    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.531542 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.531395    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcwrv\" (UniqueName: \"kubernetes.io/projected/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-kube-api-access-qcwrv\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.531542 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.531416    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-config-out\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.531542 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.531438    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.531873 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.531570    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.531873 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.531603    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.531873 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.531631    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.531873 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.531664    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.531873 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.531688    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.531873 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.531712    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.531873 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.531744    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.531873 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.531767    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.532271 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.531908    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.532271 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.531940    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.532271 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.531964    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-web-config\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.532271 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.532010    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-config\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.532271 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.532035    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.532626 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.532600    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.534008 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.533850    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.534698 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.534669    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.535854 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.535216    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.535854 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.535436    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.535854 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.535684    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.535854 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.535702    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.535854 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.535750    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.536234 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.535906    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.536234 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.536199    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.536559 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.536530    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-config-out\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.536827 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.536807    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-config\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.536892 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.536879    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.536926 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.536899    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-web-config\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.536926 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.536910    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.537182 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.537167    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.537436 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.537413    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.537721 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.537705    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.539733 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.539711    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcwrv\" (UniqueName: \"kubernetes.io/projected/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-kube-api-access-qcwrv\") pod \"prometheus-k8s-0\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.618664 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.618580    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:42.751012 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:42.750989    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 19:34:42.753380 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:34:42.753357    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f42cca0_3402_44fa_8b50_b5143dc6cc1d.slice/crio-80eead861d71c0f4699fe45d2e13552a5b963d9da8ca13bfff499d4c9dcaa9a4 WatchSource:0}: Error finding container 80eead861d71c0f4699fe45d2e13552a5b963d9da8ca13bfff499d4c9dcaa9a4: Status 404 returned error can't find the container with id 80eead861d71c0f4699fe45d2e13552a5b963d9da8ca13bfff499d4c9dcaa9a4
Jul 28 19:34:43.512796 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:43.512756    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f42cca0-3402-44fa-8b50-b5143dc6cc1d","Type":"ContainerStarted","Data":"80eead861d71c0f4699fe45d2e13552a5b963d9da8ca13bfff499d4c9dcaa9a4"}
Jul 28 19:34:44.477541 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:44.477508    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-djnj4"
Jul 28 19:34:44.519182 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:44.519143    2570 generic.go:356] "Generic (PLEG): container finished" podID="3f42cca0-3402-44fa-8b50-b5143dc6cc1d" containerID="eaa219edb82ccc99f45954cfeb1af941299d89087308e0df71b7e75880425dfe" exitCode=0
Jul 28 19:34:44.519642 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:44.519200    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f42cca0-3402-44fa-8b50-b5143dc6cc1d","Type":"ContainerDied","Data":"eaa219edb82ccc99f45954cfeb1af941299d89087308e0df71b7e75880425dfe"}
Jul 28 19:34:47.737632 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:47.737577    2570 kubelet.go:1648] "Image garbage collection succeeded"
Jul 28 19:34:48.537781 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:48.537741    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f42cca0-3402-44fa-8b50-b5143dc6cc1d","Type":"ContainerStarted","Data":"7039c6897088b36db527d0ad2f46c5a789a4e4e33c3074481e52d9f88c669f2a"}
Jul 28 19:34:48.537927 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:48.537837    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f42cca0-3402-44fa-8b50-b5143dc6cc1d","Type":"ContainerStarted","Data":"0f051d254da9c92fdda5f40b18364aba6ad33b0745d1ddaaf041345f9aac9f7c"}
Jul 28 19:34:50.547328 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:50.547297    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f42cca0-3402-44fa-8b50-b5143dc6cc1d","Type":"ContainerStarted","Data":"c9dc18a96f9afb46601d2796a9593c45b8cfc541c35ac165a5f0b5e6d68edf2c"}
Jul 28 19:34:50.547718 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:50.547363    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f42cca0-3402-44fa-8b50-b5143dc6cc1d","Type":"ContainerStarted","Data":"66dee1de6d6853c7e3219ae18758e9420f9980283b357cebd32d4b7dcff1d498"}
Jul 28 19:34:50.547718 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:50.547388    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f42cca0-3402-44fa-8b50-b5143dc6cc1d","Type":"ContainerStarted","Data":"c1261488392177b569d4083924cc717dc2d5219185e84ea62b1779a8ab153e47"}
Jul 28 19:34:50.547718 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:50.547416    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f42cca0-3402-44fa-8b50-b5143dc6cc1d","Type":"ContainerStarted","Data":"42a6a17fef86fd52d2364b54e449e3a898405fc066936209933c085fff96ec86"}
Jul 28 19:34:50.574656 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:50.574602    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.136798555 podStartE2EDuration="8.574585533s" totalImagesPullingTime="6.419041968s" totalInitContainerRuntime="18.74501ms" isStatefulPod=false podCreationTimestamp="2026-07-28 19:34:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:34:50.57315268 +0000 UTC m=+303.525185025" watchObservedRunningTime="2026-07-28 19:34:50.574585533 +0000 UTC m=+303.526617863"
Jul 28 19:34:52.619269 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:52.619225    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:34:55.196006 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:55.195960    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-djnj4_874474d2-7dc6-411c-a19f-7bd31b13376d/dns/0.log"
Jul 28 19:34:55.394947 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:55.394917    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-djnj4_874474d2-7dc6-411c-a19f-7bd31b13376d/kube-rbac-proxy/0.log"
Jul 28 19:34:56.194472 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:56.194444    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-msmdc_d1744c82-4def-4eba-84c8-89528fef43f6/dns-node-resolver/0.log"
Jul 28 19:34:56.794959 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:56.794933    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5v2j9_bbf2a53c-71f8-469f-9fb4-d5aa608b3dbf/serve-healthcheck-canary/0.log"
Jul 28 19:34:58.190051 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:34:58.190007    2570 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d456c49cf-b6bt5" podUID="4f9d58b2-725d-45aa-bd76-4040e7b4dfa0" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 28 19:35:08.189688 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:35:08.189648    2570 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d456c49cf-b6bt5" podUID="4f9d58b2-725d-45aa-bd76-4040e7b4dfa0" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 28 19:35:18.189782 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:35:18.189745    2570 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d456c49cf-b6bt5" podUID="4f9d58b2-725d-45aa-bd76-4040e7b4dfa0" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 28 19:35:18.190258 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:35:18.189826    2570 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d456c49cf-b6bt5"
Jul 28 19:35:18.190328 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:35:18.190291    2570 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"ad124c9f541e2212f1fad7ad5bc54afa79f5ac386ab16e024b2190c5f53248d0"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d456c49cf-b6bt5" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 28 19:35:18.190374 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:35:18.190350    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d456c49cf-b6bt5" podUID="4f9d58b2-725d-45aa-bd76-4040e7b4dfa0" containerName="service-proxy" containerID="cri-o://ad124c9f541e2212f1fad7ad5bc54afa79f5ac386ab16e024b2190c5f53248d0" gracePeriod=30
Jul 28 19:35:18.646509 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:35:18.646421    2570 generic.go:356] "Generic (PLEG): container finished" podID="4f9d58b2-725d-45aa-bd76-4040e7b4dfa0" containerID="ad124c9f541e2212f1fad7ad5bc54afa79f5ac386ab16e024b2190c5f53248d0" exitCode=2
Jul 28 19:35:18.646509 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:35:18.646491    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d456c49cf-b6bt5" event={"ID":"4f9d58b2-725d-45aa-bd76-4040e7b4dfa0","Type":"ContainerDied","Data":"ad124c9f541e2212f1fad7ad5bc54afa79f5ac386ab16e024b2190c5f53248d0"}
Jul 28 19:35:18.646693 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:35:18.646539    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d456c49cf-b6bt5" event={"ID":"4f9d58b2-725d-45aa-bd76-4040e7b4dfa0","Type":"ContainerStarted","Data":"563b60eff53a159861c3880fad3110b54646fa6916c4264578e1280b6258fd18"}
Jul 28 19:35:42.619143 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:35:42.619107    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:35:42.637987 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:35:42.637945    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:35:42.741349 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:35:42.741323    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:00.671028 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.670993    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 19:36:00.671493 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.671258    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3f42cca0-3402-44fa-8b50-b5143dc6cc1d" containerName="prometheus" containerID="cri-o://0f051d254da9c92fdda5f40b18364aba6ad33b0745d1ddaaf041345f9aac9f7c" gracePeriod=600
Jul 28 19:36:00.671493 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.671269    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3f42cca0-3402-44fa-8b50-b5143dc6cc1d" containerName="kube-rbac-proxy" containerID="cri-o://66dee1de6d6853c7e3219ae18758e9420f9980283b357cebd32d4b7dcff1d498" gracePeriod=600
Jul 28 19:36:00.671493 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.671307    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3f42cca0-3402-44fa-8b50-b5143dc6cc1d" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c9dc18a96f9afb46601d2796a9593c45b8cfc541c35ac165a5f0b5e6d68edf2c" gracePeriod=600
Jul 28 19:36:00.671493 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.671332    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3f42cca0-3402-44fa-8b50-b5143dc6cc1d" containerName="thanos-sidecar" containerID="cri-o://42a6a17fef86fd52d2364b54e449e3a898405fc066936209933c085fff96ec86" gracePeriod=600
Jul 28 19:36:00.671493 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.671351    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3f42cca0-3402-44fa-8b50-b5143dc6cc1d" containerName="config-reloader" containerID="cri-o://7039c6897088b36db527d0ad2f46c5a789a4e4e33c3074481e52d9f88c669f2a" gracePeriod=600
Jul 28 19:36:00.671493 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.671363    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3f42cca0-3402-44fa-8b50-b5143dc6cc1d" containerName="kube-rbac-proxy-web" containerID="cri-o://c1261488392177b569d4083924cc717dc2d5219185e84ea62b1779a8ab153e47" gracePeriod=600
Jul 28 19:36:00.791042 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.790950    2570 generic.go:356] "Generic (PLEG): container finished" podID="3f42cca0-3402-44fa-8b50-b5143dc6cc1d" containerID="c9dc18a96f9afb46601d2796a9593c45b8cfc541c35ac165a5f0b5e6d68edf2c" exitCode=0
Jul 28 19:36:00.791115 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.791047    2570 generic.go:356] "Generic (PLEG): container finished" podID="3f42cca0-3402-44fa-8b50-b5143dc6cc1d" containerID="66dee1de6d6853c7e3219ae18758e9420f9980283b357cebd32d4b7dcff1d498" exitCode=0
Jul 28 19:36:00.791115 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.791061    2570 generic.go:356] "Generic (PLEG): container finished" podID="3f42cca0-3402-44fa-8b50-b5143dc6cc1d" containerID="c1261488392177b569d4083924cc717dc2d5219185e84ea62b1779a8ab153e47" exitCode=0
Jul 28 19:36:00.791115 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.791067    2570 generic.go:356] "Generic (PLEG): container finished" podID="3f42cca0-3402-44fa-8b50-b5143dc6cc1d" containerID="7039c6897088b36db527d0ad2f46c5a789a4e4e33c3074481e52d9f88c669f2a" exitCode=0
Jul 28 19:36:00.791115 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.791073    2570 generic.go:356] "Generic (PLEG): container finished" podID="3f42cca0-3402-44fa-8b50-b5143dc6cc1d" containerID="0f051d254da9c92fdda5f40b18364aba6ad33b0745d1ddaaf041345f9aac9f7c" exitCode=0
Jul 28 19:36:00.791115 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.791067    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f42cca0-3402-44fa-8b50-b5143dc6cc1d","Type":"ContainerDied","Data":"c9dc18a96f9afb46601d2796a9593c45b8cfc541c35ac165a5f0b5e6d68edf2c"}
Jul 28 19:36:00.791304 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.791152    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f42cca0-3402-44fa-8b50-b5143dc6cc1d","Type":"ContainerDied","Data":"66dee1de6d6853c7e3219ae18758e9420f9980283b357cebd32d4b7dcff1d498"}
Jul 28 19:36:00.791304 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.791199    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f42cca0-3402-44fa-8b50-b5143dc6cc1d","Type":"ContainerDied","Data":"c1261488392177b569d4083924cc717dc2d5219185e84ea62b1779a8ab153e47"}
Jul 28 19:36:00.791304 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.791239    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f42cca0-3402-44fa-8b50-b5143dc6cc1d","Type":"ContainerDied","Data":"7039c6897088b36db527d0ad2f46c5a789a4e4e33c3074481e52d9f88c669f2a"}
Jul 28 19:36:00.791304 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.791276    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f42cca0-3402-44fa-8b50-b5143dc6cc1d","Type":"ContainerDied","Data":"0f051d254da9c92fdda5f40b18364aba6ad33b0745d1ddaaf041345f9aac9f7c"}
Jul 28 19:36:00.909107 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.909083    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:00.950493 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.950412    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-configmap-kubelet-serving-ca-bundle\") pod \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") "
Jul 28 19:36:00.950493 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.950447    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-secret-grpc-tls\") pod \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") "
Jul 28 19:36:00.950493 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.950478    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-config-out\") pod \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") "
Jul 28 19:36:00.950493 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.950494    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-configmap-metrics-client-ca\") pod \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") "
Jul 28 19:36:00.950819 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.950509    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-prometheus-k8s-rulefiles-2\") pod \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") "
Jul 28 19:36:00.950819 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.950533    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-config\") pod \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") "
Jul 28 19:36:00.950819 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.950554    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-web-config\") pod \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") "
Jul 28 19:36:00.950819 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.950583    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-tls-assets\") pod \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") "
Jul 28 19:36:00.950819 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.950607    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") "
Jul 28 19:36:00.950819 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.950639    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") "
Jul 28 19:36:00.950819 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.950662    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-secret-prometheus-k8s-tls\") pod \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") "
Jul 28 19:36:00.950819 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.950693    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-secret-metrics-client-certs\") pod \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") "
Jul 28 19:36:00.950819 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.950726    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-prometheus-k8s-rulefiles-0\") pod \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") "
Jul 28 19:36:00.950819 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.950755    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-prometheus-k8s-rulefiles-1\") pod \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") "
Jul 28 19:36:00.950819 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.950762    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "3f42cca0-3402-44fa-8b50-b5143dc6cc1d" (UID: "3f42cca0-3402-44fa-8b50-b5143dc6cc1d"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 19:36:00.950819 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.950779    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-prometheus-trusted-ca-bundle\") pod \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") "
Jul 28 19:36:00.950819 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.950822    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-configmap-serving-certs-ca-bundle\") pod \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") "
Jul 28 19:36:00.951493 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.950867    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-prometheus-k8s-db\") pod \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") "
Jul 28 19:36:00.951493 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.950894    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qcwrv\" (UniqueName: \"kubernetes.io/projected/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-kube-api-access-qcwrv\") pod \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") "
Jul 28 19:36:00.951493 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.950929    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-thanos-prometheus-http-client-file\") pod \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") "
Jul 28 19:36:00.951493 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.950956    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-secret-kube-rbac-proxy\") pod \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\" (UID: \"3f42cca0-3402-44fa-8b50-b5143dc6cc1d\") "
Jul 28 19:36:00.953046 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.952296    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "3f42cca0-3402-44fa-8b50-b5143dc6cc1d" (UID: "3f42cca0-3402-44fa-8b50-b5143dc6cc1d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 19:36:00.953046 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.952643    2570 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 19:36:00.953046 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.952675    2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 19:36:00.953300 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.953177    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "3f42cca0-3402-44fa-8b50-b5143dc6cc1d" (UID: "3f42cca0-3402-44fa-8b50-b5143dc6cc1d"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 19:36:00.955352 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.955034    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "3f42cca0-3402-44fa-8b50-b5143dc6cc1d" (UID: "3f42cca0-3402-44fa-8b50-b5143dc6cc1d"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:36:00.955352 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.955047    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "3f42cca0-3402-44fa-8b50-b5143dc6cc1d" (UID: "3f42cca0-3402-44fa-8b50-b5143dc6cc1d"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:36:00.955352 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.955155    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-config-out" (OuterVolumeSpecName: "config-out") pod "3f42cca0-3402-44fa-8b50-b5143dc6cc1d" (UID: "3f42cca0-3402-44fa-8b50-b5143dc6cc1d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:36:00.955352 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.955156    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "3f42cca0-3402-44fa-8b50-b5143dc6cc1d" (UID: "3f42cca0-3402-44fa-8b50-b5143dc6cc1d"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:36:00.955352 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.955178    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "3f42cca0-3402-44fa-8b50-b5143dc6cc1d" (UID: "3f42cca0-3402-44fa-8b50-b5143dc6cc1d"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 19:36:00.955665 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.955463    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "3f42cca0-3402-44fa-8b50-b5143dc6cc1d" (UID: "3f42cca0-3402-44fa-8b50-b5143dc6cc1d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 19:36:00.955665 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.955623    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-config" (OuterVolumeSpecName: "config") pod "3f42cca0-3402-44fa-8b50-b5143dc6cc1d" (UID: "3f42cca0-3402-44fa-8b50-b5143dc6cc1d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:36:00.955777 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.955689    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "3f42cca0-3402-44fa-8b50-b5143dc6cc1d" (UID: "3f42cca0-3402-44fa-8b50-b5143dc6cc1d"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 19:36:00.958012 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.956292    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "3f42cca0-3402-44fa-8b50-b5143dc6cc1d" (UID: "3f42cca0-3402-44fa-8b50-b5143dc6cc1d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 19:36:00.958012 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.956332    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "3f42cca0-3402-44fa-8b50-b5143dc6cc1d" (UID: "3f42cca0-3402-44fa-8b50-b5143dc6cc1d"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:36:00.960017 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.958953    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-kube-api-access-qcwrv" (OuterVolumeSpecName: "kube-api-access-qcwrv") pod "3f42cca0-3402-44fa-8b50-b5143dc6cc1d" (UID: "3f42cca0-3402-44fa-8b50-b5143dc6cc1d"). InnerVolumeSpecName "kube-api-access-qcwrv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:36:00.960402 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.960256    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "3f42cca0-3402-44fa-8b50-b5143dc6cc1d" (UID: "3f42cca0-3402-44fa-8b50-b5143dc6cc1d"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:36:00.960885 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.960861    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "3f42cca0-3402-44fa-8b50-b5143dc6cc1d" (UID: "3f42cca0-3402-44fa-8b50-b5143dc6cc1d"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:36:00.961175 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.961149    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "3f42cca0-3402-44fa-8b50-b5143dc6cc1d" (UID: "3f42cca0-3402-44fa-8b50-b5143dc6cc1d"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:36:00.962385 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.962353    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3f42cca0-3402-44fa-8b50-b5143dc6cc1d" (UID: "3f42cca0-3402-44fa-8b50-b5143dc6cc1d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:36:00.962522 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.962497    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "3f42cca0-3402-44fa-8b50-b5143dc6cc1d" (UID: "3f42cca0-3402-44fa-8b50-b5143dc6cc1d"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:36:00.968225 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:00.968204    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-web-config" (OuterVolumeSpecName: "web-config") pod "3f42cca0-3402-44fa-8b50-b5143dc6cc1d" (UID: "3f42cca0-3402-44fa-8b50-b5143dc6cc1d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:36:01.053931 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.053877    2570 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-secret-grpc-tls\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 19:36:01.053931 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.053921    2570 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-config-out\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 19:36:01.053931 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.053930    2570 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-configmap-metrics-client-ca\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 19:36:01.053931 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.053942    2570 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-config\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 19:36:01.053931 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.053950    2570 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-web-config\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 19:36:01.054289 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.053959    2570 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-tls-assets\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 19:36:01.054289 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.053967    2570 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 19:36:01.054289 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.054002    2570 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 19:36:01.054289 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.054012    2570 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 19:36:01.054289 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.054020    2570 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-secret-metrics-client-certs\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 19:36:01.054289 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.054028    2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 19:36:01.054289 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.054036    2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 19:36:01.054289 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.054044    2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 19:36:01.054289 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.054052    2570 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 19:36:01.054289 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.054060    2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-prometheus-k8s-db\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 19:36:01.054289 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.054068    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qcwrv\" (UniqueName: \"kubernetes.io/projected/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-kube-api-access-qcwrv\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 19:36:01.054289 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.054076    2570 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 19:36:01.054289 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.054084    2570 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f42cca0-3402-44fa-8b50-b5143dc6cc1d-secret-kube-rbac-proxy\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 19:36:01.798521 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.798484    2570 generic.go:356] "Generic (PLEG): container finished" podID="3f42cca0-3402-44fa-8b50-b5143dc6cc1d" containerID="42a6a17fef86fd52d2364b54e449e3a898405fc066936209933c085fff96ec86" exitCode=0
Jul 28 19:36:01.798950 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.798570    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:01.798950 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.798574    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f42cca0-3402-44fa-8b50-b5143dc6cc1d","Type":"ContainerDied","Data":"42a6a17fef86fd52d2364b54e449e3a898405fc066936209933c085fff96ec86"}
Jul 28 19:36:01.798950 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.798643    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f42cca0-3402-44fa-8b50-b5143dc6cc1d","Type":"ContainerDied","Data":"80eead861d71c0f4699fe45d2e13552a5b963d9da8ca13bfff499d4c9dcaa9a4"}
Jul 28 19:36:01.798950 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.798687    2570 scope.go:117] "RemoveContainer" containerID="c9dc18a96f9afb46601d2796a9593c45b8cfc541c35ac165a5f0b5e6d68edf2c"
Jul 28 19:36:01.806302 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.806286    2570 scope.go:117] "RemoveContainer" containerID="66dee1de6d6853c7e3219ae18758e9420f9980283b357cebd32d4b7dcff1d498"
Jul 28 19:36:01.813210 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.813189    2570 scope.go:117] "RemoveContainer" containerID="c1261488392177b569d4083924cc717dc2d5219185e84ea62b1779a8ab153e47"
Jul 28 19:36:01.820002 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.819960    2570 scope.go:117] "RemoveContainer" containerID="42a6a17fef86fd52d2364b54e449e3a898405fc066936209933c085fff96ec86"
Jul 28 19:36:01.820602 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.820551    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 19:36:01.825122 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.825103    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 19:36:01.826942 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.826930    2570 scope.go:117] "RemoveContainer" containerID="7039c6897088b36db527d0ad2f46c5a789a4e4e33c3074481e52d9f88c669f2a"
Jul 28 19:36:01.833168 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.833150    2570 scope.go:117] "RemoveContainer" containerID="0f051d254da9c92fdda5f40b18364aba6ad33b0745d1ddaaf041345f9aac9f7c"
Jul 28 19:36:01.840128 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.840069    2570 scope.go:117] "RemoveContainer" containerID="eaa219edb82ccc99f45954cfeb1af941299d89087308e0df71b7e75880425dfe"
Jul 28 19:36:01.846953 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.846932    2570 scope.go:117] "RemoveContainer" containerID="c9dc18a96f9afb46601d2796a9593c45b8cfc541c35ac165a5f0b5e6d68edf2c"
Jul 28 19:36:01.847312 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:36:01.847271    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9dc18a96f9afb46601d2796a9593c45b8cfc541c35ac165a5f0b5e6d68edf2c\": container with ID starting with c9dc18a96f9afb46601d2796a9593c45b8cfc541c35ac165a5f0b5e6d68edf2c not found: ID does not exist" containerID="c9dc18a96f9afb46601d2796a9593c45b8cfc541c35ac165a5f0b5e6d68edf2c"
Jul 28 19:36:01.847385 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.847316    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9dc18a96f9afb46601d2796a9593c45b8cfc541c35ac165a5f0b5e6d68edf2c"} err="failed to get container status \"c9dc18a96f9afb46601d2796a9593c45b8cfc541c35ac165a5f0b5e6d68edf2c\": rpc error: code = NotFound desc = could not find container \"c9dc18a96f9afb46601d2796a9593c45b8cfc541c35ac165a5f0b5e6d68edf2c\": container with ID starting with c9dc18a96f9afb46601d2796a9593c45b8cfc541c35ac165a5f0b5e6d68edf2c not found: ID does not exist"
Jul 28 19:36:01.847385 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.847335    2570 scope.go:117] "RemoveContainer" containerID="66dee1de6d6853c7e3219ae18758e9420f9980283b357cebd32d4b7dcff1d498"
Jul 28 19:36:01.847589 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:36:01.847573    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66dee1de6d6853c7e3219ae18758e9420f9980283b357cebd32d4b7dcff1d498\": container with ID starting with 66dee1de6d6853c7e3219ae18758e9420f9980283b357cebd32d4b7dcff1d498 not found: ID does not exist" containerID="66dee1de6d6853c7e3219ae18758e9420f9980283b357cebd32d4b7dcff1d498"
Jul 28 19:36:01.847647 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.847619    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66dee1de6d6853c7e3219ae18758e9420f9980283b357cebd32d4b7dcff1d498"} err="failed to get container status \"66dee1de6d6853c7e3219ae18758e9420f9980283b357cebd32d4b7dcff1d498\": rpc error: code = NotFound desc = could not find container \"66dee1de6d6853c7e3219ae18758e9420f9980283b357cebd32d4b7dcff1d498\": container with ID starting with 66dee1de6d6853c7e3219ae18758e9420f9980283b357cebd32d4b7dcff1d498 not found: ID does not exist"
Jul 28 19:36:01.847647 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.847632    2570 scope.go:117] "RemoveContainer" containerID="c1261488392177b569d4083924cc717dc2d5219185e84ea62b1779a8ab153e47"
Jul 28 19:36:01.847871 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:36:01.847852    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1261488392177b569d4083924cc717dc2d5219185e84ea62b1779a8ab153e47\": container with ID starting with c1261488392177b569d4083924cc717dc2d5219185e84ea62b1779a8ab153e47 not found: ID does not exist" containerID="c1261488392177b569d4083924cc717dc2d5219185e84ea62b1779a8ab153e47"
Jul 28 19:36:01.847942 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.847878    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1261488392177b569d4083924cc717dc2d5219185e84ea62b1779a8ab153e47"} err="failed to get container status \"c1261488392177b569d4083924cc717dc2d5219185e84ea62b1779a8ab153e47\": rpc error: code = NotFound desc = could not find container \"c1261488392177b569d4083924cc717dc2d5219185e84ea62b1779a8ab153e47\": container with ID starting with c1261488392177b569d4083924cc717dc2d5219185e84ea62b1779a8ab153e47 not found: ID does not exist"
Jul 28 19:36:01.847942 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.847899    2570 scope.go:117] "RemoveContainer" containerID="42a6a17fef86fd52d2364b54e449e3a898405fc066936209933c085fff96ec86"
Jul 28 19:36:01.848146 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.847999    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 19:36:01.848190 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:36:01.848176    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42a6a17fef86fd52d2364b54e449e3a898405fc066936209933c085fff96ec86\": container with ID starting with 42a6a17fef86fd52d2364b54e449e3a898405fc066936209933c085fff96ec86 not found: ID does not exist" containerID="42a6a17fef86fd52d2364b54e449e3a898405fc066936209933c085fff96ec86"
Jul 28 19:36:01.848232 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.848197    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42a6a17fef86fd52d2364b54e449e3a898405fc066936209933c085fff96ec86"} err="failed to get container status \"42a6a17fef86fd52d2364b54e449e3a898405fc066936209933c085fff96ec86\": rpc error: code = NotFound desc = could not find container \"42a6a17fef86fd52d2364b54e449e3a898405fc066936209933c085fff96ec86\": container with ID starting with 42a6a17fef86fd52d2364b54e449e3a898405fc066936209933c085fff96ec86 not found: ID does not exist"
Jul 28 19:36:01.848232 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.848212    2570 scope.go:117] "RemoveContainer" containerID="7039c6897088b36db527d0ad2f46c5a789a4e4e33c3074481e52d9f88c669f2a"
Jul 28 19:36:01.848304 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.848235    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f42cca0-3402-44fa-8b50-b5143dc6cc1d" containerName="kube-rbac-proxy-web"
Jul 28 19:36:01.848304 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.848246    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f42cca0-3402-44fa-8b50-b5143dc6cc1d" containerName="kube-rbac-proxy-web"
Jul 28 19:36:01.848304 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.848260    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f42cca0-3402-44fa-8b50-b5143dc6cc1d" containerName="kube-rbac-proxy-thanos"
Jul 28 19:36:01.848304 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.848269    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f42cca0-3402-44fa-8b50-b5143dc6cc1d" containerName="kube-rbac-proxy-thanos"
Jul 28 19:36:01.848304 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.848280    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f42cca0-3402-44fa-8b50-b5143dc6cc1d" containerName="init-config-reloader"
Jul 28 19:36:01.848304 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.848288    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f42cca0-3402-44fa-8b50-b5143dc6cc1d" containerName="init-config-reloader"
Jul 28 19:36:01.848304 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.848300    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f42cca0-3402-44fa-8b50-b5143dc6cc1d" containerName="kube-rbac-proxy"
Jul 28 19:36:01.848579 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.848308    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f42cca0-3402-44fa-8b50-b5143dc6cc1d" containerName="kube-rbac-proxy"
Jul 28 19:36:01.848579 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.848319    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f42cca0-3402-44fa-8b50-b5143dc6cc1d" containerName="prometheus"
Jul 28 19:36:01.848579 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.848328    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f42cca0-3402-44fa-8b50-b5143dc6cc1d" containerName="prometheus"
Jul 28 19:36:01.848579 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.848338    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f42cca0-3402-44fa-8b50-b5143dc6cc1d" containerName="thanos-sidecar"
Jul 28 19:36:01.848579 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.848345    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f42cca0-3402-44fa-8b50-b5143dc6cc1d" containerName="thanos-sidecar"
Jul 28 19:36:01.848579 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.848367    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f42cca0-3402-44fa-8b50-b5143dc6cc1d" containerName="config-reloader"
Jul 28 19:36:01.848579 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.848376    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f42cca0-3402-44fa-8b50-b5143dc6cc1d" containerName="config-reloader"
Jul 28 19:36:01.848579 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.848430    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f42cca0-3402-44fa-8b50-b5143dc6cc1d" containerName="kube-rbac-proxy-web"
Jul 28 19:36:01.848579 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.848439    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f42cca0-3402-44fa-8b50-b5143dc6cc1d" containerName="kube-rbac-proxy"
Jul 28 19:36:01.848579 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.848445    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f42cca0-3402-44fa-8b50-b5143dc6cc1d" containerName="prometheus"
Jul 28 19:36:01.848579 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:36:01.848441    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7039c6897088b36db527d0ad2f46c5a789a4e4e33c3074481e52d9f88c669f2a\": container with ID starting with 7039c6897088b36db527d0ad2f46c5a789a4e4e33c3074481e52d9f88c669f2a not found: ID does not exist" containerID="7039c6897088b36db527d0ad2f46c5a789a4e4e33c3074481e52d9f88c669f2a"
Jul 28 19:36:01.848579 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.848475    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7039c6897088b36db527d0ad2f46c5a789a4e4e33c3074481e52d9f88c669f2a"} err="failed to get container status \"7039c6897088b36db527d0ad2f46c5a789a4e4e33c3074481e52d9f88c669f2a\": rpc error: code = NotFound desc = could not find container \"7039c6897088b36db527d0ad2f46c5a789a4e4e33c3074481e52d9f88c669f2a\": container with ID starting with 7039c6897088b36db527d0ad2f46c5a789a4e4e33c3074481e52d9f88c669f2a not found: ID does not exist"
Jul 28 19:36:01.848579 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.848496    2570 scope.go:117] "RemoveContainer" containerID="0f051d254da9c92fdda5f40b18364aba6ad33b0745d1ddaaf041345f9aac9f7c"
Jul 28 19:36:01.848579 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.848451    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f42cca0-3402-44fa-8b50-b5143dc6cc1d" containerName="config-reloader"
Jul 28 19:36:01.848579 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.848536    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f42cca0-3402-44fa-8b50-b5143dc6cc1d" containerName="thanos-sidecar"
Jul 28 19:36:01.848579 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.848541    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f42cca0-3402-44fa-8b50-b5143dc6cc1d" containerName="kube-rbac-proxy-thanos"
Jul 28 19:36:01.849129 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:36:01.848715    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f051d254da9c92fdda5f40b18364aba6ad33b0745d1ddaaf041345f9aac9f7c\": container with ID starting with 0f051d254da9c92fdda5f40b18364aba6ad33b0745d1ddaaf041345f9aac9f7c not found: ID does not exist" containerID="0f051d254da9c92fdda5f40b18364aba6ad33b0745d1ddaaf041345f9aac9f7c"
Jul 28 19:36:01.849129 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.848733    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f051d254da9c92fdda5f40b18364aba6ad33b0745d1ddaaf041345f9aac9f7c"} err="failed to get container status \"0f051d254da9c92fdda5f40b18364aba6ad33b0745d1ddaaf041345f9aac9f7c\": rpc error: code = NotFound desc = could not find container \"0f051d254da9c92fdda5f40b18364aba6ad33b0745d1ddaaf041345f9aac9f7c\": container with ID starting with 0f051d254da9c92fdda5f40b18364aba6ad33b0745d1ddaaf041345f9aac9f7c not found: ID does not exist"
Jul 28 19:36:01.849129 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.848749    2570 scope.go:117] "RemoveContainer" containerID="eaa219edb82ccc99f45954cfeb1af941299d89087308e0df71b7e75880425dfe"
Jul 28 19:36:01.849129 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:36:01.848994    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eaa219edb82ccc99f45954cfeb1af941299d89087308e0df71b7e75880425dfe\": container with ID starting with eaa219edb82ccc99f45954cfeb1af941299d89087308e0df71b7e75880425dfe not found: ID does not exist" containerID="eaa219edb82ccc99f45954cfeb1af941299d89087308e0df71b7e75880425dfe"
Jul 28 19:36:01.849129 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.849019    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaa219edb82ccc99f45954cfeb1af941299d89087308e0df71b7e75880425dfe"} err="failed to get container status \"eaa219edb82ccc99f45954cfeb1af941299d89087308e0df71b7e75880425dfe\": rpc error: code = NotFound desc = could not find container \"eaa219edb82ccc99f45954cfeb1af941299d89087308e0df71b7e75880425dfe\": container with ID starting with eaa219edb82ccc99f45954cfeb1af941299d89087308e0df71b7e75880425dfe not found: ID does not exist"
Jul 28 19:36:01.852071 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.852055    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:01.854559 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.854541    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bfqval51igv5t\""
Jul 28 19:36:01.854825 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.854799    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-s9d7p\""
Jul 28 19:36:01.854825 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.854808    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 28 19:36:01.854962 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.854823    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 28 19:36:01.854962 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.854831    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 28 19:36:01.854962 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.854808    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 28 19:36:01.855227 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.855206    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 28 19:36:01.855339 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.855324    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 28 19:36:01.855434 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.855418    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 28 19:36:01.855531 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.855517    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 28 19:36:01.855757 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.855740    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 28 19:36:01.855846 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.855748    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 28 19:36:01.855846 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.855774    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 28 19:36:01.855952 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.855776    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 28 19:36:01.856112 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.856074    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 28 19:36:01.858053 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.858026    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 28 19:36:01.860740 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.860724    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 28 19:36:01.866405 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.866386    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 19:36:01.960264 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.960230    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a255cfcd-4539-4711-98c1-e30b575c6494-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:01.960264 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.960266    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a255cfcd-4539-4711-98c1-e30b575c6494-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:01.960485 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.960286    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a255cfcd-4539-4711-98c1-e30b575c6494-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:01.960485 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.960304    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a255cfcd-4539-4711-98c1-e30b575c6494-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:01.960485 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.960321    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a255cfcd-4539-4711-98c1-e30b575c6494-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:01.960485 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.960382    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a255cfcd-4539-4711-98c1-e30b575c6494-config\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:01.960485 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.960408    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a255cfcd-4539-4711-98c1-e30b575c6494-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:01.960485 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.960431    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a255cfcd-4539-4711-98c1-e30b575c6494-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:01.960485 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.960449    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a255cfcd-4539-4711-98c1-e30b575c6494-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:01.960684 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.960484    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a255cfcd-4539-4711-98c1-e30b575c6494-config-out\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:01.960684 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.960513    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a255cfcd-4539-4711-98c1-e30b575c6494-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:01.960684 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.960543    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a255cfcd-4539-4711-98c1-e30b575c6494-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:01.960684 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.960563    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a255cfcd-4539-4711-98c1-e30b575c6494-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:01.960684 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.960580    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a255cfcd-4539-4711-98c1-e30b575c6494-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:01.960684 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.960599    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a255cfcd-4539-4711-98c1-e30b575c6494-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:01.960684 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.960613    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a255cfcd-4539-4711-98c1-e30b575c6494-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:01.960684 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.960662    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zltkx\" (UniqueName: \"kubernetes.io/projected/a255cfcd-4539-4711-98c1-e30b575c6494-kube-api-access-zltkx\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:01.960907 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.960687    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a255cfcd-4539-4711-98c1-e30b575c6494-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:01.960907 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.960727    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a255cfcd-4539-4711-98c1-e30b575c6494-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:01.960907 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:01.960742    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a255cfcd-4539-4711-98c1-e30b575c6494-web-config\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.062069 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.062028    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a255cfcd-4539-4711-98c1-e30b575c6494-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.062069 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.062070    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a255cfcd-4539-4711-98c1-e30b575c6494-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.062324 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.062093    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a255cfcd-4539-4711-98c1-e30b575c6494-config-out\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.062324 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.062116    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a255cfcd-4539-4711-98c1-e30b575c6494-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.062324 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.062150    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a255cfcd-4539-4711-98c1-e30b575c6494-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.062324 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.062174    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a255cfcd-4539-4711-98c1-e30b575c6494-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.062324 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.062199    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a255cfcd-4539-4711-98c1-e30b575c6494-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.062324 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.062226    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a255cfcd-4539-4711-98c1-e30b575c6494-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.062912 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.062878    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a255cfcd-4539-4711-98c1-e30b575c6494-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.063048 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.062943    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a255cfcd-4539-4711-98c1-e30b575c6494-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.063048 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.063013    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zltkx\" (UniqueName: \"kubernetes.io/projected/a255cfcd-4539-4711-98c1-e30b575c6494-kube-api-access-zltkx\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.063048 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.063047    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a255cfcd-4539-4711-98c1-e30b575c6494-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.063226 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.063079    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a255cfcd-4539-4711-98c1-e30b575c6494-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.063226 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.063101    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a255cfcd-4539-4711-98c1-e30b575c6494-web-config\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.063226 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.063131    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a255cfcd-4539-4711-98c1-e30b575c6494-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.063226 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.063164    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a255cfcd-4539-4711-98c1-e30b575c6494-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.063226 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.063193    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a255cfcd-4539-4711-98c1-e30b575c6494-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.063226 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.063221    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a255cfcd-4539-4711-98c1-e30b575c6494-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.063730 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.063248    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a255cfcd-4539-4711-98c1-e30b575c6494-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.063730 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.063320    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a255cfcd-4539-4711-98c1-e30b575c6494-config\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.063730 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.063346    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a255cfcd-4539-4711-98c1-e30b575c6494-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.064554 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.064525    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a255cfcd-4539-4711-98c1-e30b575c6494-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.064663 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.064584    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a255cfcd-4539-4711-98c1-e30b575c6494-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.064730 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.064676    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a255cfcd-4539-4711-98c1-e30b575c6494-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.065538 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.065414    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a255cfcd-4539-4711-98c1-e30b575c6494-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.066011 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.065969    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a255cfcd-4539-4711-98c1-e30b575c6494-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.066155 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.066132    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a255cfcd-4539-4711-98c1-e30b575c6494-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.066713 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.066691    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a255cfcd-4539-4711-98c1-e30b575c6494-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.067071 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.067045    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a255cfcd-4539-4711-98c1-e30b575c6494-config-out\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.067283 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.067257    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a255cfcd-4539-4711-98c1-e30b575c6494-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.067387 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.067314    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a255cfcd-4539-4711-98c1-e30b575c6494-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.067783 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.067741    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a255cfcd-4539-4711-98c1-e30b575c6494-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.067868 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.067786    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a255cfcd-4539-4711-98c1-e30b575c6494-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.067868 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.067841    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a255cfcd-4539-4711-98c1-e30b575c6494-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.068147 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.068126    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a255cfcd-4539-4711-98c1-e30b575c6494-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.068147 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.068138    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a255cfcd-4539-4711-98c1-e30b575c6494-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.068337 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.068314    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a255cfcd-4539-4711-98c1-e30b575c6494-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.068836 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.068819    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a255cfcd-4539-4711-98c1-e30b575c6494-config\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.069653 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.069639    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a255cfcd-4539-4711-98c1-e30b575c6494-web-config\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.072133 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.072111    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zltkx\" (UniqueName: \"kubernetes.io/projected/a255cfcd-4539-4711-98c1-e30b575c6494-kube-api-access-zltkx\") pod \"prometheus-k8s-0\" (UID: \"a255cfcd-4539-4711-98c1-e30b575c6494\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.161889 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.161790    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:36:02.295631 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.295598    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 19:36:02.298823 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:36:02.298799    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda255cfcd_4539_4711_98c1_e30b575c6494.slice/crio-ec167f797f9e34a1a41b7ade2bacc0eb4f57da77a0955d42b72dca962b829c11 WatchSource:0}: Error finding container ec167f797f9e34a1a41b7ade2bacc0eb4f57da77a0955d42b72dca962b829c11: Status 404 returned error can't find the container with id ec167f797f9e34a1a41b7ade2bacc0eb4f57da77a0955d42b72dca962b829c11
Jul 28 19:36:02.804306 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.804273    2570 generic.go:356] "Generic (PLEG): container finished" podID="a255cfcd-4539-4711-98c1-e30b575c6494" containerID="6070145ed73b84662dbd15b53d277969a7a80f1fe078291b2316fd223a30dfcf" exitCode=0
Jul 28 19:36:02.804688 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.804343    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a255cfcd-4539-4711-98c1-e30b575c6494","Type":"ContainerDied","Data":"6070145ed73b84662dbd15b53d277969a7a80f1fe078291b2316fd223a30dfcf"}
Jul 28 19:36:02.804688 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:02.804406    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a255cfcd-4539-4711-98c1-e30b575c6494","Type":"ContainerStarted","Data":"ec167f797f9e34a1a41b7ade2bacc0eb4f57da77a0955d42b72dca962b829c11"}
Jul 28 19:36:03.572476 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:03.572437    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f42cca0-3402-44fa-8b50-b5143dc6cc1d" path="/var/lib/kubelet/pods/3f42cca0-3402-44fa-8b50-b5143dc6cc1d/volumes"
Jul 28 19:36:03.811284 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:03.811251    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a255cfcd-4539-4711-98c1-e30b575c6494","Type":"ContainerStarted","Data":"3b2dbb72214d7b8824177151a2b09eb2c7f56d7b8541eb8827779afbe5c86214"}
Jul 28 19:36:03.811646 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:03.811324    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a255cfcd-4539-4711-98c1-e30b575c6494","Type":"ContainerStarted","Data":"cc51dd0c314472972aabb50a451f864beb6d6e27116e5a4adda04b04af5ecd07"}
Jul 28 19:36:03.811646 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:03.811353    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a255cfcd-4539-4711-98c1-e30b575c6494","Type":"ContainerStarted","Data":"d54d3a9081a54662a73244f078949ff2b7f82311c7efb7e3da940df2795cdf3e"}
Jul 28 19:36:03.811646 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:03.811376    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a255cfcd-4539-4711-98c1-e30b575c6494","Type":"ContainerStarted","Data":"f5412f5d899910312f1a5543798939a534ce4866aefd3688e82161236b52dd30"}
Jul 28 19:36:03.811646 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:03.811404    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a255cfcd-4539-4711-98c1-e30b575c6494","Type":"ContainerStarted","Data":"410b3e0c99594c5f3f43b0eef5eda964473ad1357df9e2b60cd916a9e73c5d33"}
Jul 28 19:36:03.811646 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:03.811427    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a255cfcd-4539-4711-98c1-e30b575c6494","Type":"ContainerStarted","Data":"fad87fa9f4d16b85885aeef88ee64c56956d8a97ab40e9d46c595ab5e5ffc895"}
Jul 28 19:36:03.838247 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:03.838112    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.819683315 podStartE2EDuration="2.838090453s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.407138ms" isStatefulPod=false podCreationTimestamp="2026-07-28 19:36:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:36:03.835909847 +0000 UTC m=+376.787942179" watchObservedRunningTime="2026-07-28 19:36:03.838090453 +0000 UTC m=+376.790122783"
Jul 28 19:36:07.162846 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:36:07.162811    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:37:02.162347 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:37:02.162307    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:37:02.177165 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:37:02.177135    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:37:03.031295 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:37:03.031267    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 19:38:11.764482 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:11.764436    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-rljx4"]
Jul 28 19:38:11.767891 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:11.767871    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-rljx4"
Jul 28 19:38:11.769183 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:11.769159    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d28e390-a160-4cad-92b5-a367376e5c83-tmp\") pod \"opendatahub-operator-controller-manager-9ddd48bbd-rljx4\" (UID: \"1d28e390-a160-4cad-92b5-a367376e5c83\") " pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-rljx4"
Jul 28 19:38:11.769317 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:11.769197    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjltf\" (UniqueName: \"kubernetes.io/projected/1d28e390-a160-4cad-92b5-a367376e5c83-kube-api-access-wjltf\") pod \"opendatahub-operator-controller-manager-9ddd48bbd-rljx4\" (UID: \"1d28e390-a160-4cad-92b5-a367376e5c83\") " pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-rljx4"
Jul 28 19:38:11.769317 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:11.769225    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1d28e390-a160-4cad-92b5-a367376e5c83-manifests\") pod \"opendatahub-operator-controller-manager-9ddd48bbd-rljx4\" (UID: \"1d28e390-a160-4cad-92b5-a367376e5c83\") " pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-rljx4"
Jul 28 19:38:11.769317 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:11.769271    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d28e390-a160-4cad-92b5-a367376e5c83-webhook-cert\") pod \"opendatahub-operator-controller-manager-9ddd48bbd-rljx4\" (UID: \"1d28e390-a160-4cad-92b5-a367376e5c83\") " pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-rljx4"
Jul 28 19:38:11.769317 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:11.769299    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1d28e390-a160-4cad-92b5-a367376e5c83-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9ddd48bbd-rljx4\" (UID: \"1d28e390-a160-4cad-92b5-a367376e5c83\") " pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-rljx4"
Jul 28 19:38:11.770754 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:11.770733    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 28 19:38:11.770910 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:11.770893    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 28 19:38:11.771067 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:11.771047    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 28 19:38:11.771185 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:11.771051    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gvzp5\""
Jul 28 19:38:11.771801 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:11.771782    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 28 19:38:11.791215 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:11.791182    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-rljx4"]
Jul 28 19:38:11.869670 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:11.869634    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d28e390-a160-4cad-92b5-a367376e5c83-webhook-cert\") pod \"opendatahub-operator-controller-manager-9ddd48bbd-rljx4\" (UID: \"1d28e390-a160-4cad-92b5-a367376e5c83\") " pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-rljx4"
Jul 28 19:38:11.869865 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:11.869680    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1d28e390-a160-4cad-92b5-a367376e5c83-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9ddd48bbd-rljx4\" (UID: \"1d28e390-a160-4cad-92b5-a367376e5c83\") " pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-rljx4"
Jul 28 19:38:11.869865 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:11.869722    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d28e390-a160-4cad-92b5-a367376e5c83-tmp\") pod \"opendatahub-operator-controller-manager-9ddd48bbd-rljx4\" (UID: \"1d28e390-a160-4cad-92b5-a367376e5c83\") " pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-rljx4"
Jul 28 19:38:11.869865 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:11.869748    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjltf\" (UniqueName: \"kubernetes.io/projected/1d28e390-a160-4cad-92b5-a367376e5c83-kube-api-access-wjltf\") pod \"opendatahub-operator-controller-manager-9ddd48bbd-rljx4\" (UID: \"1d28e390-a160-4cad-92b5-a367376e5c83\") " pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-rljx4"
Jul 28 19:38:11.869865 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:11.869768    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1d28e390-a160-4cad-92b5-a367376e5c83-manifests\") pod \"opendatahub-operator-controller-manager-9ddd48bbd-rljx4\" (UID: \"1d28e390-a160-4cad-92b5-a367376e5c83\") " pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-rljx4"
Jul 28 19:38:11.870297 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:11.870274    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1d28e390-a160-4cad-92b5-a367376e5c83-manifests\") pod \"opendatahub-operator-controller-manager-9ddd48bbd-rljx4\" (UID: \"1d28e390-a160-4cad-92b5-a367376e5c83\") " pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-rljx4"
Jul 28 19:38:11.872040 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:11.872015    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d28e390-a160-4cad-92b5-a367376e5c83-tmp\") pod \"opendatahub-operator-controller-manager-9ddd48bbd-rljx4\" (UID: \"1d28e390-a160-4cad-92b5-a367376e5c83\") " pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-rljx4"
Jul 28 19:38:11.872149 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:11.872091    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1d28e390-a160-4cad-92b5-a367376e5c83-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9ddd48bbd-rljx4\" (UID: \"1d28e390-a160-4cad-92b5-a367376e5c83\") " pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-rljx4"
Jul 28 19:38:11.872327 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:11.872308    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d28e390-a160-4cad-92b5-a367376e5c83-webhook-cert\") pod \"opendatahub-operator-controller-manager-9ddd48bbd-rljx4\" (UID: \"1d28e390-a160-4cad-92b5-a367376e5c83\") " pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-rljx4"
Jul 28 19:38:11.877400 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:11.877378    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjltf\" (UniqueName: \"kubernetes.io/projected/1d28e390-a160-4cad-92b5-a367376e5c83-kube-api-access-wjltf\") pod \"opendatahub-operator-controller-manager-9ddd48bbd-rljx4\" (UID: \"1d28e390-a160-4cad-92b5-a367376e5c83\") " pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-rljx4"
Jul 28 19:38:12.080445 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:12.080352    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-rljx4"
Jul 28 19:38:12.229802 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:12.229772    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-rljx4"]
Jul 28 19:38:12.235185 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:38:12.235144    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d28e390_a160_4cad_92b5_a367376e5c83.slice/crio-8865eba4a7ee865624a97565795ebc494b552d9fc5f8fbb30abf93427da3efdd WatchSource:0}: Error finding container 8865eba4a7ee865624a97565795ebc494b552d9fc5f8fbb30abf93427da3efdd: Status 404 returned error can't find the container with id 8865eba4a7ee865624a97565795ebc494b552d9fc5f8fbb30abf93427da3efdd
Jul 28 19:38:12.237079 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:12.237058    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 19:38:12.251582 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:12.251554    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-rljx4" event={"ID":"1d28e390-a160-4cad-92b5-a367376e5c83","Type":"ContainerStarted","Data":"8865eba4a7ee865624a97565795ebc494b552d9fc5f8fbb30abf93427da3efdd"}
Jul 28 19:38:15.264262 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:15.264228    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-rljx4" event={"ID":"1d28e390-a160-4cad-92b5-a367376e5c83","Type":"ContainerStarted","Data":"8ec0e22552e89d0b17eec3101b0f4a86447d8a4c0e46df32c00b952d9c1360ac"}
Jul 28 19:38:17.273169 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:17.273135    2570 generic.go:356] "Generic (PLEG): container finished" podID="1d28e390-a160-4cad-92b5-a367376e5c83" containerID="8ec0e22552e89d0b17eec3101b0f4a86447d8a4c0e46df32c00b952d9c1360ac" exitCode=0
Jul 28 19:38:17.273564 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:17.273189    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-rljx4" event={"ID":"1d28e390-a160-4cad-92b5-a367376e5c83","Type":"ContainerDied","Data":"8ec0e22552e89d0b17eec3101b0f4a86447d8a4c0e46df32c00b952d9c1360ac"}
Jul 28 19:38:18.279267 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:18.279227    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-rljx4" event={"ID":"1d28e390-a160-4cad-92b5-a367376e5c83","Type":"ContainerStarted","Data":"4cd4ad469004954dcd16941da531452078c2c866a0c33c08fc39888852b5e10f"}
Jul 28 19:38:18.279651 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:18.279458    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-rljx4"
Jul 28 19:38:18.299164 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:18.299117    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-rljx4" podStartSLOduration=2.904323747 podStartE2EDuration="7.299102331s" totalImagesPullingTime="3.344726716s" totalInitContainerRuntime="1.050051868s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:38:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:38:18.2976076 +0000 UTC m=+511.249639953" watchObservedRunningTime="2026-07-28 19:38:18.299102331 +0000 UTC m=+511.251134663"
Jul 28 19:38:29.284940 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:29.284907    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-rljx4"
Jul 28 19:38:38.045225 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:38.045195    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c85c6bd85-pkk97"]
Jul 28 19:38:38.057050 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:38.057021    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c85c6bd85-pkk97"
Jul 28 19:38:38.057206 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:38.057146    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c85c6bd85-pkk97"]
Jul 28 19:38:38.060759 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:38.060728    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-hds79\""
Jul 28 19:38:38.060913 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:38.060731    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 28 19:38:38.061199 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:38.061176    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 28 19:38:38.061348 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:38.061179    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 28 19:38:38.061500 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:38.061234    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 28 19:38:38.061576 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:38.061235    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 28 19:38:38.166357 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:38.166324    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8de741e-dcac-43aa-ad48-15fef51e17a9-cert\") pod \"lws-controller-manager-6c85c6bd85-pkk97\" (UID: \"b8de741e-dcac-43aa-ad48-15fef51e17a9\") " pod="openshift-lws-operator/lws-controller-manager-6c85c6bd85-pkk97"
Jul 28 19:38:38.166532 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:38.166371    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhzwd\" (UniqueName: \"kubernetes.io/projected/b8de741e-dcac-43aa-ad48-15fef51e17a9-kube-api-access-rhzwd\") pod \"lws-controller-manager-6c85c6bd85-pkk97\" (UID: \"b8de741e-dcac-43aa-ad48-15fef51e17a9\") " pod="openshift-lws-operator/lws-controller-manager-6c85c6bd85-pkk97"
Jul 28 19:38:38.166532 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:38.166460    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b8de741e-dcac-43aa-ad48-15fef51e17a9-manager-config\") pod \"lws-controller-manager-6c85c6bd85-pkk97\" (UID: \"b8de741e-dcac-43aa-ad48-15fef51e17a9\") " pod="openshift-lws-operator/lws-controller-manager-6c85c6bd85-pkk97"
Jul 28 19:38:38.166532 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:38.166501    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b8de741e-dcac-43aa-ad48-15fef51e17a9-metrics-cert\") pod \"lws-controller-manager-6c85c6bd85-pkk97\" (UID: \"b8de741e-dcac-43aa-ad48-15fef51e17a9\") " pod="openshift-lws-operator/lws-controller-manager-6c85c6bd85-pkk97"
Jul 28 19:38:38.267481 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:38.267447    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b8de741e-dcac-43aa-ad48-15fef51e17a9-metrics-cert\") pod \"lws-controller-manager-6c85c6bd85-pkk97\" (UID: \"b8de741e-dcac-43aa-ad48-15fef51e17a9\") " pod="openshift-lws-operator/lws-controller-manager-6c85c6bd85-pkk97"
Jul 28 19:38:38.267481 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:38.267481    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8de741e-dcac-43aa-ad48-15fef51e17a9-cert\") pod \"lws-controller-manager-6c85c6bd85-pkk97\" (UID: \"b8de741e-dcac-43aa-ad48-15fef51e17a9\") " pod="openshift-lws-operator/lws-controller-manager-6c85c6bd85-pkk97"
Jul 28 19:38:38.267711 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:38.267509    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhzwd\" (UniqueName: \"kubernetes.io/projected/b8de741e-dcac-43aa-ad48-15fef51e17a9-kube-api-access-rhzwd\") pod \"lws-controller-manager-6c85c6bd85-pkk97\" (UID: \"b8de741e-dcac-43aa-ad48-15fef51e17a9\") " pod="openshift-lws-operator/lws-controller-manager-6c85c6bd85-pkk97"
Jul 28 19:38:38.267711 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:38.267561    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b8de741e-dcac-43aa-ad48-15fef51e17a9-manager-config\") pod \"lws-controller-manager-6c85c6bd85-pkk97\" (UID: \"b8de741e-dcac-43aa-ad48-15fef51e17a9\") " pod="openshift-lws-operator/lws-controller-manager-6c85c6bd85-pkk97"
Jul 28 19:38:38.268286 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:38.268263    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b8de741e-dcac-43aa-ad48-15fef51e17a9-manager-config\") pod \"lws-controller-manager-6c85c6bd85-pkk97\" (UID: \"b8de741e-dcac-43aa-ad48-15fef51e17a9\") " pod="openshift-lws-operator/lws-controller-manager-6c85c6bd85-pkk97"
Jul 28 19:38:38.269924 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:38.269905    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8de741e-dcac-43aa-ad48-15fef51e17a9-cert\") pod \"lws-controller-manager-6c85c6bd85-pkk97\" (UID: \"b8de741e-dcac-43aa-ad48-15fef51e17a9\") " pod="openshift-lws-operator/lws-controller-manager-6c85c6bd85-pkk97"
Jul 28 19:38:38.270065 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:38.270040    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b8de741e-dcac-43aa-ad48-15fef51e17a9-metrics-cert\") pod \"lws-controller-manager-6c85c6bd85-pkk97\" (UID: \"b8de741e-dcac-43aa-ad48-15fef51e17a9\") " pod="openshift-lws-operator/lws-controller-manager-6c85c6bd85-pkk97"
Jul 28 19:38:38.284258 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:38.284229    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhzwd\" (UniqueName: \"kubernetes.io/projected/b8de741e-dcac-43aa-ad48-15fef51e17a9-kube-api-access-rhzwd\") pod \"lws-controller-manager-6c85c6bd85-pkk97\" (UID: \"b8de741e-dcac-43aa-ad48-15fef51e17a9\") " pod="openshift-lws-operator/lws-controller-manager-6c85c6bd85-pkk97"
Jul 28 19:38:38.367661 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:38.367573    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c85c6bd85-pkk97"
Jul 28 19:38:38.495652 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:38.495497    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c85c6bd85-pkk97"]
Jul 28 19:38:38.498106 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:38:38.498084    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8de741e_dcac_43aa_ad48_15fef51e17a9.slice/crio-985f522fc2a20f8bd3a92a5c35dbdd7459c9b38acf86f62db8b71ca52d4999d7 WatchSource:0}: Error finding container 985f522fc2a20f8bd3a92a5c35dbdd7459c9b38acf86f62db8b71ca52d4999d7: Status 404 returned error can't find the container with id 985f522fc2a20f8bd3a92a5c35dbdd7459c9b38acf86f62db8b71ca52d4999d7
Jul 28 19:38:39.358653 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:39.358559    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c85c6bd85-pkk97" event={"ID":"b8de741e-dcac-43aa-ad48-15fef51e17a9","Type":"ContainerStarted","Data":"985f522fc2a20f8bd3a92a5c35dbdd7459c9b38acf86f62db8b71ca52d4999d7"}
Jul 28 19:38:40.606271 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:40.606203    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-zsbhm"]
Jul 28 19:38:40.609716 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:40.609695    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zsbhm"
Jul 28 19:38:40.612279 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:40.612240    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 28 19:38:40.612456 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:40.612336    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 28 19:38:40.612618 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:40.612603    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 28 19:38:40.612695 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:40.612631    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 28 19:38:40.612695 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:40.612633    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 28 19:38:40.613513 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:40.613410    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 28 19:38:40.613513 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:40.613423    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-pkbvx\""
Jul 28 19:38:40.620518 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:40.620483    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-zsbhm"]
Jul 28 19:38:40.689074 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:40.689023    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/04facac8-04e5-413d-855a-a1bb83e0ee66-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-zsbhm\" (UID: \"04facac8-04e5-413d-855a-a1bb83e0ee66\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zsbhm"
Jul 28 19:38:40.689074 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:40.689081    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04facac8-04e5-413d-855a-a1bb83e0ee66-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-zsbhm\" (UID: \"04facac8-04e5-413d-855a-a1bb83e0ee66\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zsbhm"
Jul 28 19:38:40.689319 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:40.689113    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/04facac8-04e5-413d-855a-a1bb83e0ee66-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-zsbhm\" (UID: \"04facac8-04e5-413d-855a-a1bb83e0ee66\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zsbhm"
Jul 28 19:38:40.689319 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:40.689147    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s8wc\" (UniqueName: \"kubernetes.io/projected/04facac8-04e5-413d-855a-a1bb83e0ee66-kube-api-access-2s8wc\") pod \"istiod-openshift-gateway-5677ccb49b-zsbhm\" (UID: \"04facac8-04e5-413d-855a-a1bb83e0ee66\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zsbhm"
Jul 28 19:38:40.689319 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:40.689246    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/04facac8-04e5-413d-855a-a1bb83e0ee66-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-zsbhm\" (UID: \"04facac8-04e5-413d-855a-a1bb83e0ee66\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zsbhm"
Jul 28 19:38:40.689319 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:40.689297    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/04facac8-04e5-413d-855a-a1bb83e0ee66-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-zsbhm\" (UID: \"04facac8-04e5-413d-855a-a1bb83e0ee66\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zsbhm"
Jul 28 19:38:40.689492 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:40.689328    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04facac8-04e5-413d-855a-a1bb83e0ee66-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-zsbhm\" (UID: \"04facac8-04e5-413d-855a-a1bb83e0ee66\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zsbhm"
Jul 28 19:38:40.790538 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:40.790501    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/04facac8-04e5-413d-855a-a1bb83e0ee66-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-zsbhm\" (UID: \"04facac8-04e5-413d-855a-a1bb83e0ee66\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zsbhm"
Jul 28 19:38:40.790538 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:40.790541    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04facac8-04e5-413d-855a-a1bb83e0ee66-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-zsbhm\" (UID: \"04facac8-04e5-413d-855a-a1bb83e0ee66\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zsbhm"
Jul 28 19:38:40.790756 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:40.790566    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/04facac8-04e5-413d-855a-a1bb83e0ee66-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-zsbhm\" (UID: \"04facac8-04e5-413d-855a-a1bb83e0ee66\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zsbhm"
Jul 28 19:38:40.790756 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:40.790595    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s8wc\" (UniqueName: \"kubernetes.io/projected/04facac8-04e5-413d-855a-a1bb83e0ee66-kube-api-access-2s8wc\") pod \"istiod-openshift-gateway-5677ccb49b-zsbhm\" (UID: \"04facac8-04e5-413d-855a-a1bb83e0ee66\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zsbhm"
Jul 28 19:38:40.790756 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:40.790646    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/04facac8-04e5-413d-855a-a1bb83e0ee66-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-zsbhm\" (UID: \"04facac8-04e5-413d-855a-a1bb83e0ee66\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zsbhm"
Jul 28 19:38:40.790756 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:40.790683    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/04facac8-04e5-413d-855a-a1bb83e0ee66-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-zsbhm\" (UID: \"04facac8-04e5-413d-855a-a1bb83e0ee66\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zsbhm"
Jul 28 19:38:40.790756 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:40.790716    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04facac8-04e5-413d-855a-a1bb83e0ee66-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-zsbhm\" (UID: \"04facac8-04e5-413d-855a-a1bb83e0ee66\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zsbhm"
Jul 28 19:38:40.791442 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:40.791414    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/04facac8-04e5-413d-855a-a1bb83e0ee66-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-zsbhm\" (UID: \"04facac8-04e5-413d-855a-a1bb83e0ee66\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zsbhm"
Jul 28 19:38:40.792848 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:40.792824    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/04facac8-04e5-413d-855a-a1bb83e0ee66-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-zsbhm\" (UID: \"04facac8-04e5-413d-855a-a1bb83e0ee66\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zsbhm"
Jul 28 19:38:40.792987 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:40.792949    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04facac8-04e5-413d-855a-a1bb83e0ee66-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-zsbhm\" (UID: \"04facac8-04e5-413d-855a-a1bb83e0ee66\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zsbhm"
Jul 28 19:38:40.793068 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:40.793051    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/04facac8-04e5-413d-855a-a1bb83e0ee66-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-zsbhm\" (UID: \"04facac8-04e5-413d-855a-a1bb83e0ee66\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zsbhm"
Jul 28 19:38:40.793176 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:40.793162    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/04facac8-04e5-413d-855a-a1bb83e0ee66-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-zsbhm\" (UID: \"04facac8-04e5-413d-855a-a1bb83e0ee66\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zsbhm"
Jul 28 19:38:40.804887 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:40.804858    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s8wc\" (UniqueName: \"kubernetes.io/projected/04facac8-04e5-413d-855a-a1bb83e0ee66-kube-api-access-2s8wc\") pod \"istiod-openshift-gateway-5677ccb49b-zsbhm\" (UID: \"04facac8-04e5-413d-855a-a1bb83e0ee66\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zsbhm"
Jul 28 19:38:40.811170 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:40.811145    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04facac8-04e5-413d-855a-a1bb83e0ee66-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-zsbhm\" (UID: \"04facac8-04e5-413d-855a-a1bb83e0ee66\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zsbhm"
Jul 28 19:38:40.922439 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:40.922401    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zsbhm"
Jul 28 19:38:41.069410 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:41.069369    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-zsbhm"]
Jul 28 19:38:41.073948 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:38:41.073918    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04facac8_04e5_413d_855a_a1bb83e0ee66.slice/crio-dcc59d25fd12dce3ebec4ae1713876e1518cb50441777a3c8ef638c8d5bfdedd WatchSource:0}: Error finding container dcc59d25fd12dce3ebec4ae1713876e1518cb50441777a3c8ef638c8d5bfdedd: Status 404 returned error can't find the container with id dcc59d25fd12dce3ebec4ae1713876e1518cb50441777a3c8ef638c8d5bfdedd
Jul 28 19:38:41.367835 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:41.367800    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c85c6bd85-pkk97" event={"ID":"b8de741e-dcac-43aa-ad48-15fef51e17a9","Type":"ContainerStarted","Data":"74a1c498beef9c265b8a947365c89546fa1a2031c4686160b6952b597d6d4ee5"}
Jul 28 19:38:41.368059 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:41.367886    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6c85c6bd85-pkk97"
Jul 28 19:38:41.369067 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:41.369042    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zsbhm" event={"ID":"04facac8-04e5-413d-855a-a1bb83e0ee66","Type":"ContainerStarted","Data":"dcc59d25fd12dce3ebec4ae1713876e1518cb50441777a3c8ef638c8d5bfdedd"}
Jul 28 19:38:41.387270 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:41.387218    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6c85c6bd85-pkk97" podStartSLOduration=1.071339635 podStartE2EDuration="3.387202127s" totalImagesPullingTime="2.315862492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:38:41.386037233 +0000 UTC m=+534.338069585" watchObservedRunningTime="2026-07-28 19:38:41.387202127 +0000 UTC m=+534.339234456"
Jul 28 19:38:43.561958 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:43.561923    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 19:38:43.562261 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:43.562004    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 19:38:44.383140 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:44.383102    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zsbhm" event={"ID":"04facac8-04e5-413d-855a-a1bb83e0ee66","Type":"ContainerStarted","Data":"dd32d8ad3c08c024ca729e6774ea63e9b363105782388e880a6b1f25176bc099"}
Jul 28 19:38:44.383376 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:44.383357    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zsbhm"
Jul 28 19:38:44.384952 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:44.384927    2570 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-zsbhm container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 19:38:44.385096 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:44.385009    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zsbhm" podUID="04facac8-04e5-413d-855a-a1bb83e0ee66" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 19:38:44.407471 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:44.407405    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zsbhm" podStartSLOduration=1.921772452 podStartE2EDuration="4.407386729s" totalImagesPullingTime="2.485614277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:38:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:38:44.405108689 +0000 UTC m=+537.357141041" watchObservedRunningTime="2026-07-28 19:38:44.407386729 +0000 UTC m=+537.359419058"
Jul 28 19:38:45.387460 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:45.387436    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zsbhm"
Jul 28 19:38:52.376393 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:38:52.376354    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6c85c6bd85-pkk97"
Jul 28 19:41:51.612548 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:41:51.612510    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-z4wmz"]
Jul 28 19:41:51.615626 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:41:51.615606    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z4wmz"
Jul 28 19:41:51.617858 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:41:51.617836    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 28 19:41:51.618002 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:41:51.617910    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 28 19:41:51.618728 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:41:51.618704    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 19:41:51.618857 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:41:51.618750    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-t476d\""
Jul 28 19:41:51.623172 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:41:51.623146    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-z4wmz"]
Jul 28 19:41:51.698058 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:41:51.698026    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb5k5\" (UniqueName: \"kubernetes.io/projected/7c6398d2-3fd8-4c67-a985-78e2258967f9-kube-api-access-jb5k5\") pod \"postgres-69fb4594cf-z4wmz\" (UID: \"7c6398d2-3fd8-4c67-a985-78e2258967f9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-z4wmz"
Jul 28 19:41:51.698232 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:41:51.698088    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7c6398d2-3fd8-4c67-a985-78e2258967f9-data\") pod \"postgres-69fb4594cf-z4wmz\" (UID: \"7c6398d2-3fd8-4c67-a985-78e2258967f9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-z4wmz"
Jul 28 19:41:51.798547 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:41:51.798510    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7c6398d2-3fd8-4c67-a985-78e2258967f9-data\") pod \"postgres-69fb4594cf-z4wmz\" (UID: \"7c6398d2-3fd8-4c67-a985-78e2258967f9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-z4wmz"
Jul 28 19:41:51.798733 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:41:51.798578    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb5k5\" (UniqueName: \"kubernetes.io/projected/7c6398d2-3fd8-4c67-a985-78e2258967f9-kube-api-access-jb5k5\") pod \"postgres-69fb4594cf-z4wmz\" (UID: \"7c6398d2-3fd8-4c67-a985-78e2258967f9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-z4wmz"
Jul 28 19:41:51.798958 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:41:51.798929    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7c6398d2-3fd8-4c67-a985-78e2258967f9-data\") pod \"postgres-69fb4594cf-z4wmz\" (UID: \"7c6398d2-3fd8-4c67-a985-78e2258967f9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-z4wmz"
Jul 28 19:41:51.806321 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:41:51.806301    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb5k5\" (UniqueName: \"kubernetes.io/projected/7c6398d2-3fd8-4c67-a985-78e2258967f9-kube-api-access-jb5k5\") pod \"postgres-69fb4594cf-z4wmz\" (UID: \"7c6398d2-3fd8-4c67-a985-78e2258967f9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-z4wmz"
Jul 28 19:41:51.926483 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:41:51.926453    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z4wmz"
Jul 28 19:41:52.051147 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:41:52.051112    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-z4wmz"]
Jul 28 19:41:52.053961 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:41:52.053925    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c6398d2_3fd8_4c67_a985_78e2258967f9.slice/crio-b827bcb93e6dd528c727a72e95b08eb21a7baf42b064388816e18a7d1fb9f22f WatchSource:0}: Error finding container b827bcb93e6dd528c727a72e95b08eb21a7baf42b064388816e18a7d1fb9f22f: Status 404 returned error can't find the container with id b827bcb93e6dd528c727a72e95b08eb21a7baf42b064388816e18a7d1fb9f22f
Jul 28 19:41:52.070438 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:41:52.070413    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z4wmz" event={"ID":"7c6398d2-3fd8-4c67-a985-78e2258967f9","Type":"ContainerStarted","Data":"b827bcb93e6dd528c727a72e95b08eb21a7baf42b064388816e18a7d1fb9f22f"}
Jul 28 19:41:57.095740 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:41:57.095706    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z4wmz" event={"ID":"7c6398d2-3fd8-4c67-a985-78e2258967f9","Type":"ContainerStarted","Data":"49458fa490ba30dead1e9527697859d39ea8d6b16a471b1104d23abd47d5987b"}
Jul 28 19:41:57.096221 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:41:57.095819    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z4wmz"
Jul 28 19:41:57.110749 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:41:57.110691    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z4wmz" podStartSLOduration=1.157467513 podStartE2EDuration="6.110665672s" totalImagesPullingTime="4.953198159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:41:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:41:57.109113617 +0000 UTC m=+730.061145946" watchObservedRunningTime="2026-07-28 19:41:57.110665672 +0000 UTC m=+730.062698003"
Jul 28 19:42:03.130187 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:42:03.130158    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z4wmz"
Jul 28 19:42:12.813454 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:42:12.813419    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f867cc9-r6mbc"]
Jul 28 19:42:12.816799 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:42:12.816773    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f867cc9-r6mbc"
Jul 28 19:42:12.820106 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:42:12.820076    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 28 19:42:12.820231 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:42:12.820113    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 28 19:42:12.820231 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:42:12.820166    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6kzd6\""
Jul 28 19:42:12.825671 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:42:12.825648    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f867cc9-r6mbc"]
Jul 28 19:42:12.890063 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:42:12.890029    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e706f5a6-4f5c-4333-81c5-1d095a0c237e-webhook-cert\") pod \"maas-controller-7f867cc9-r6mbc\" (UID: \"e706f5a6-4f5c-4333-81c5-1d095a0c237e\") " pod="opendatahub/maas-controller-7f867cc9-r6mbc"
Jul 28 19:42:12.890063 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:42:12.890067    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk7kb\" (UniqueName: \"kubernetes.io/projected/e706f5a6-4f5c-4333-81c5-1d095a0c237e-kube-api-access-wk7kb\") pod \"maas-controller-7f867cc9-r6mbc\" (UID: \"e706f5a6-4f5c-4333-81c5-1d095a0c237e\") " pod="opendatahub/maas-controller-7f867cc9-r6mbc"
Jul 28 19:42:12.991998 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:42:12.991356    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk7kb\" (UniqueName: \"kubernetes.io/projected/e706f5a6-4f5c-4333-81c5-1d095a0c237e-kube-api-access-wk7kb\") pod \"maas-controller-7f867cc9-r6mbc\" (UID: \"e706f5a6-4f5c-4333-81c5-1d095a0c237e\") " pod="opendatahub/maas-controller-7f867cc9-r6mbc"
Jul 28 19:42:12.991998 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:42:12.991507    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e706f5a6-4f5c-4333-81c5-1d095a0c237e-webhook-cert\") pod \"maas-controller-7f867cc9-r6mbc\" (UID: \"e706f5a6-4f5c-4333-81c5-1d095a0c237e\") " pod="opendatahub/maas-controller-7f867cc9-r6mbc"
Jul 28 19:42:12.995235 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:42:12.995181    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e706f5a6-4f5c-4333-81c5-1d095a0c237e-webhook-cert\") pod \"maas-controller-7f867cc9-r6mbc\" (UID: \"e706f5a6-4f5c-4333-81c5-1d095a0c237e\") " pod="opendatahub/maas-controller-7f867cc9-r6mbc"
Jul 28 19:42:13.000930 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:42:13.000896    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk7kb\" (UniqueName: \"kubernetes.io/projected/e706f5a6-4f5c-4333-81c5-1d095a0c237e-kube-api-access-wk7kb\") pod \"maas-controller-7f867cc9-r6mbc\" (UID: \"e706f5a6-4f5c-4333-81c5-1d095a0c237e\") " pod="opendatahub/maas-controller-7f867cc9-r6mbc"
Jul 28 19:42:13.128212 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:42:13.128143    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f867cc9-r6mbc"
Jul 28 19:42:13.254090 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:42:13.254062    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f867cc9-r6mbc"]
Jul 28 19:42:13.256790 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:42:13.256760    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode706f5a6_4f5c_4333_81c5_1d095a0c237e.slice/crio-0e114a4e71e4cf077defbf41742b9c5cc327df4862195c234b579ebcc2e25490 WatchSource:0}: Error finding container 0e114a4e71e4cf077defbf41742b9c5cc327df4862195c234b579ebcc2e25490: Status 404 returned error can't find the container with id 0e114a4e71e4cf077defbf41742b9c5cc327df4862195c234b579ebcc2e25490
Jul 28 19:42:14.167910 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:42:14.167865    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f867cc9-r6mbc" event={"ID":"e706f5a6-4f5c-4333-81c5-1d095a0c237e","Type":"ContainerStarted","Data":"0e114a4e71e4cf077defbf41742b9c5cc327df4862195c234b579ebcc2e25490"}
Jul 28 19:42:16.177690 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:42:16.177651    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f867cc9-r6mbc" event={"ID":"e706f5a6-4f5c-4333-81c5-1d095a0c237e","Type":"ContainerStarted","Data":"65ccd32acd15ef1d96a8b230d260e56c54ceaa2a71a25d274520009a717077a3"}
Jul 28 19:42:16.178103 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:42:16.177782    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f867cc9-r6mbc"
Jul 28 19:42:16.195031 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:42:16.194960    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7f867cc9-r6mbc" podStartSLOduration=2.061122143 podStartE2EDuration="4.194943313s" totalImagesPullingTime="2.13382117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:42:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:42:16.1939279 +0000 UTC m=+749.145960227" watchObservedRunningTime="2026-07-28 19:42:16.194943313 +0000 UTC m=+749.146975643"
Jul 28 19:42:27.183650 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:42:27.183619    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f867cc9-r6mbc"
Jul 28 19:42:49.402327 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:42:49.402288    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-tvdt2"]
Jul 28 19:42:49.407747 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:42:49.407725    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-tvdt2"
Jul 28 19:42:49.409827 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:42:49.409808    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-pl8rm\""
Jul 28 19:42:49.409922 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:42:49.409811    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 28 19:42:49.413352 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:42:49.413331    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-tvdt2"]
Jul 28 19:42:49.508447 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:42:49.508415    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7dw9\" (UniqueName: \"kubernetes.io/projected/28205bd5-94b7-4dfc-8adb-adabf45f8e19-kube-api-access-w7dw9\") pod \"payload-processing-5cc6cd444b-tvdt2\" (UID: \"28205bd5-94b7-4dfc-8adb-adabf45f8e19\") " pod="openshift-ingress/payload-processing-5cc6cd444b-tvdt2"
Jul 28 19:42:49.508447 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:42:49.508452    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28205bd5-94b7-4dfc-8adb-adabf45f8e19-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-tvdt2\" (UID: \"28205bd5-94b7-4dfc-8adb-adabf45f8e19\") " pod="openshift-ingress/payload-processing-5cc6cd444b-tvdt2"
Jul 28 19:42:49.609386 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:42:49.609355    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7dw9\" (UniqueName: \"kubernetes.io/projected/28205bd5-94b7-4dfc-8adb-adabf45f8e19-kube-api-access-w7dw9\") pod \"payload-processing-5cc6cd444b-tvdt2\" (UID: \"28205bd5-94b7-4dfc-8adb-adabf45f8e19\") " pod="openshift-ingress/payload-processing-5cc6cd444b-tvdt2"
Jul 28 19:42:49.609588 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:42:49.609393    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28205bd5-94b7-4dfc-8adb-adabf45f8e19-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-tvdt2\" (UID: \"28205bd5-94b7-4dfc-8adb-adabf45f8e19\") " pod="openshift-ingress/payload-processing-5cc6cd444b-tvdt2"
Jul 28 19:42:49.610084 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:42:49.610062    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28205bd5-94b7-4dfc-8adb-adabf45f8e19-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-tvdt2\" (UID: \"28205bd5-94b7-4dfc-8adb-adabf45f8e19\") " pod="openshift-ingress/payload-processing-5cc6cd444b-tvdt2"
Jul 28 19:42:49.617049 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:42:49.617023    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7dw9\" (UniqueName: \"kubernetes.io/projected/28205bd5-94b7-4dfc-8adb-adabf45f8e19-kube-api-access-w7dw9\") pod \"payload-processing-5cc6cd444b-tvdt2\" (UID: \"28205bd5-94b7-4dfc-8adb-adabf45f8e19\") " pod="openshift-ingress/payload-processing-5cc6cd444b-tvdt2"
Jul 28 19:42:49.718796 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:42:49.718765    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-tvdt2"
Jul 28 19:42:49.850823 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:42:49.850791    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-tvdt2"]
Jul 28 19:42:49.854109 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:42:49.854079    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28205bd5_94b7_4dfc_8adb_adabf45f8e19.slice/crio-e0be34747a72470dcfa1f77cd384a1a3cd892d6312218b3d46038af628a186e9 WatchSource:0}: Error finding container e0be34747a72470dcfa1f77cd384a1a3cd892d6312218b3d46038af628a186e9: Status 404 returned error can't find the container with id e0be34747a72470dcfa1f77cd384a1a3cd892d6312218b3d46038af628a186e9
Jul 28 19:42:50.311099 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:42:50.311062    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-tvdt2" event={"ID":"28205bd5-94b7-4dfc-8adb-adabf45f8e19","Type":"ContainerStarted","Data":"e0be34747a72470dcfa1f77cd384a1a3cd892d6312218b3d46038af628a186e9"}
Jul 28 19:42:52.321791 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:42:52.321754    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-tvdt2" event={"ID":"28205bd5-94b7-4dfc-8adb-adabf45f8e19","Type":"ContainerStarted","Data":"fe6067778be5f4e111d1f2dbf21acec6d3bed177ccaad2dbc7ef79680020694a"}
Jul 28 19:42:52.322212 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:42:52.321903    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-tvdt2"
Jul 28 19:42:52.336462 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:42:52.336418    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-tvdt2" podStartSLOduration=1.073773514 podStartE2EDuration="3.336400629s" totalImagesPullingTime="2.262627115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:42:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:42:52.335690891 +0000 UTC m=+785.287723249" watchObservedRunningTime="2026-07-28 19:42:52.336400629 +0000 UTC m=+785.288432965"
Jul 28 19:43:03.328175 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:43:03.328142    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-tvdt2"
Jul 28 19:44:33.683624 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:44:33.683589    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6"]
Jul 28 19:44:33.686808 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:44:33.686788    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6"
Jul 28 19:44:33.690048 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:44:33.690023    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 28 19:44:33.690152 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:44:33.690063    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 28 19:44:33.690152 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:44:33.690031    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-csdqr\""
Jul 28 19:44:33.690152 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:44:33.690031    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 28 19:44:33.696666 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:44:33.696644    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6"]
Jul 28 19:44:33.804934 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:44:33.804904    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47392ca8-5f18-495f-b59f-70f20fc2e78a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6\" (UID: \"47392ca8-5f18-495f-b59f-70f20fc2e78a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6"
Jul 28 19:44:33.805109 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:44:33.804948    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47392ca8-5f18-495f-b59f-70f20fc2e78a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6\" (UID: \"47392ca8-5f18-495f-b59f-70f20fc2e78a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6"
Jul 28 19:44:33.805109 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:44:33.804970    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frmwf\" (UniqueName: \"kubernetes.io/projected/47392ca8-5f18-495f-b59f-70f20fc2e78a-kube-api-access-frmwf\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6\" (UID: \"47392ca8-5f18-495f-b59f-70f20fc2e78a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6"
Jul 28 19:44:33.805109 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:44:33.805084    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47392ca8-5f18-495f-b59f-70f20fc2e78a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6\" (UID: \"47392ca8-5f18-495f-b59f-70f20fc2e78a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6"
Jul 28 19:44:33.805233 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:44:33.805117    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47392ca8-5f18-495f-b59f-70f20fc2e78a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6\" (UID: \"47392ca8-5f18-495f-b59f-70f20fc2e78a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6"
Jul 28 19:44:33.805233 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:44:33.805154    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47392ca8-5f18-495f-b59f-70f20fc2e78a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6\" (UID: \"47392ca8-5f18-495f-b59f-70f20fc2e78a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6"
Jul 28 19:44:33.906360 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:44:33.906329    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47392ca8-5f18-495f-b59f-70f20fc2e78a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6\" (UID: \"47392ca8-5f18-495f-b59f-70f20fc2e78a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6"
Jul 28 19:44:33.906360 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:44:33.906361    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frmwf\" (UniqueName: \"kubernetes.io/projected/47392ca8-5f18-495f-b59f-70f20fc2e78a-kube-api-access-frmwf\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6\" (UID: \"47392ca8-5f18-495f-b59f-70f20fc2e78a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6"
Jul 28 19:44:33.906583 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:44:33.906397    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47392ca8-5f18-495f-b59f-70f20fc2e78a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6\" (UID: \"47392ca8-5f18-495f-b59f-70f20fc2e78a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6"
Jul 28 19:44:33.906583 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:44:33.906521    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47392ca8-5f18-495f-b59f-70f20fc2e78a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6\" (UID: \"47392ca8-5f18-495f-b59f-70f20fc2e78a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6"
Jul 28 19:44:33.906690 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:44:33.906613    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47392ca8-5f18-495f-b59f-70f20fc2e78a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6\" (UID: \"47392ca8-5f18-495f-b59f-70f20fc2e78a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6"
Jul 28 19:44:33.906745 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:44:33.906686    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47392ca8-5f18-495f-b59f-70f20fc2e78a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6\" (UID: \"47392ca8-5f18-495f-b59f-70f20fc2e78a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6"
Jul 28 19:44:33.906745 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:44:33.906721    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47392ca8-5f18-495f-b59f-70f20fc2e78a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6\" (UID: \"47392ca8-5f18-495f-b59f-70f20fc2e78a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6"
Jul 28 19:44:33.906920 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:44:33.906897    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47392ca8-5f18-495f-b59f-70f20fc2e78a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6\" (UID: \"47392ca8-5f18-495f-b59f-70f20fc2e78a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6"
Jul 28 19:44:33.907035 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:44:33.907017    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47392ca8-5f18-495f-b59f-70f20fc2e78a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6\" (UID: \"47392ca8-5f18-495f-b59f-70f20fc2e78a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6"
Jul 28 19:44:33.908504 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:44:33.908486    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47392ca8-5f18-495f-b59f-70f20fc2e78a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6\" (UID: \"47392ca8-5f18-495f-b59f-70f20fc2e78a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6"
Jul 28 19:44:33.908935 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:44:33.908912    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47392ca8-5f18-495f-b59f-70f20fc2e78a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6\" (UID: \"47392ca8-5f18-495f-b59f-70f20fc2e78a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6"
Jul 28 19:44:33.913895 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:44:33.913874    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frmwf\" (UniqueName: \"kubernetes.io/projected/47392ca8-5f18-495f-b59f-70f20fc2e78a-kube-api-access-frmwf\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6\" (UID: \"47392ca8-5f18-495f-b59f-70f20fc2e78a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6"
Jul 28 19:44:34.018844 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:44:34.018759    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6"
Jul 28 19:44:34.142953 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:44:34.142931    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6"]
Jul 28 19:44:34.145211 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:44:34.145188    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47392ca8_5f18_495f_b59f_70f20fc2e78a.slice/crio-c80b81851c7476c6a64c93a007d0ea419ab408a3b0bcb6df01f004292eceab37 WatchSource:0}: Error finding container c80b81851c7476c6a64c93a007d0ea419ab408a3b0bcb6df01f004292eceab37: Status 404 returned error can't find the container with id c80b81851c7476c6a64c93a007d0ea419ab408a3b0bcb6df01f004292eceab37
Jul 28 19:44:34.146463 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:44:34.146447    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 19:44:34.734119 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:44:34.734086    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6" event={"ID":"47392ca8-5f18-495f-b59f-70f20fc2e78a","Type":"ContainerStarted","Data":"c80b81851c7476c6a64c93a007d0ea419ab408a3b0bcb6df01f004292eceab37"}
Jul 28 19:44:35.740142 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:44:35.740103    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6" event={"ID":"47392ca8-5f18-495f-b59f-70f20fc2e78a","Type":"ContainerStarted","Data":"21f2169ca05fcb777ba9078af48529ed320ff2a3e4877817142c7c67fd4e0423"}
Jul 28 19:44:35.757561 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:44:35.757518    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6" podStartSLOduration=1.269837201 podStartE2EDuration="2.75750306s" totalImagesPullingTime="1.487665859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:44:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:44:35.755206078 +0000 UTC m=+888.707238446" watchObservedRunningTime="2026-07-28 19:44:35.75750306 +0000 UTC m=+888.709535390"
Jul 28 19:44:44.019278 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:44:44.019241    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6"
Jul 28 19:44:44.019690 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:44:44.019302    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6"
Jul 28 19:44:44.031626 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:44:44.031597    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6"
Jul 28 19:44:44.788307 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:44:44.788277    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6"
Jul 28 19:45:00.138413 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:45:00.138372    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754465-z8h6d"]
Jul 28 19:45:00.141943 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:45:00.141924    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754465-z8h6d"
Jul 28 19:45:00.144306 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:45:00.144284    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z6zs4\""
Jul 28 19:45:00.147148 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:45:00.147125    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754465-z8h6d"]
Jul 28 19:45:00.151558 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:45:00.151542    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754465-z8h6d"
Jul 28 19:45:00.275566 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:45:00.275541    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754465-z8h6d"]
Jul 28 19:45:00.278144 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:45:00.278111    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86dcda99_9c03_48b2_8ed3_0f5b9a36fd02.slice/crio-f98e9659e31ad76fb950195e93f9f2b95ccb9b6296d12f57236f17509887c59f WatchSource:0}: Error finding container f98e9659e31ad76fb950195e93f9f2b95ccb9b6296d12f57236f17509887c59f: Status 404 returned error can't find the container with id f98e9659e31ad76fb950195e93f9f2b95ccb9b6296d12f57236f17509887c59f
Jul 28 19:45:00.840189 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:45:00.840156    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754465-z8h6d" event={"ID":"86dcda99-9c03-48b2-8ed3-0f5b9a36fd02","Type":"ContainerStarted","Data":"f98e9659e31ad76fb950195e93f9f2b95ccb9b6296d12f57236f17509887c59f"}
Jul 28 19:45:03.855923 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:45:03.855833    2570 generic.go:356] "Generic (PLEG): container finished" podID="86dcda99-9c03-48b2-8ed3-0f5b9a36fd02" containerID="df1d128eb7f23f27b33d57a6ed2ec5ed2421253b9e02f5b90b505d4ce3bfe447" exitCode=0
Jul 28 19:45:03.855923 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:45:03.855899    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754465-z8h6d" event={"ID":"86dcda99-9c03-48b2-8ed3-0f5b9a36fd02","Type":"ContainerDied","Data":"df1d128eb7f23f27b33d57a6ed2ec5ed2421253b9e02f5b90b505d4ce3bfe447"}
Jul 28 19:45:04.986158 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:45:04.986134    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754465-z8h6d"
Jul 28 19:45:05.864949 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:45:05.864872    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754465-z8h6d"
Jul 28 19:45:05.864949 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:45:05.864890    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754465-z8h6d" event={"ID":"86dcda99-9c03-48b2-8ed3-0f5b9a36fd02","Type":"ContainerDied","Data":"f98e9659e31ad76fb950195e93f9f2b95ccb9b6296d12f57236f17509887c59f"}
Jul 28 19:45:05.864949 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:45:05.864940    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f98e9659e31ad76fb950195e93f9f2b95ccb9b6296d12f57236f17509887c59f"
Jul 28 19:46:46.117934 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:46:46.117895    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f867cc9-r6mbc"]
Jul 28 19:46:46.118624 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:46:46.118193    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7f867cc9-r6mbc" podUID="e706f5a6-4f5c-4333-81c5-1d095a0c237e" containerName="manager" containerID="cri-o://65ccd32acd15ef1d96a8b230d260e56c54ceaa2a71a25d274520009a717077a3" gracePeriod=30
Jul 28 19:46:46.285772 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:46:46.285731    2570 generic.go:356] "Generic (PLEG): container finished" podID="e706f5a6-4f5c-4333-81c5-1d095a0c237e" containerID="65ccd32acd15ef1d96a8b230d260e56c54ceaa2a71a25d274520009a717077a3" exitCode=0
Jul 28 19:46:46.285909 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:46:46.285886    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f867cc9-r6mbc" event={"ID":"e706f5a6-4f5c-4333-81c5-1d095a0c237e","Type":"ContainerDied","Data":"65ccd32acd15ef1d96a8b230d260e56c54ceaa2a71a25d274520009a717077a3"}
Jul 28 19:46:46.366910 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:46:46.366885    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f867cc9-r6mbc"
Jul 28 19:46:46.422708 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:46:46.422674    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e706f5a6-4f5c-4333-81c5-1d095a0c237e-webhook-cert\") pod \"e706f5a6-4f5c-4333-81c5-1d095a0c237e\" (UID: \"e706f5a6-4f5c-4333-81c5-1d095a0c237e\") "
Jul 28 19:46:46.422886 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:46:46.422727    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wk7kb\" (UniqueName: \"kubernetes.io/projected/e706f5a6-4f5c-4333-81c5-1d095a0c237e-kube-api-access-wk7kb\") pod \"e706f5a6-4f5c-4333-81c5-1d095a0c237e\" (UID: \"e706f5a6-4f5c-4333-81c5-1d095a0c237e\") "
Jul 28 19:46:46.424898 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:46:46.424865    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e706f5a6-4f5c-4333-81c5-1d095a0c237e-kube-api-access-wk7kb" (OuterVolumeSpecName: "kube-api-access-wk7kb") pod "e706f5a6-4f5c-4333-81c5-1d095a0c237e" (UID: "e706f5a6-4f5c-4333-81c5-1d095a0c237e"). InnerVolumeSpecName "kube-api-access-wk7kb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:46:46.424898 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:46:46.424881    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e706f5a6-4f5c-4333-81c5-1d095a0c237e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e706f5a6-4f5c-4333-81c5-1d095a0c237e" (UID: "e706f5a6-4f5c-4333-81c5-1d095a0c237e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:46:46.523431 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:46:46.523392    2570 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e706f5a6-4f5c-4333-81c5-1d095a0c237e-webhook-cert\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 19:46:46.523431 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:46:46.523422    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wk7kb\" (UniqueName: \"kubernetes.io/projected/e706f5a6-4f5c-4333-81c5-1d095a0c237e-kube-api-access-wk7kb\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 19:46:47.291373 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:46:47.291342    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f867cc9-r6mbc" event={"ID":"e706f5a6-4f5c-4333-81c5-1d095a0c237e","Type":"ContainerDied","Data":"0e114a4e71e4cf077defbf41742b9c5cc327df4862195c234b579ebcc2e25490"}
Jul 28 19:46:47.291817 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:46:47.291377    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f867cc9-r6mbc"
Jul 28 19:46:47.291817 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:46:47.291405    2570 scope.go:117] "RemoveContainer" containerID="65ccd32acd15ef1d96a8b230d260e56c54ceaa2a71a25d274520009a717077a3"
Jul 28 19:46:47.315517 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:46:47.315487    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f867cc9-r6mbc"]
Jul 28 19:46:47.320947 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:46:47.320921    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7f867cc9-r6mbc"]
Jul 28 19:46:47.572817 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:46:47.572739    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e706f5a6-4f5c-4333-81c5-1d095a0c237e" path="/var/lib/kubelet/pods/e706f5a6-4f5c-4333-81c5-1d095a0c237e/volumes"
Jul 28 19:47:48.088107 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:47:48.088072    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f867cc9-dnsdg"]
Jul 28 19:47:48.088579 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:47:48.088363    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86dcda99-9c03-48b2-8ed3-0f5b9a36fd02" containerName="cleanup"
Jul 28 19:47:48.088579 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:47:48.088374    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="86dcda99-9c03-48b2-8ed3-0f5b9a36fd02" containerName="cleanup"
Jul 28 19:47:48.088579 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:47:48.088386    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e706f5a6-4f5c-4333-81c5-1d095a0c237e" containerName="manager"
Jul 28 19:47:48.088579 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:47:48.088391    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e706f5a6-4f5c-4333-81c5-1d095a0c237e" containerName="manager"
Jul 28 19:47:48.088579 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:47:48.088444    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e706f5a6-4f5c-4333-81c5-1d095a0c237e" containerName="manager"
Jul 28 19:47:48.088579 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:47:48.088452    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="86dcda99-9c03-48b2-8ed3-0f5b9a36fd02" containerName="cleanup"
Jul 28 19:47:48.091285 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:47:48.091265    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f867cc9-dnsdg"
Jul 28 19:47:48.094702 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:47:48.094674    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6kzd6\""
Jul 28 19:47:48.094823 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:47:48.094674    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 28 19:47:48.094823 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:47:48.094683    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 28 19:47:48.099612 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:47:48.099566    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f867cc9-dnsdg"]
Jul 28 19:47:48.152913 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:47:48.152879    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8dft\" (UniqueName: \"kubernetes.io/projected/d1e4548b-1f98-40d5-a81a-2704ce5e2a50-kube-api-access-j8dft\") pod \"maas-controller-7f867cc9-dnsdg\" (UID: \"d1e4548b-1f98-40d5-a81a-2704ce5e2a50\") " pod="opendatahub/maas-controller-7f867cc9-dnsdg"
Jul 28 19:47:48.153095 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:47:48.152932    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d1e4548b-1f98-40d5-a81a-2704ce5e2a50-webhook-cert\") pod \"maas-controller-7f867cc9-dnsdg\" (UID: \"d1e4548b-1f98-40d5-a81a-2704ce5e2a50\") " pod="opendatahub/maas-controller-7f867cc9-dnsdg"
Jul 28 19:47:48.254409 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:47:48.254375    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8dft\" (UniqueName: \"kubernetes.io/projected/d1e4548b-1f98-40d5-a81a-2704ce5e2a50-kube-api-access-j8dft\") pod \"maas-controller-7f867cc9-dnsdg\" (UID: \"d1e4548b-1f98-40d5-a81a-2704ce5e2a50\") " pod="opendatahub/maas-controller-7f867cc9-dnsdg"
Jul 28 19:47:48.254590 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:47:48.254426    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d1e4548b-1f98-40d5-a81a-2704ce5e2a50-webhook-cert\") pod \"maas-controller-7f867cc9-dnsdg\" (UID: \"d1e4548b-1f98-40d5-a81a-2704ce5e2a50\") " pod="opendatahub/maas-controller-7f867cc9-dnsdg"
Jul 28 19:47:48.256741 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:47:48.256718    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d1e4548b-1f98-40d5-a81a-2704ce5e2a50-webhook-cert\") pod \"maas-controller-7f867cc9-dnsdg\" (UID: \"d1e4548b-1f98-40d5-a81a-2704ce5e2a50\") " pod="opendatahub/maas-controller-7f867cc9-dnsdg"
Jul 28 19:47:48.262804 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:47:48.262779    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8dft\" (UniqueName: \"kubernetes.io/projected/d1e4548b-1f98-40d5-a81a-2704ce5e2a50-kube-api-access-j8dft\") pod \"maas-controller-7f867cc9-dnsdg\" (UID: \"d1e4548b-1f98-40d5-a81a-2704ce5e2a50\") " pod="opendatahub/maas-controller-7f867cc9-dnsdg"
Jul 28 19:47:48.402759 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:47:48.402665    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f867cc9-dnsdg"
Jul 28 19:47:48.536608 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:47:48.534204    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f867cc9-dnsdg"]
Jul 28 19:47:48.538244 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:47:48.538215    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1e4548b_1f98_40d5_a81a_2704ce5e2a50.slice/crio-69f043d64a4b12d49b329e3a77155cfec4a913deae7e867f13cddae942679170 WatchSource:0}: Error finding container 69f043d64a4b12d49b329e3a77155cfec4a913deae7e867f13cddae942679170: Status 404 returned error can't find the container with id 69f043d64a4b12d49b329e3a77155cfec4a913deae7e867f13cddae942679170
Jul 28 19:47:48.549623 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:47:48.549595    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f867cc9-dnsdg" event={"ID":"d1e4548b-1f98-40d5-a81a-2704ce5e2a50","Type":"ContainerStarted","Data":"69f043d64a4b12d49b329e3a77155cfec4a913deae7e867f13cddae942679170"}
Jul 28 19:47:49.554888 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:47:49.554854    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f867cc9-dnsdg" event={"ID":"d1e4548b-1f98-40d5-a81a-2704ce5e2a50","Type":"ContainerStarted","Data":"24ab62c7b1e3ccf68ff7ca364440127bbbdc15e37494d6ea347e10988b898f2a"}
Jul 28 19:47:49.555294 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:47:49.555009    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f867cc9-dnsdg"
Jul 28 19:47:49.572763 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:47:49.572711    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7f867cc9-dnsdg" podStartSLOduration=1.091567054 podStartE2EDuration="1.572691792s" totalImagesPullingTime="481.124738ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:47:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:47:49.572214706 +0000 UTC m=+1082.524247037" watchObservedRunningTime="2026-07-28 19:47:49.572691792 +0000 UTC m=+1082.524724123"
Jul 28 19:48:00.561565 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:00.561532    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f867cc9-dnsdg"
Jul 28 19:48:05.244050 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:05.244015    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f867cc9-dnsdg"]
Jul 28 19:48:05.244482 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:05.244214    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7f867cc9-dnsdg" podUID="d1e4548b-1f98-40d5-a81a-2704ce5e2a50" containerName="manager" containerID="cri-o://24ab62c7b1e3ccf68ff7ca364440127bbbdc15e37494d6ea347e10988b898f2a" gracePeriod=30
Jul 28 19:48:05.488278 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:05.488252    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f867cc9-dnsdg"
Jul 28 19:48:05.611115 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:05.611028    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d1e4548b-1f98-40d5-a81a-2704ce5e2a50-webhook-cert\") pod \"d1e4548b-1f98-40d5-a81a-2704ce5e2a50\" (UID: \"d1e4548b-1f98-40d5-a81a-2704ce5e2a50\") "
Jul 28 19:48:05.611115 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:05.611076    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8dft\" (UniqueName: \"kubernetes.io/projected/d1e4548b-1f98-40d5-a81a-2704ce5e2a50-kube-api-access-j8dft\") pod \"d1e4548b-1f98-40d5-a81a-2704ce5e2a50\" (UID: \"d1e4548b-1f98-40d5-a81a-2704ce5e2a50\") "
Jul 28 19:48:05.613364 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:05.613333    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1e4548b-1f98-40d5-a81a-2704ce5e2a50-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d1e4548b-1f98-40d5-a81a-2704ce5e2a50" (UID: "d1e4548b-1f98-40d5-a81a-2704ce5e2a50"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:48:05.613460 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:05.613331    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1e4548b-1f98-40d5-a81a-2704ce5e2a50-kube-api-access-j8dft" (OuterVolumeSpecName: "kube-api-access-j8dft") pod "d1e4548b-1f98-40d5-a81a-2704ce5e2a50" (UID: "d1e4548b-1f98-40d5-a81a-2704ce5e2a50"). InnerVolumeSpecName "kube-api-access-j8dft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:48:05.628648 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:05.628622    2570 generic.go:356] "Generic (PLEG): container finished" podID="d1e4548b-1f98-40d5-a81a-2704ce5e2a50" containerID="24ab62c7b1e3ccf68ff7ca364440127bbbdc15e37494d6ea347e10988b898f2a" exitCode=0
Jul 28 19:48:05.628792 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:05.628663    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f867cc9-dnsdg" event={"ID":"d1e4548b-1f98-40d5-a81a-2704ce5e2a50","Type":"ContainerDied","Data":"24ab62c7b1e3ccf68ff7ca364440127bbbdc15e37494d6ea347e10988b898f2a"}
Jul 28 19:48:05.628792 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:05.628684    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f867cc9-dnsdg"
Jul 28 19:48:05.628792 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:05.628703    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f867cc9-dnsdg" event={"ID":"d1e4548b-1f98-40d5-a81a-2704ce5e2a50","Type":"ContainerDied","Data":"69f043d64a4b12d49b329e3a77155cfec4a913deae7e867f13cddae942679170"}
Jul 28 19:48:05.628792 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:05.628724    2570 scope.go:117] "RemoveContainer" containerID="24ab62c7b1e3ccf68ff7ca364440127bbbdc15e37494d6ea347e10988b898f2a"
Jul 28 19:48:05.638386 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:05.638367    2570 scope.go:117] "RemoveContainer" containerID="24ab62c7b1e3ccf68ff7ca364440127bbbdc15e37494d6ea347e10988b898f2a"
Jul 28 19:48:05.638675 ip-10-0-131-248 kubenswrapper[2570]: E0728 19:48:05.638656    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24ab62c7b1e3ccf68ff7ca364440127bbbdc15e37494d6ea347e10988b898f2a\": container with ID starting with 24ab62c7b1e3ccf68ff7ca364440127bbbdc15e37494d6ea347e10988b898f2a not found: ID does not exist" containerID="24ab62c7b1e3ccf68ff7ca364440127bbbdc15e37494d6ea347e10988b898f2a"
Jul 28 19:48:05.638728 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:05.638686    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24ab62c7b1e3ccf68ff7ca364440127bbbdc15e37494d6ea347e10988b898f2a"} err="failed to get container status \"24ab62c7b1e3ccf68ff7ca364440127bbbdc15e37494d6ea347e10988b898f2a\": rpc error: code = NotFound desc = could not find container \"24ab62c7b1e3ccf68ff7ca364440127bbbdc15e37494d6ea347e10988b898f2a\": container with ID starting with 24ab62c7b1e3ccf68ff7ca364440127bbbdc15e37494d6ea347e10988b898f2a not found: ID does not exist"
Jul 28 19:48:05.649138 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:05.649113    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f867cc9-dnsdg"]
Jul 28 19:48:05.651175 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:05.651155    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7f867cc9-dnsdg"]
Jul 28 19:48:05.712287 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:05.712253    2570 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d1e4548b-1f98-40d5-a81a-2704ce5e2a50-webhook-cert\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 19:48:05.712287 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:05.712284    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8dft\" (UniqueName: \"kubernetes.io/projected/d1e4548b-1f98-40d5-a81a-2704ce5e2a50-kube-api-access-j8dft\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 19:48:06.463916 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:06.463881    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f867cc9-qwphn"]
Jul 28 19:48:06.464295 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:06.464196    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1e4548b-1f98-40d5-a81a-2704ce5e2a50" containerName="manager"
Jul 28 19:48:06.464295 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:06.464208    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1e4548b-1f98-40d5-a81a-2704ce5e2a50" containerName="manager"
Jul 28 19:48:06.464295 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:06.464269    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1e4548b-1f98-40d5-a81a-2704ce5e2a50" containerName="manager"
Jul 28 19:48:06.468539 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:06.468518    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f867cc9-qwphn"
Jul 28 19:48:06.471679 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:06.471659    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 28 19:48:06.471847 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:06.471726    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 28 19:48:06.471847 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:06.471779    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6kzd6\""
Jul 28 19:48:06.477360 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:06.477340    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f867cc9-qwphn"]
Jul 28 19:48:06.618709 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:06.618667    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad9a952e-9c20-40af-a631-c0ff7489676b-webhook-cert\") pod \"maas-controller-7f867cc9-qwphn\" (UID: \"ad9a952e-9c20-40af-a631-c0ff7489676b\") " pod="opendatahub/maas-controller-7f867cc9-qwphn"
Jul 28 19:48:06.618854 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:06.618714    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stcv2\" (UniqueName: \"kubernetes.io/projected/ad9a952e-9c20-40af-a631-c0ff7489676b-kube-api-access-stcv2\") pod \"maas-controller-7f867cc9-qwphn\" (UID: \"ad9a952e-9c20-40af-a631-c0ff7489676b\") " pod="opendatahub/maas-controller-7f867cc9-qwphn"
Jul 28 19:48:06.720146 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:06.720058    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad9a952e-9c20-40af-a631-c0ff7489676b-webhook-cert\") pod \"maas-controller-7f867cc9-qwphn\" (UID: \"ad9a952e-9c20-40af-a631-c0ff7489676b\") " pod="opendatahub/maas-controller-7f867cc9-qwphn"
Jul 28 19:48:06.720146 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:06.720100    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stcv2\" (UniqueName: \"kubernetes.io/projected/ad9a952e-9c20-40af-a631-c0ff7489676b-kube-api-access-stcv2\") pod \"maas-controller-7f867cc9-qwphn\" (UID: \"ad9a952e-9c20-40af-a631-c0ff7489676b\") " pod="opendatahub/maas-controller-7f867cc9-qwphn"
Jul 28 19:48:06.722484 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:06.722455    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad9a952e-9c20-40af-a631-c0ff7489676b-webhook-cert\") pod \"maas-controller-7f867cc9-qwphn\" (UID: \"ad9a952e-9c20-40af-a631-c0ff7489676b\") " pod="opendatahub/maas-controller-7f867cc9-qwphn"
Jul 28 19:48:06.727411 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:06.727388    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stcv2\" (UniqueName: \"kubernetes.io/projected/ad9a952e-9c20-40af-a631-c0ff7489676b-kube-api-access-stcv2\") pod \"maas-controller-7f867cc9-qwphn\" (UID: \"ad9a952e-9c20-40af-a631-c0ff7489676b\") " pod="opendatahub/maas-controller-7f867cc9-qwphn"
Jul 28 19:48:06.779419 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:06.779387    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f867cc9-qwphn"
Jul 28 19:48:07.113549 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:07.113471    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f867cc9-qwphn"]
Jul 28 19:48:07.117037 ip-10-0-131-248 kubenswrapper[2570]: W0728 19:48:07.117006    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad9a952e_9c20_40af_a631_c0ff7489676b.slice/crio-38c767853b44c1324956bbc81b6e7b7b0586eb0cc28a42c384012bf2a70d2461 WatchSource:0}: Error finding container 38c767853b44c1324956bbc81b6e7b7b0586eb0cc28a42c384012bf2a70d2461: Status 404 returned error can't find the container with id 38c767853b44c1324956bbc81b6e7b7b0586eb0cc28a42c384012bf2a70d2461
Jul 28 19:48:07.573005 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:07.572957    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1e4548b-1f98-40d5-a81a-2704ce5e2a50" path="/var/lib/kubelet/pods/d1e4548b-1f98-40d5-a81a-2704ce5e2a50/volumes"
Jul 28 19:48:07.639773 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:07.639744    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f867cc9-qwphn" event={"ID":"ad9a952e-9c20-40af-a631-c0ff7489676b","Type":"ContainerStarted","Data":"cf346a44449ca7fde1cc42d369838282fc91a7fcbedda5c10e82cb386e0d993e"}
Jul 28 19:48:07.639910 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:07.639802    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f867cc9-qwphn" event={"ID":"ad9a952e-9c20-40af-a631-c0ff7489676b","Type":"ContainerStarted","Data":"38c767853b44c1324956bbc81b6e7b7b0586eb0cc28a42c384012bf2a70d2461"}
Jul 28 19:48:07.639910 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:07.639847    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f867cc9-qwphn"
Jul 28 19:48:07.657607 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:07.657540    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7f867cc9-qwphn" podStartSLOduration=1.19113341 podStartE2EDuration="1.657521178s" totalImagesPullingTime="466.387768ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:48:07.655566641 +0000 UTC m=+1100.607598963" watchObservedRunningTime="2026-07-28 19:48:07.657521178 +0000 UTC m=+1100.609553510"
Jul 28 19:48:18.646336 ip-10-0-131-248 kubenswrapper[2570]: I0728 19:48:18.646304    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f867cc9-qwphn"
Jul 28 20:00:00.142259 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:00:00.142226    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754480-8lrzt"]
Jul 28 20:00:00.144946 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:00:00.144928    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754480-8lrzt"
Jul 28 20:00:00.147763 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:00:00.147742    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z6zs4\""
Jul 28 20:00:00.153845 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:00:00.153825    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754480-8lrzt"
Jul 28 20:00:00.160069 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:00:00.160047    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754480-8lrzt"]
Jul 28 20:00:00.284899 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:00:00.284875    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754480-8lrzt"]
Jul 28 20:00:00.287464 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:00:00.287435    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50d7b3e9_8456_442a_a70e_a550ff75c9ac.slice/crio-2bc730fe4a1284e6ece067905431b85cf26076786016e6c9d073a64a002eb1e2 WatchSource:0}: Error finding container 2bc730fe4a1284e6ece067905431b85cf26076786016e6c9d073a64a002eb1e2: Status 404 returned error can't find the container with id 2bc730fe4a1284e6ece067905431b85cf26076786016e6c9d073a64a002eb1e2
Jul 28 20:00:00.550691 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:00:00.550659    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754480-8lrzt" event={"ID":"50d7b3e9-8456-442a-a70e-a550ff75c9ac","Type":"ContainerStarted","Data":"2bc730fe4a1284e6ece067905431b85cf26076786016e6c9d073a64a002eb1e2"}
Jul 28 20:00:01.556183 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:00:01.556100    2570 generic.go:356] "Generic (PLEG): container finished" podID="50d7b3e9-8456-442a-a70e-a550ff75c9ac" containerID="bf4ed001933ecfcc4c4292623edbebddb577ce7ac45894f42bc42fd9168b27ad" exitCode=0
Jul 28 20:00:01.556534 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:00:01.556194    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754480-8lrzt" event={"ID":"50d7b3e9-8456-442a-a70e-a550ff75c9ac","Type":"ContainerDied","Data":"bf4ed001933ecfcc4c4292623edbebddb577ce7ac45894f42bc42fd9168b27ad"}
Jul 28 20:00:02.694040 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:00:02.693970    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754480-8lrzt"
Jul 28 20:00:03.566623 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:00:03.566593    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754480-8lrzt"
Jul 28 20:00:03.571501 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:00:03.571469    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754480-8lrzt" event={"ID":"50d7b3e9-8456-442a-a70e-a550ff75c9ac","Type":"ContainerDied","Data":"2bc730fe4a1284e6ece067905431b85cf26076786016e6c9d073a64a002eb1e2"}
Jul 28 20:00:03.571645 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:00:03.571515    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2bc730fe4a1284e6ece067905431b85cf26076786016e6c9d073a64a002eb1e2"
Jul 28 20:01:49.181876 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:49.181843    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"]
Jul 28 20:01:49.182391 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:49.182178    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50d7b3e9-8456-442a-a70e-a550ff75c9ac" containerName="cleanup"
Jul 28 20:01:49.182391 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:49.182198    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="50d7b3e9-8456-442a-a70e-a550ff75c9ac" containerName="cleanup"
Jul 28 20:01:49.182391 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:49.182280    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="50d7b3e9-8456-442a-a70e-a550ff75c9ac" containerName="cleanup"
Jul 28 20:01:49.185570 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:49.185549    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:01:49.187881 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:49.187857    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-8a457bc8-openshift-default-dockercfg-fj5rh\""
Jul 28 20:01:49.207349 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:49.207326    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"]
Jul 28 20:01:49.300277 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:49.300235    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd4a8100-3a8f-4006-b441-514ead15c5e1-credential-socket\") pod \"e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s\" (UID: \"cd4a8100-3a8f-4006-b441-514ead15c5e1\") " pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:01:49.300277 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:49.300276    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd4a8100-3a8f-4006-b441-514ead15c5e1-istio-podinfo\") pod \"e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s\" (UID: \"cd4a8100-3a8f-4006-b441-514ead15c5e1\") " pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:01:49.300539 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:49.300293    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd4a8100-3a8f-4006-b441-514ead15c5e1-istiod-ca-cert\") pod \"e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s\" (UID: \"cd4a8100-3a8f-4006-b441-514ead15c5e1\") " pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:01:49.300539 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:49.300320    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd4a8100-3a8f-4006-b441-514ead15c5e1-workload-socket\") pod \"e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s\" (UID: \"cd4a8100-3a8f-4006-b441-514ead15c5e1\") " pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:01:49.300539 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:49.300395    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd4a8100-3a8f-4006-b441-514ead15c5e1-istio-token\") pod \"e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s\" (UID: \"cd4a8100-3a8f-4006-b441-514ead15c5e1\") " pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:01:49.300539 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:49.300443    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd4a8100-3a8f-4006-b441-514ead15c5e1-workload-certs\") pod \"e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s\" (UID: \"cd4a8100-3a8f-4006-b441-514ead15c5e1\") " pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:01:49.300539 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:49.300504    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd4a8100-3a8f-4006-b441-514ead15c5e1-istio-envoy\") pod \"e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s\" (UID: \"cd4a8100-3a8f-4006-b441-514ead15c5e1\") " pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:01:49.300733 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:49.300563    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcmkr\" (UniqueName: \"kubernetes.io/projected/cd4a8100-3a8f-4006-b441-514ead15c5e1-kube-api-access-mcmkr\") pod \"e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s\" (UID: \"cd4a8100-3a8f-4006-b441-514ead15c5e1\") " pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:01:49.300733 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:49.300595    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd4a8100-3a8f-4006-b441-514ead15c5e1-istio-data\") pod \"e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s\" (UID: \"cd4a8100-3a8f-4006-b441-514ead15c5e1\") " pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:01:49.401455 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:49.401420    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd4a8100-3a8f-4006-b441-514ead15c5e1-istio-token\") pod \"e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s\" (UID: \"cd4a8100-3a8f-4006-b441-514ead15c5e1\") " pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:01:49.401624 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:49.401470    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd4a8100-3a8f-4006-b441-514ead15c5e1-workload-certs\") pod \"e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s\" (UID: \"cd4a8100-3a8f-4006-b441-514ead15c5e1\") " pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:01:49.401624 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:49.401504    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd4a8100-3a8f-4006-b441-514ead15c5e1-istio-envoy\") pod \"e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s\" (UID: \"cd4a8100-3a8f-4006-b441-514ead15c5e1\") " pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:01:49.401704 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:49.401679    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcmkr\" (UniqueName: \"kubernetes.io/projected/cd4a8100-3a8f-4006-b441-514ead15c5e1-kube-api-access-mcmkr\") pod \"e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s\" (UID: \"cd4a8100-3a8f-4006-b441-514ead15c5e1\") " pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:01:49.401758 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:49.401725    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd4a8100-3a8f-4006-b441-514ead15c5e1-istio-data\") pod \"e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s\" (UID: \"cd4a8100-3a8f-4006-b441-514ead15c5e1\") " pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:01:49.401809 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:49.401790    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd4a8100-3a8f-4006-b441-514ead15c5e1-credential-socket\") pod \"e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s\" (UID: \"cd4a8100-3a8f-4006-b441-514ead15c5e1\") " pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:01:49.401860 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:49.401825    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd4a8100-3a8f-4006-b441-514ead15c5e1-istio-podinfo\") pod \"e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s\" (UID: \"cd4a8100-3a8f-4006-b441-514ead15c5e1\") " pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:01:49.401860 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:49.401831    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd4a8100-3a8f-4006-b441-514ead15c5e1-workload-certs\") pod \"e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s\" (UID: \"cd4a8100-3a8f-4006-b441-514ead15c5e1\") " pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:01:49.401860 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:49.401849    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd4a8100-3a8f-4006-b441-514ead15c5e1-istiod-ca-cert\") pod \"e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s\" (UID: \"cd4a8100-3a8f-4006-b441-514ead15c5e1\") " pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:01:49.402110 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:49.401906    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd4a8100-3a8f-4006-b441-514ead15c5e1-workload-socket\") pod \"e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s\" (UID: \"cd4a8100-3a8f-4006-b441-514ead15c5e1\") " pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:01:49.402174 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:49.402111    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd4a8100-3a8f-4006-b441-514ead15c5e1-istio-data\") pod \"e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s\" (UID: \"cd4a8100-3a8f-4006-b441-514ead15c5e1\") " pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:01:49.402264 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:49.402229    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd4a8100-3a8f-4006-b441-514ead15c5e1-credential-socket\") pod \"e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s\" (UID: \"cd4a8100-3a8f-4006-b441-514ead15c5e1\") " pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:01:49.402400 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:49.402284    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd4a8100-3a8f-4006-b441-514ead15c5e1-workload-socket\") pod \"e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s\" (UID: \"cd4a8100-3a8f-4006-b441-514ead15c5e1\") " pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:01:49.402612 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:49.402592    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd4a8100-3a8f-4006-b441-514ead15c5e1-istiod-ca-cert\") pod \"e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s\" (UID: \"cd4a8100-3a8f-4006-b441-514ead15c5e1\") " pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:01:49.403822 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:49.403799    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd4a8100-3a8f-4006-b441-514ead15c5e1-istio-envoy\") pod \"e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s\" (UID: \"cd4a8100-3a8f-4006-b441-514ead15c5e1\") " pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:01:49.404087 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:49.404071    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd4a8100-3a8f-4006-b441-514ead15c5e1-istio-podinfo\") pod \"e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s\" (UID: \"cd4a8100-3a8f-4006-b441-514ead15c5e1\") " pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:01:49.409200 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:49.409178    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcmkr\" (UniqueName: \"kubernetes.io/projected/cd4a8100-3a8f-4006-b441-514ead15c5e1-kube-api-access-mcmkr\") pod \"e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s\" (UID: \"cd4a8100-3a8f-4006-b441-514ead15c5e1\") " pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:01:49.409329 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:49.409269    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd4a8100-3a8f-4006-b441-514ead15c5e1-istio-token\") pod \"e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s\" (UID: \"cd4a8100-3a8f-4006-b441-514ead15c5e1\") " pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:01:49.495527 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:49.495444    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:01:49.635090 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:49.635060    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"]
Jul 28 20:01:49.637505 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:01:49.637478    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd4a8100_3a8f_4006_b441_514ead15c5e1.slice/crio-80486f2fb2858e28d4d311bc8dbf0b638360e94c2a3048ed5950b412483bed51 WatchSource:0}: Error finding container 80486f2fb2858e28d4d311bc8dbf0b638360e94c2a3048ed5950b412483bed51: Status 404 returned error can't find the container with id 80486f2fb2858e28d4d311bc8dbf0b638360e94c2a3048ed5950b412483bed51
Jul 28 20:01:49.639609 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:49.639593    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 20:01:50.008945 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:50.008909    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s" event={"ID":"cd4a8100-3a8f-4006-b441-514ead15c5e1","Type":"ContainerStarted","Data":"80486f2fb2858e28d4d311bc8dbf0b638360e94c2a3048ed5950b412483bed51"}
Jul 28 20:01:52.188692 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:52.188656    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:01:52.188994 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:52.188724    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:01:52.188994 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:52.188752    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:01:53.024694 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:53.024660    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s" event={"ID":"cd4a8100-3a8f-4006-b441-514ead15c5e1","Type":"ContainerStarted","Data":"9403b6a235fd6a4b8dfd12f03c428d8371f2a3f1ff10c8f4b7ce66862358ab90"}
Jul 28 20:01:53.045243 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:53.045193    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s" podStartSLOduration=1.496511848 podStartE2EDuration="4.045175018s" totalImagesPullingTime="2.54866317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:01:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:01:53.043792108 +0000 UTC m=+1925.995824490" watchObservedRunningTime="2026-07-28 20:01:53.045175018 +0000 UTC m=+1925.997207347"
Jul 28 20:01:53.496310 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:53.496270    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:01:53.501287 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:53.501259    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:01:54.029493 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:54.029454    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:01:54.031364 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:54.031344    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:01:55.263567 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:55.263532    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8a457bc8-b8fb6fdc6-8m7nr"]
Jul 28 20:01:55.266970 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:55.266950    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-8a457bc8-b8fb6fdc6-8m7nr"
Jul 28 20:01:55.269666 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:55.269638    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-8a457bc8\""
Jul 28 20:01:55.269791 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:55.269661    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-8a457bc8-dockercfg-kk8dz\""
Jul 28 20:01:55.278266 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:55.278241    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8a457bc8-b8fb6fdc6-8m7nr"]
Jul 28 20:01:55.291336 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:55.291309    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8a457bc8-974cbd596-lvpfz"]
Jul 28 20:01:55.302703 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:55.302678    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8a457bc8-974cbd596-lvpfz"
Jul 28 20:01:55.302848 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:55.302827    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8a457bc8-974cbd596-lvpfz"]
Jul 28 20:01:55.357401 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:55.357366    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7bdv\" (UniqueName: \"kubernetes.io/projected/7b0db217-569f-448a-a2f1-3878e73cfdae-kube-api-access-z7bdv\") pod \"payload-pre-processing-e2e-ait-8a457bc8-b8fb6fdc6-8m7nr\" (UID: \"7b0db217-569f-448a-a2f1-3878e73cfdae\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8a457bc8-b8fb6fdc6-8m7nr"
Jul 28 20:01:55.357575 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:55.357409    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lk4v\" (UniqueName: \"kubernetes.io/projected/6201beef-46e8-454a-8f1b-ae2d5279434c-kube-api-access-5lk4v\") pod \"payload-processing-e2e-ait-8a457bc8-974cbd596-lvpfz\" (UID: \"6201beef-46e8-454a-8f1b-ae2d5279434c\") " pod="openshift-ingress/payload-processing-e2e-ait-8a457bc8-974cbd596-lvpfz"
Jul 28 20:01:55.357575 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:55.357512    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b0db217-569f-448a-a2f1-3878e73cfdae-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-8a457bc8-b8fb6fdc6-8m7nr\" (UID: \"7b0db217-569f-448a-a2f1-3878e73cfdae\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8a457bc8-b8fb6fdc6-8m7nr"
Jul 28 20:01:55.357575 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:55.357564    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6201beef-46e8-454a-8f1b-ae2d5279434c-plugins-config-volume\") pod \"payload-processing-e2e-ait-8a457bc8-974cbd596-lvpfz\" (UID: \"6201beef-46e8-454a-8f1b-ae2d5279434c\") " pod="openshift-ingress/payload-processing-e2e-ait-8a457bc8-974cbd596-lvpfz"
Jul 28 20:01:55.458879 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:55.458838    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lk4v\" (UniqueName: \"kubernetes.io/projected/6201beef-46e8-454a-8f1b-ae2d5279434c-kube-api-access-5lk4v\") pod \"payload-processing-e2e-ait-8a457bc8-974cbd596-lvpfz\" (UID: \"6201beef-46e8-454a-8f1b-ae2d5279434c\") " pod="openshift-ingress/payload-processing-e2e-ait-8a457bc8-974cbd596-lvpfz"
Jul 28 20:01:55.459064 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:55.459008    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b0db217-569f-448a-a2f1-3878e73cfdae-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-8a457bc8-b8fb6fdc6-8m7nr\" (UID: \"7b0db217-569f-448a-a2f1-3878e73cfdae\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8a457bc8-b8fb6fdc6-8m7nr"
Jul 28 20:01:55.459064 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:55.459057    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6201beef-46e8-454a-8f1b-ae2d5279434c-plugins-config-volume\") pod \"payload-processing-e2e-ait-8a457bc8-974cbd596-lvpfz\" (UID: \"6201beef-46e8-454a-8f1b-ae2d5279434c\") " pod="openshift-ingress/payload-processing-e2e-ait-8a457bc8-974cbd596-lvpfz"
Jul 28 20:01:55.459210 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:55.459188    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7bdv\" (UniqueName: \"kubernetes.io/projected/7b0db217-569f-448a-a2f1-3878e73cfdae-kube-api-access-z7bdv\") pod \"payload-pre-processing-e2e-ait-8a457bc8-b8fb6fdc6-8m7nr\" (UID: \"7b0db217-569f-448a-a2f1-3878e73cfdae\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8a457bc8-b8fb6fdc6-8m7nr"
Jul 28 20:01:55.459758 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:55.459737    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6201beef-46e8-454a-8f1b-ae2d5279434c-plugins-config-volume\") pod \"payload-processing-e2e-ait-8a457bc8-974cbd596-lvpfz\" (UID: \"6201beef-46e8-454a-8f1b-ae2d5279434c\") " pod="openshift-ingress/payload-processing-e2e-ait-8a457bc8-974cbd596-lvpfz"
Jul 28 20:01:55.460026 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:55.460002    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b0db217-569f-448a-a2f1-3878e73cfdae-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-8a457bc8-b8fb6fdc6-8m7nr\" (UID: \"7b0db217-569f-448a-a2f1-3878e73cfdae\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8a457bc8-b8fb6fdc6-8m7nr"
Jul 28 20:01:55.466717 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:55.466691    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7bdv\" (UniqueName: \"kubernetes.io/projected/7b0db217-569f-448a-a2f1-3878e73cfdae-kube-api-access-z7bdv\") pod \"payload-pre-processing-e2e-ait-8a457bc8-b8fb6fdc6-8m7nr\" (UID: \"7b0db217-569f-448a-a2f1-3878e73cfdae\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8a457bc8-b8fb6fdc6-8m7nr"
Jul 28 20:01:55.466837 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:55.466814    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lk4v\" (UniqueName: \"kubernetes.io/projected/6201beef-46e8-454a-8f1b-ae2d5279434c-kube-api-access-5lk4v\") pod \"payload-processing-e2e-ait-8a457bc8-974cbd596-lvpfz\" (UID: \"6201beef-46e8-454a-8f1b-ae2d5279434c\") " pod="openshift-ingress/payload-processing-e2e-ait-8a457bc8-974cbd596-lvpfz"
Jul 28 20:01:55.578263 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:55.578186    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-8a457bc8-b8fb6fdc6-8m7nr"
Jul 28 20:01:55.613004 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:55.612957    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8a457bc8-974cbd596-lvpfz"
Jul 28 20:01:55.731967 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:55.731931    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8a457bc8-b8fb6fdc6-8m7nr"]
Jul 28 20:01:55.734433 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:01:55.734401    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b0db217_569f_448a_a2f1_3878e73cfdae.slice/crio-d76c9744c36714f98fc9399f05cde20ee766c8b7eea7b8481db3a8242b795e58 WatchSource:0}: Error finding container d76c9744c36714f98fc9399f05cde20ee766c8b7eea7b8481db3a8242b795e58: Status 404 returned error can't find the container with id d76c9744c36714f98fc9399f05cde20ee766c8b7eea7b8481db3a8242b795e58
Jul 28 20:01:55.771666 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:55.771643    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8a457bc8-974cbd596-lvpfz"]
Jul 28 20:01:55.774179 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:01:55.774153    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6201beef_46e8_454a_8f1b_ae2d5279434c.slice/crio-c9ccc09ed29d3ecf6954c6017b807451e5b72669de43cf9cd2911d35c61f5318 WatchSource:0}: Error finding container c9ccc09ed29d3ecf6954c6017b807451e5b72669de43cf9cd2911d35c61f5318: Status 404 returned error can't find the container with id c9ccc09ed29d3ecf6954c6017b807451e5b72669de43cf9cd2911d35c61f5318
Jul 28 20:01:56.039154 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:56.039113    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-8a457bc8-b8fb6fdc6-8m7nr" event={"ID":"7b0db217-569f-448a-a2f1-3878e73cfdae","Type":"ContainerStarted","Data":"aa4d22695e15e171cc76e709c150a7737b5ff93e186336886e12a8b38e0157f9"}
Jul 28 20:01:56.039357 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:56.039181    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-8a457bc8-b8fb6fdc6-8m7nr" event={"ID":"7b0db217-569f-448a-a2f1-3878e73cfdae","Type":"ContainerStarted","Data":"d76c9744c36714f98fc9399f05cde20ee766c8b7eea7b8481db3a8242b795e58"}
Jul 28 20:01:56.039357 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:56.039208    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-8a457bc8-b8fb6fdc6-8m7nr"
Jul 28 20:01:56.040576 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:56.040548    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8a457bc8-974cbd596-lvpfz" event={"ID":"6201beef-46e8-454a-8f1b-ae2d5279434c","Type":"ContainerStarted","Data":"b9abc93f2a3b924544c171eaaa801dd3f401ab1c8a1cea3795515a4bf3337934"}
Jul 28 20:01:56.040674 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:56.040595    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8a457bc8-974cbd596-lvpfz" event={"ID":"6201beef-46e8-454a-8f1b-ae2d5279434c","Type":"ContainerStarted","Data":"c9ccc09ed29d3ecf6954c6017b807451e5b72669de43cf9cd2911d35c61f5318"}
Jul 28 20:01:56.054572 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:56.054506    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-8a457bc8-b8fb6fdc6-8m7nr" podStartSLOduration=1.054492243 podStartE2EDuration="1.054492243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:01:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:01:56.053645032 +0000 UTC m=+1929.005677372" watchObservedRunningTime="2026-07-28 20:01:56.054492243 +0000 UTC m=+1929.006524572"
Jul 28 20:01:56.069287 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:56.069246    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-8a457bc8-974cbd596-lvpfz" podStartSLOduration=1.069231469 podStartE2EDuration="1.069231469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:01:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:01:56.068427423 +0000 UTC m=+1929.020459781" watchObservedRunningTime="2026-07-28 20:01:56.069231469 +0000 UTC m=+1929.021263798"
Jul 28 20:01:57.044623 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:01:57.044587    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-8a457bc8-974cbd596-lvpfz"
Jul 28 20:02:07.047444 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:07.047414    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-8a457bc8-b8fb6fdc6-8m7nr"
Jul 28 20:02:07.088723 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:07.088684    2570 generic.go:356] "Generic (PLEG): container finished" podID="cd4a8100-3a8f-4006-b441-514ead15c5e1" containerID="9403b6a235fd6a4b8dfd12f03c428d8371f2a3f1ff10c8f4b7ce66862358ab90" exitCode=0
Jul 28 20:02:07.088893 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:07.088748    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s" event={"ID":"cd4a8100-3a8f-4006-b441-514ead15c5e1","Type":"ContainerDied","Data":"9403b6a235fd6a4b8dfd12f03c428d8371f2a3f1ff10c8f4b7ce66862358ab90"}
Jul 28 20:02:07.089160 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:07.089146    2570 scope.go:117] "RemoveContainer" containerID="9403b6a235fd6a4b8dfd12f03c428d8371f2a3f1ff10c8f4b7ce66862358ab90"
Jul 28 20:02:07.091111 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:07.091082    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:02:07.091219 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:07.091176    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:02:07.091290 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:07.091226    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:02:08.051189 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:08.051157    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-8a457bc8-974cbd596-lvpfz"
Jul 28 20:02:08.096898 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:08.096866    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s" event={"ID":"cd4a8100-3a8f-4006-b441-514ead15c5e1","Type":"ContainerStarted","Data":"1623e7debeee02f338df282603de654b22b6028c11abb70f757ab592e5a73b5e"}
Jul 28 20:02:08.497999 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:08.497460    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:02:08.497999 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:08.497625    2570 patch_prober.go:28] interesting pod/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Jul 28 20:02:08.497999 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:08.497685    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s" podUID="cd4a8100-3a8f-4006-b441-514ead15c5e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Jul 28 20:02:09.029755 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:09.029724    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:02:09.496132 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:09.496086    2570 patch_prober.go:28] interesting pod/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Jul 28 20:02:09.496660 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:09.496172    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s" podUID="cd4a8100-3a8f-4006-b441-514ead15c5e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Jul 28 20:02:10.496037 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:10.495994    2570 patch_prober.go:28] interesting pod/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Jul 28 20:02:10.496244 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:10.496068    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s" podUID="cd4a8100-3a8f-4006-b441-514ead15c5e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Jul 28 20:02:11.496441 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:11.496401    2570 patch_prober.go:28] interesting pod/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Jul 28 20:02:11.497068 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:11.497034    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s" podUID="cd4a8100-3a8f-4006-b441-514ead15c5e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Jul 28 20:02:12.496320 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:12.496273    2570 patch_prober.go:28] interesting pod/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Jul 28 20:02:12.496531 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:12.496346    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s" podUID="cd4a8100-3a8f-4006-b441-514ead15c5e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Jul 28 20:02:13.500628 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:13.500592    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:02:13.501444 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:13.501424    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:02:35.187544 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:35.187506    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8a457bc8-974cbd596-lvpfz"]
Jul 28 20:02:35.188111 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:35.187769    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-8a457bc8-974cbd596-lvpfz" podUID="6201beef-46e8-454a-8f1b-ae2d5279434c" containerName="payload-processing" containerID="cri-o://b9abc93f2a3b924544c171eaaa801dd3f401ab1c8a1cea3795515a4bf3337934" gracePeriod=30
Jul 28 20:02:35.192386 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:35.192355    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8a457bc8-b8fb6fdc6-8m7nr"]
Jul 28 20:02:35.192655 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:35.192597    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-8a457bc8-b8fb6fdc6-8m7nr" podUID="7b0db217-569f-448a-a2f1-3878e73cfdae" containerName="payload-pre-processing" containerID="cri-o://aa4d22695e15e171cc76e709c150a7737b5ff93e186336886e12a8b38e0157f9" gracePeriod=30
Jul 28 20:02:35.466507 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:35.466479    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-8a457bc8-b8fb6fdc6-8m7nr"
Jul 28 20:02:35.470476 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:35.470453    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8a457bc8-974cbd596-lvpfz"
Jul 28 20:02:35.475720 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:35.475689    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"]
Jul 28 20:02:35.475954 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:35.475918    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s" podUID="cd4a8100-3a8f-4006-b441-514ead15c5e1" containerName="istio-proxy" containerID="cri-o://1623e7debeee02f338df282603de654b22b6028c11abb70f757ab592e5a73b5e" gracePeriod=30
Jul 28 20:02:35.519307 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:35.519278    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b0db217-569f-448a-a2f1-3878e73cfdae-plugins-config-volume\") pod \"7b0db217-569f-448a-a2f1-3878e73cfdae\" (UID: \"7b0db217-569f-448a-a2f1-3878e73cfdae\") "
Jul 28 20:02:35.519472 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:35.519379    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lk4v\" (UniqueName: \"kubernetes.io/projected/6201beef-46e8-454a-8f1b-ae2d5279434c-kube-api-access-5lk4v\") pod \"6201beef-46e8-454a-8f1b-ae2d5279434c\" (UID: \"6201beef-46e8-454a-8f1b-ae2d5279434c\") "
Jul 28 20:02:35.519472 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:35.519424    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7bdv\" (UniqueName: \"kubernetes.io/projected/7b0db217-569f-448a-a2f1-3878e73cfdae-kube-api-access-z7bdv\") pod \"7b0db217-569f-448a-a2f1-3878e73cfdae\" (UID: \"7b0db217-569f-448a-a2f1-3878e73cfdae\") "
Jul 28 20:02:35.519472 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:35.519450    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6201beef-46e8-454a-8f1b-ae2d5279434c-plugins-config-volume\") pod \"6201beef-46e8-454a-8f1b-ae2d5279434c\" (UID: \"6201beef-46e8-454a-8f1b-ae2d5279434c\") "
Jul 28 20:02:35.519763 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:35.519727    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b0db217-569f-448a-a2f1-3878e73cfdae-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7b0db217-569f-448a-a2f1-3878e73cfdae" (UID: "7b0db217-569f-448a-a2f1-3878e73cfdae"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:02:35.519940 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:35.519913    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6201beef-46e8-454a-8f1b-ae2d5279434c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6201beef-46e8-454a-8f1b-ae2d5279434c" (UID: "6201beef-46e8-454a-8f1b-ae2d5279434c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:02:35.521660 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:35.521626    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b0db217-569f-448a-a2f1-3878e73cfdae-kube-api-access-z7bdv" (OuterVolumeSpecName: "kube-api-access-z7bdv") pod "7b0db217-569f-448a-a2f1-3878e73cfdae" (UID: "7b0db217-569f-448a-a2f1-3878e73cfdae"). InnerVolumeSpecName "kube-api-access-z7bdv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:02:35.521748 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:35.521653    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6201beef-46e8-454a-8f1b-ae2d5279434c-kube-api-access-5lk4v" (OuterVolumeSpecName: "kube-api-access-5lk4v") pod "6201beef-46e8-454a-8f1b-ae2d5279434c" (UID: "6201beef-46e8-454a-8f1b-ae2d5279434c"). InnerVolumeSpecName "kube-api-access-5lk4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:02:35.620723 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:35.620695    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lk4v\" (UniqueName: \"kubernetes.io/projected/6201beef-46e8-454a-8f1b-ae2d5279434c-kube-api-access-5lk4v\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:02:35.620723 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:35.620721    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7bdv\" (UniqueName: \"kubernetes.io/projected/7b0db217-569f-448a-a2f1-3878e73cfdae-kube-api-access-z7bdv\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:02:35.620888 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:35.620731    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6201beef-46e8-454a-8f1b-ae2d5279434c-plugins-config-volume\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:02:35.620888 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:35.620739    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b0db217-569f-448a-a2f1-3878e73cfdae-plugins-config-volume\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:02:36.233164 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.233131    2570 generic.go:356] "Generic (PLEG): container finished" podID="7b0db217-569f-448a-a2f1-3878e73cfdae" containerID="aa4d22695e15e171cc76e709c150a7737b5ff93e186336886e12a8b38e0157f9" exitCode=0
Jul 28 20:02:36.233602 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.233187    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-8a457bc8-b8fb6fdc6-8m7nr"
Jul 28 20:02:36.233602 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.233217    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-8a457bc8-b8fb6fdc6-8m7nr" event={"ID":"7b0db217-569f-448a-a2f1-3878e73cfdae","Type":"ContainerDied","Data":"aa4d22695e15e171cc76e709c150a7737b5ff93e186336886e12a8b38e0157f9"}
Jul 28 20:02:36.233602 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.233278    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-8a457bc8-b8fb6fdc6-8m7nr" event={"ID":"7b0db217-569f-448a-a2f1-3878e73cfdae","Type":"ContainerDied","Data":"d76c9744c36714f98fc9399f05cde20ee766c8b7eea7b8481db3a8242b795e58"}
Jul 28 20:02:36.233602 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.233301    2570 scope.go:117] "RemoveContainer" containerID="aa4d22695e15e171cc76e709c150a7737b5ff93e186336886e12a8b38e0157f9"
Jul 28 20:02:36.234656 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.234541    2570 generic.go:356] "Generic (PLEG): container finished" podID="6201beef-46e8-454a-8f1b-ae2d5279434c" containerID="b9abc93f2a3b924544c171eaaa801dd3f401ab1c8a1cea3795515a4bf3337934" exitCode=0
Jul 28 20:02:36.234656 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.234581    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8a457bc8-974cbd596-lvpfz" event={"ID":"6201beef-46e8-454a-8f1b-ae2d5279434c","Type":"ContainerDied","Data":"b9abc93f2a3b924544c171eaaa801dd3f401ab1c8a1cea3795515a4bf3337934"}
Jul 28 20:02:36.234656 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.234594    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8a457bc8-974cbd596-lvpfz"
Jul 28 20:02:36.234656 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.234622    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8a457bc8-974cbd596-lvpfz" event={"ID":"6201beef-46e8-454a-8f1b-ae2d5279434c","Type":"ContainerDied","Data":"c9ccc09ed29d3ecf6954c6017b807451e5b72669de43cf9cd2911d35c61f5318"}
Jul 28 20:02:36.241721 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.241702    2570 scope.go:117] "RemoveContainer" containerID="aa4d22695e15e171cc76e709c150a7737b5ff93e186336886e12a8b38e0157f9"
Jul 28 20:02:36.242018 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:02:36.241993    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa4d22695e15e171cc76e709c150a7737b5ff93e186336886e12a8b38e0157f9\": container with ID starting with aa4d22695e15e171cc76e709c150a7737b5ff93e186336886e12a8b38e0157f9 not found: ID does not exist" containerID="aa4d22695e15e171cc76e709c150a7737b5ff93e186336886e12a8b38e0157f9"
Jul 28 20:02:36.242115 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.242027    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa4d22695e15e171cc76e709c150a7737b5ff93e186336886e12a8b38e0157f9"} err="failed to get container status \"aa4d22695e15e171cc76e709c150a7737b5ff93e186336886e12a8b38e0157f9\": rpc error: code = NotFound desc = could not find container \"aa4d22695e15e171cc76e709c150a7737b5ff93e186336886e12a8b38e0157f9\": container with ID starting with aa4d22695e15e171cc76e709c150a7737b5ff93e186336886e12a8b38e0157f9 not found: ID does not exist"
Jul 28 20:02:36.242115 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.242053    2570 scope.go:117] "RemoveContainer" containerID="b9abc93f2a3b924544c171eaaa801dd3f401ab1c8a1cea3795515a4bf3337934"
Jul 28 20:02:36.249041 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.249030    2570 scope.go:117] "RemoveContainer" containerID="b9abc93f2a3b924544c171eaaa801dd3f401ab1c8a1cea3795515a4bf3337934"
Jul 28 20:02:36.249314 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:02:36.249287    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9abc93f2a3b924544c171eaaa801dd3f401ab1c8a1cea3795515a4bf3337934\": container with ID starting with b9abc93f2a3b924544c171eaaa801dd3f401ab1c8a1cea3795515a4bf3337934 not found: ID does not exist" containerID="b9abc93f2a3b924544c171eaaa801dd3f401ab1c8a1cea3795515a4bf3337934"
Jul 28 20:02:36.249435 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.249321    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9abc93f2a3b924544c171eaaa801dd3f401ab1c8a1cea3795515a4bf3337934"} err="failed to get container status \"b9abc93f2a3b924544c171eaaa801dd3f401ab1c8a1cea3795515a4bf3337934\": rpc error: code = NotFound desc = could not find container \"b9abc93f2a3b924544c171eaaa801dd3f401ab1c8a1cea3795515a4bf3337934\": container with ID starting with b9abc93f2a3b924544c171eaaa801dd3f401ab1c8a1cea3795515a4bf3337934 not found: ID does not exist"
Jul 28 20:02:36.251722 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.251671    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8a457bc8-b8fb6fdc6-8m7nr"]
Jul 28 20:02:36.253516 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.253493    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8a457bc8-b8fb6fdc6-8m7nr"]
Jul 28 20:02:36.263488 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.263463    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8a457bc8-974cbd596-lvpfz"]
Jul 28 20:02:36.266022 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.266003    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8a457bc8-974cbd596-lvpfz"]
Jul 28 20:02:36.479701 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.479665    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"]
Jul 28 20:02:36.480012 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.479999    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6201beef-46e8-454a-8f1b-ae2d5279434c" containerName="payload-processing"
Jul 28 20:02:36.480061 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.480014    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6201beef-46e8-454a-8f1b-ae2d5279434c" containerName="payload-processing"
Jul 28 20:02:36.480061 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.480026    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b0db217-569f-448a-a2f1-3878e73cfdae" containerName="payload-pre-processing"
Jul 28 20:02:36.480061 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.480032    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b0db217-569f-448a-a2f1-3878e73cfdae" containerName="payload-pre-processing"
Jul 28 20:02:36.480160 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.480079    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="6201beef-46e8-454a-8f1b-ae2d5279434c" containerName="payload-processing"
Jul 28 20:02:36.480160 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.480091    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b0db217-569f-448a-a2f1-3878e73cfdae" containerName="payload-pre-processing"
Jul 28 20:02:36.484534 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.484479    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:02:36.488220 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.488202    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-b2dba1e2-gw-openshift-default-dockercfg-4dv92\""
Jul 28 20:02:36.505815 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.505786    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"]
Jul 28 20:02:36.629737 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.629706    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b3279d8-33ad-416b-b2ec-c560d5a95111-istio-token\") pod \"e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd\" (UID: \"4b3279d8-33ad-416b-b2ec-c560d5a95111\") " pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:02:36.629737 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.629747    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b3279d8-33ad-416b-b2ec-c560d5a95111-istio-podinfo\") pod \"e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd\" (UID: \"4b3279d8-33ad-416b-b2ec-c560d5a95111\") " pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:02:36.630045 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.629817    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nrjn\" (UniqueName: \"kubernetes.io/projected/4b3279d8-33ad-416b-b2ec-c560d5a95111-kube-api-access-8nrjn\") pod \"e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd\" (UID: \"4b3279d8-33ad-416b-b2ec-c560d5a95111\") " pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:02:36.630045 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.629880    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b3279d8-33ad-416b-b2ec-c560d5a95111-credential-socket\") pod \"e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd\" (UID: \"4b3279d8-33ad-416b-b2ec-c560d5a95111\") " pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:02:36.630045 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.629906    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b3279d8-33ad-416b-b2ec-c560d5a95111-workload-certs\") pod \"e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd\" (UID: \"4b3279d8-33ad-416b-b2ec-c560d5a95111\") " pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:02:36.630045 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.629953    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b3279d8-33ad-416b-b2ec-c560d5a95111-workload-socket\") pod \"e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd\" (UID: \"4b3279d8-33ad-416b-b2ec-c560d5a95111\") " pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:02:36.630045 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.629969    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b3279d8-33ad-416b-b2ec-c560d5a95111-istiod-ca-cert\") pod \"e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd\" (UID: \"4b3279d8-33ad-416b-b2ec-c560d5a95111\") " pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:02:36.630045 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.630014    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b3279d8-33ad-416b-b2ec-c560d5a95111-istio-data\") pod \"e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd\" (UID: \"4b3279d8-33ad-416b-b2ec-c560d5a95111\") " pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:02:36.630253 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.630060    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b3279d8-33ad-416b-b2ec-c560d5a95111-istio-envoy\") pod \"e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd\" (UID: \"4b3279d8-33ad-416b-b2ec-c560d5a95111\") " pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:02:36.730833 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.730799    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b3279d8-33ad-416b-b2ec-c560d5a95111-istio-podinfo\") pod \"e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd\" (UID: \"4b3279d8-33ad-416b-b2ec-c560d5a95111\") " pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:02:36.731075 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.730850    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nrjn\" (UniqueName: \"kubernetes.io/projected/4b3279d8-33ad-416b-b2ec-c560d5a95111-kube-api-access-8nrjn\") pod \"e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd\" (UID: \"4b3279d8-33ad-416b-b2ec-c560d5a95111\") " pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:02:36.731075 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.730889    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b3279d8-33ad-416b-b2ec-c560d5a95111-credential-socket\") pod \"e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd\" (UID: \"4b3279d8-33ad-416b-b2ec-c560d5a95111\") " pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:02:36.731075 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.730912    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b3279d8-33ad-416b-b2ec-c560d5a95111-workload-certs\") pod \"e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd\" (UID: \"4b3279d8-33ad-416b-b2ec-c560d5a95111\") " pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:02:36.731075 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.730944    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b3279d8-33ad-416b-b2ec-c560d5a95111-workload-socket\") pod \"e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd\" (UID: \"4b3279d8-33ad-416b-b2ec-c560d5a95111\") " pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:02:36.731075 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.730967    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b3279d8-33ad-416b-b2ec-c560d5a95111-istiod-ca-cert\") pod \"e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd\" (UID: \"4b3279d8-33ad-416b-b2ec-c560d5a95111\") " pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:02:36.731075 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.731019    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b3279d8-33ad-416b-b2ec-c560d5a95111-istio-data\") pod \"e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd\" (UID: \"4b3279d8-33ad-416b-b2ec-c560d5a95111\") " pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:02:36.731424 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.731084    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b3279d8-33ad-416b-b2ec-c560d5a95111-istio-envoy\") pod \"e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd\" (UID: \"4b3279d8-33ad-416b-b2ec-c560d5a95111\") " pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:02:36.731424 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.731130    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b3279d8-33ad-416b-b2ec-c560d5a95111-istio-token\") pod \"e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd\" (UID: \"4b3279d8-33ad-416b-b2ec-c560d5a95111\") " pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:02:36.731582 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.731557    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b3279d8-33ad-416b-b2ec-c560d5a95111-credential-socket\") pod \"e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd\" (UID: \"4b3279d8-33ad-416b-b2ec-c560d5a95111\") " pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:02:36.731954 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.731912    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b3279d8-33ad-416b-b2ec-c560d5a95111-workload-certs\") pod \"e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd\" (UID: \"4b3279d8-33ad-416b-b2ec-c560d5a95111\") " pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:02:36.732127 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.732102    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b3279d8-33ad-416b-b2ec-c560d5a95111-istio-data\") pod \"e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd\" (UID: \"4b3279d8-33ad-416b-b2ec-c560d5a95111\") " pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:02:36.732220 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.732109    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b3279d8-33ad-416b-b2ec-c560d5a95111-istiod-ca-cert\") pod \"e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd\" (UID: \"4b3279d8-33ad-416b-b2ec-c560d5a95111\") " pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:02:36.732220 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.732145    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b3279d8-33ad-416b-b2ec-c560d5a95111-workload-socket\") pod \"e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd\" (UID: \"4b3279d8-33ad-416b-b2ec-c560d5a95111\") " pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:02:36.733492 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.733473    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b3279d8-33ad-416b-b2ec-c560d5a95111-istio-envoy\") pod \"e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd\" (UID: \"4b3279d8-33ad-416b-b2ec-c560d5a95111\") " pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:02:36.733598 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.733572    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b3279d8-33ad-416b-b2ec-c560d5a95111-istio-podinfo\") pod \"e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd\" (UID: \"4b3279d8-33ad-416b-b2ec-c560d5a95111\") " pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:02:36.738896 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.738833    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nrjn\" (UniqueName: \"kubernetes.io/projected/4b3279d8-33ad-416b-b2ec-c560d5a95111-kube-api-access-8nrjn\") pod \"e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd\" (UID: \"4b3279d8-33ad-416b-b2ec-c560d5a95111\") " pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:02:36.738997 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.738905    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b3279d8-33ad-416b-b2ec-c560d5a95111-istio-token\") pod \"e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd\" (UID: \"4b3279d8-33ad-416b-b2ec-c560d5a95111\") " pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:02:36.794985 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.794935    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:02:36.928781 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.928741    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"]
Jul 28 20:02:36.931533 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:02:36.931505    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b3279d8_33ad_416b_b2ec_c560d5a95111.slice/crio-b76bd715356b55913a2f4cd45bbd952971221ff7f26d932c445933e09aa152a1 WatchSource:0}: Error finding container b76bd715356b55913a2f4cd45bbd952971221ff7f26d932c445933e09aa152a1: Status 404 returned error can't find the container with id b76bd715356b55913a2f4cd45bbd952971221ff7f26d932c445933e09aa152a1
Jul 28 20:02:36.933679 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.933642    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:02:36.933759 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.933722    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:02:36.933793 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:36.933763    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:02:37.241548 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:37.241444    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd" event={"ID":"4b3279d8-33ad-416b-b2ec-c560d5a95111","Type":"ContainerStarted","Data":"1749ca27f5a82f8e1f393a820b7c6b3f8f137704a68f4860834a690309157f80"}
Jul 28 20:02:37.241548 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:37.241512    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd" event={"ID":"4b3279d8-33ad-416b-b2ec-c560d5a95111","Type":"ContainerStarted","Data":"b76bd715356b55913a2f4cd45bbd952971221ff7f26d932c445933e09aa152a1"}
Jul 28 20:02:37.262287 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:37.262240    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd" podStartSLOduration=1.262224689 podStartE2EDuration="1.262224689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:02:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:02:37.259558848 +0000 UTC m=+1970.211591172" watchObservedRunningTime="2026-07-28 20:02:37.262224689 +0000 UTC m=+1970.214257019"
Jul 28 20:02:37.573994 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:37.573894    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6201beef-46e8-454a-8f1b-ae2d5279434c" path="/var/lib/kubelet/pods/6201beef-46e8-454a-8f1b-ae2d5279434c/volumes"
Jul 28 20:02:37.574302 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:37.574286    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b0db217-569f-448a-a2f1-3878e73cfdae" path="/var/lib/kubelet/pods/7b0db217-569f-448a-a2f1-3878e73cfdae/volumes"
Jul 28 20:02:37.795423 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:37.795388    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:02:37.800725 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:37.800698    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:02:38.248040 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:38.248003    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:02:38.248956 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:38.248937    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:02:39.524143 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:39.524067    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b2dba1e2-5c67f8cc48-2csqs"]
Jul 28 20:02:39.528196 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:39.528174    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b2dba1e2-5c67f8cc48-2csqs"
Jul 28 20:02:39.530845 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:39.530817    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-b2dba1e2\""
Jul 28 20:02:39.530845 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:39.530838    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-b2dba1e2-dockercfg-t2kqw\""
Jul 28 20:02:39.538327 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:39.538297    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b2dba1e2-5c67f8cc48-2csqs"]
Jul 28 20:02:39.546757 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:39.546732    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-b2dba1e2-58ccbc5d57-7rtcq"]
Jul 28 20:02:39.550930 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:39.550907    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-b2dba1e2-58ccbc5d57-7rtcq"
Jul 28 20:02:39.560804 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:39.560779    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-b2dba1e2-58ccbc5d57-7rtcq"]
Jul 28 20:02:39.659382 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:39.659342    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kg59\" (UniqueName: \"kubernetes.io/projected/a1515f5e-c67f-4318-aa68-5d03b9825df7-kube-api-access-5kg59\") pod \"payload-pre-processing-e2e-migrate-b2dba1e2-5c67f8cc48-2csqs\" (UID: \"a1515f5e-c67f-4318-aa68-5d03b9825df7\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b2dba1e2-5c67f8cc48-2csqs"
Jul 28 20:02:39.659573 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:39.659398    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvdv8\" (UniqueName: \"kubernetes.io/projected/0c6103dd-a61f-4d5d-b6ef-a7f90c9b526d-kube-api-access-lvdv8\") pod \"payload-processing-e2e-migrate-b2dba1e2-58ccbc5d57-7rtcq\" (UID: \"0c6103dd-a61f-4d5d-b6ef-a7f90c9b526d\") " pod="openshift-ingress/payload-processing-e2e-migrate-b2dba1e2-58ccbc5d57-7rtcq"
Jul 28 20:02:39.659573 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:39.659505    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1515f5e-c67f-4318-aa68-5d03b9825df7-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-b2dba1e2-5c67f8cc48-2csqs\" (UID: \"a1515f5e-c67f-4318-aa68-5d03b9825df7\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b2dba1e2-5c67f8cc48-2csqs"
Jul 28 20:02:39.659683 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:39.659567    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c6103dd-a61f-4d5d-b6ef-a7f90c9b526d-plugins-config-volume\") pod \"payload-processing-e2e-migrate-b2dba1e2-58ccbc5d57-7rtcq\" (UID: \"0c6103dd-a61f-4d5d-b6ef-a7f90c9b526d\") " pod="openshift-ingress/payload-processing-e2e-migrate-b2dba1e2-58ccbc5d57-7rtcq"
Jul 28 20:02:39.760953 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:39.760910    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kg59\" (UniqueName: \"kubernetes.io/projected/a1515f5e-c67f-4318-aa68-5d03b9825df7-kube-api-access-5kg59\") pod \"payload-pre-processing-e2e-migrate-b2dba1e2-5c67f8cc48-2csqs\" (UID: \"a1515f5e-c67f-4318-aa68-5d03b9825df7\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b2dba1e2-5c67f8cc48-2csqs"
Jul 28 20:02:39.761161 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:39.760969    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvdv8\" (UniqueName: \"kubernetes.io/projected/0c6103dd-a61f-4d5d-b6ef-a7f90c9b526d-kube-api-access-lvdv8\") pod \"payload-processing-e2e-migrate-b2dba1e2-58ccbc5d57-7rtcq\" (UID: \"0c6103dd-a61f-4d5d-b6ef-a7f90c9b526d\") " pod="openshift-ingress/payload-processing-e2e-migrate-b2dba1e2-58ccbc5d57-7rtcq"
Jul 28 20:02:39.761161 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:39.761039    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1515f5e-c67f-4318-aa68-5d03b9825df7-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-b2dba1e2-5c67f8cc48-2csqs\" (UID: \"a1515f5e-c67f-4318-aa68-5d03b9825df7\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b2dba1e2-5c67f8cc48-2csqs"
Jul 28 20:02:39.761161 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:39.761073    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c6103dd-a61f-4d5d-b6ef-a7f90c9b526d-plugins-config-volume\") pod \"payload-processing-e2e-migrate-b2dba1e2-58ccbc5d57-7rtcq\" (UID: \"0c6103dd-a61f-4d5d-b6ef-a7f90c9b526d\") " pod="openshift-ingress/payload-processing-e2e-migrate-b2dba1e2-58ccbc5d57-7rtcq"
Jul 28 20:02:39.761845 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:39.761822    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c6103dd-a61f-4d5d-b6ef-a7f90c9b526d-plugins-config-volume\") pod \"payload-processing-e2e-migrate-b2dba1e2-58ccbc5d57-7rtcq\" (UID: \"0c6103dd-a61f-4d5d-b6ef-a7f90c9b526d\") " pod="openshift-ingress/payload-processing-e2e-migrate-b2dba1e2-58ccbc5d57-7rtcq"
Jul 28 20:02:39.761911 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:39.761825    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1515f5e-c67f-4318-aa68-5d03b9825df7-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-b2dba1e2-5c67f8cc48-2csqs\" (UID: \"a1515f5e-c67f-4318-aa68-5d03b9825df7\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b2dba1e2-5c67f8cc48-2csqs"
Jul 28 20:02:39.769385 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:39.769360    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kg59\" (UniqueName: \"kubernetes.io/projected/a1515f5e-c67f-4318-aa68-5d03b9825df7-kube-api-access-5kg59\") pod \"payload-pre-processing-e2e-migrate-b2dba1e2-5c67f8cc48-2csqs\" (UID: \"a1515f5e-c67f-4318-aa68-5d03b9825df7\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b2dba1e2-5c67f8cc48-2csqs"
Jul 28 20:02:39.769806 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:39.769784    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvdv8\" (UniqueName: \"kubernetes.io/projected/0c6103dd-a61f-4d5d-b6ef-a7f90c9b526d-kube-api-access-lvdv8\") pod \"payload-processing-e2e-migrate-b2dba1e2-58ccbc5d57-7rtcq\" (UID: \"0c6103dd-a61f-4d5d-b6ef-a7f90c9b526d\") " pod="openshift-ingress/payload-processing-e2e-migrate-b2dba1e2-58ccbc5d57-7rtcq"
Jul 28 20:02:39.839739 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:39.839648    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b2dba1e2-5c67f8cc48-2csqs"
Jul 28 20:02:39.861969 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:39.861941    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-b2dba1e2-58ccbc5d57-7rtcq"
Jul 28 20:02:39.987614 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:39.987510    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b2dba1e2-5c67f8cc48-2csqs"]
Jul 28 20:02:39.989930 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:02:39.989901    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1515f5e_c67f_4318_aa68_5d03b9825df7.slice/crio-072dd9f55c3ca1af274c03941185c8464b24fe5eaf0519e579ba2c2898419fa1 WatchSource:0}: Error finding container 072dd9f55c3ca1af274c03941185c8464b24fe5eaf0519e579ba2c2898419fa1: Status 404 returned error can't find the container with id 072dd9f55c3ca1af274c03941185c8464b24fe5eaf0519e579ba2c2898419fa1
Jul 28 20:02:40.012849 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:40.012823    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-b2dba1e2-58ccbc5d57-7rtcq"]
Jul 28 20:02:40.015260 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:02:40.015233    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c6103dd_a61f_4d5d_b6ef_a7f90c9b526d.slice/crio-67792a6abec4f87615f57e918cb224a81adec0cbbf3b9ceb0654c43eb8ee72a5 WatchSource:0}: Error finding container 67792a6abec4f87615f57e918cb224a81adec0cbbf3b9ceb0654c43eb8ee72a5: Status 404 returned error can't find the container with id 67792a6abec4f87615f57e918cb224a81adec0cbbf3b9ceb0654c43eb8ee72a5
Jul 28 20:02:40.258964 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:40.258921    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-b2dba1e2-58ccbc5d57-7rtcq" event={"ID":"0c6103dd-a61f-4d5d-b6ef-a7f90c9b526d","Type":"ContainerStarted","Data":"e05c44ef088dbdae86f358b9fbfaf8e7791eb318287c87cf7b8361a9bb65d714"}
Jul 28 20:02:40.259183 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:40.259004    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-b2dba1e2-58ccbc5d57-7rtcq" event={"ID":"0c6103dd-a61f-4d5d-b6ef-a7f90c9b526d","Type":"ContainerStarted","Data":"67792a6abec4f87615f57e918cb224a81adec0cbbf3b9ceb0654c43eb8ee72a5"}
Jul 28 20:02:40.259183 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:40.259035    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-b2dba1e2-58ccbc5d57-7rtcq"
Jul 28 20:02:40.260334 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:40.260305    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b2dba1e2-5c67f8cc48-2csqs" event={"ID":"a1515f5e-c67f-4318-aa68-5d03b9825df7","Type":"ContainerStarted","Data":"9bdf37c84a0af59f623578cc4322d5e7c5952a8cf4797efaff4c96fc8d27dddd"}
Jul 28 20:02:40.260453 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:40.260352    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b2dba1e2-5c67f8cc48-2csqs" event={"ID":"a1515f5e-c67f-4318-aa68-5d03b9825df7","Type":"ContainerStarted","Data":"072dd9f55c3ca1af274c03941185c8464b24fe5eaf0519e579ba2c2898419fa1"}
Jul 28 20:02:40.275281 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:40.275205    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-b2dba1e2-58ccbc5d57-7rtcq" podStartSLOduration=1.2751864720000001 podStartE2EDuration="1.275186472s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:02:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:02:40.274207695 +0000 UTC m=+1973.226240052" watchObservedRunningTime="2026-07-28 20:02:40.275186472 +0000 UTC m=+1973.227218803"
Jul 28 20:02:40.289827 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:40.289772    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b2dba1e2-5c67f8cc48-2csqs" podStartSLOduration=1.289752659 podStartE2EDuration="1.289752659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:02:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:02:40.288837299 +0000 UTC m=+1973.240869657" watchObservedRunningTime="2026-07-28 20:02:40.289752659 +0000 UTC m=+1973.241784990"
Jul 28 20:02:40.720627 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:40.720603    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:02:40.871719 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:40.871642    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd4a8100-3a8f-4006-b441-514ead15c5e1-istio-token\") pod \"cd4a8100-3a8f-4006-b441-514ead15c5e1\" (UID: \"cd4a8100-3a8f-4006-b441-514ead15c5e1\") "
Jul 28 20:02:40.871852 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:40.871725    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd4a8100-3a8f-4006-b441-514ead15c5e1-workload-certs\") pod \"cd4a8100-3a8f-4006-b441-514ead15c5e1\" (UID: \"cd4a8100-3a8f-4006-b441-514ead15c5e1\") "
Jul 28 20:02:40.871852 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:40.871827    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd4a8100-3a8f-4006-b441-514ead15c5e1-istio-podinfo\") pod \"cd4a8100-3a8f-4006-b441-514ead15c5e1\" (UID: \"cd4a8100-3a8f-4006-b441-514ead15c5e1\") "
Jul 28 20:02:40.871925 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:40.871890    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd4a8100-3a8f-4006-b441-514ead15c5e1-istio-data\") pod \"cd4a8100-3a8f-4006-b441-514ead15c5e1\" (UID: \"cd4a8100-3a8f-4006-b441-514ead15c5e1\") "
Jul 28 20:02:40.871998 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:40.871963    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd4a8100-3a8f-4006-b441-514ead15c5e1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cd4a8100-3a8f-4006-b441-514ead15c5e1" (UID: "cd4a8100-3a8f-4006-b441-514ead15c5e1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:02:40.872042 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:40.872027    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd4a8100-3a8f-4006-b441-514ead15c5e1-istiod-ca-cert\") pod \"cd4a8100-3a8f-4006-b441-514ead15c5e1\" (UID: \"cd4a8100-3a8f-4006-b441-514ead15c5e1\") "
Jul 28 20:02:40.872084 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:40.872053    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcmkr\" (UniqueName: \"kubernetes.io/projected/cd4a8100-3a8f-4006-b441-514ead15c5e1-kube-api-access-mcmkr\") pod \"cd4a8100-3a8f-4006-b441-514ead15c5e1\" (UID: \"cd4a8100-3a8f-4006-b441-514ead15c5e1\") "
Jul 28 20:02:40.872138 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:40.872112    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd4a8100-3a8f-4006-b441-514ead15c5e1-workload-socket\") pod \"cd4a8100-3a8f-4006-b441-514ead15c5e1\" (UID: \"cd4a8100-3a8f-4006-b441-514ead15c5e1\") "
Jul 28 20:02:40.872196 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:40.872150    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd4a8100-3a8f-4006-b441-514ead15c5e1-istio-envoy\") pod \"cd4a8100-3a8f-4006-b441-514ead15c5e1\" (UID: \"cd4a8100-3a8f-4006-b441-514ead15c5e1\") "
Jul 28 20:02:40.872196 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:40.872176    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd4a8100-3a8f-4006-b441-514ead15c5e1-credential-socket\") pod \"cd4a8100-3a8f-4006-b441-514ead15c5e1\" (UID: \"cd4a8100-3a8f-4006-b441-514ead15c5e1\") "
Jul 28 20:02:40.872374 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:40.872354    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd4a8100-3a8f-4006-b441-514ead15c5e1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cd4a8100-3a8f-4006-b441-514ead15c5e1" (UID: "cd4a8100-3a8f-4006-b441-514ead15c5e1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:02:40.872374 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:40.872361    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd4a8100-3a8f-4006-b441-514ead15c5e1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cd4a8100-3a8f-4006-b441-514ead15c5e1" (UID: "cd4a8100-3a8f-4006-b441-514ead15c5e1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:02:40.872574 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:40.872516    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd4a8100-3a8f-4006-b441-514ead15c5e1-workload-certs\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:02:40.872574 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:40.872538    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd4a8100-3a8f-4006-b441-514ead15c5e1-istiod-ca-cert\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:02:40.872574 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:40.872540    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd4a8100-3a8f-4006-b441-514ead15c5e1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cd4a8100-3a8f-4006-b441-514ead15c5e1" (UID: "cd4a8100-3a8f-4006-b441-514ead15c5e1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:02:40.872574 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:40.872553    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd4a8100-3a8f-4006-b441-514ead15c5e1-workload-socket\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:02:40.872798 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:40.872753    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd4a8100-3a8f-4006-b441-514ead15c5e1-istio-data" (OuterVolumeSpecName: "istio-data") pod "cd4a8100-3a8f-4006-b441-514ead15c5e1" (UID: "cd4a8100-3a8f-4006-b441-514ead15c5e1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:02:40.874220 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:40.874197    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd4a8100-3a8f-4006-b441-514ead15c5e1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cd4a8100-3a8f-4006-b441-514ead15c5e1" (UID: "cd4a8100-3a8f-4006-b441-514ead15c5e1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:02:40.874317 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:40.874245    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cd4a8100-3a8f-4006-b441-514ead15c5e1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cd4a8100-3a8f-4006-b441-514ead15c5e1" (UID: "cd4a8100-3a8f-4006-b441-514ead15c5e1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:02:40.874317 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:40.874298    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd4a8100-3a8f-4006-b441-514ead15c5e1-istio-token" (OuterVolumeSpecName: "istio-token") pod "cd4a8100-3a8f-4006-b441-514ead15c5e1" (UID: "cd4a8100-3a8f-4006-b441-514ead15c5e1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:02:40.874534 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:40.874499    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd4a8100-3a8f-4006-b441-514ead15c5e1-kube-api-access-mcmkr" (OuterVolumeSpecName: "kube-api-access-mcmkr") pod "cd4a8100-3a8f-4006-b441-514ead15c5e1" (UID: "cd4a8100-3a8f-4006-b441-514ead15c5e1"). InnerVolumeSpecName "kube-api-access-mcmkr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:02:40.973201 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:40.973155    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcmkr\" (UniqueName: \"kubernetes.io/projected/cd4a8100-3a8f-4006-b441-514ead15c5e1-kube-api-access-mcmkr\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:02:40.973201 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:40.973196    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd4a8100-3a8f-4006-b441-514ead15c5e1-istio-envoy\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:02:40.973201 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:40.973210    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd4a8100-3a8f-4006-b441-514ead15c5e1-credential-socket\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:02:40.973423 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:40.973222    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd4a8100-3a8f-4006-b441-514ead15c5e1-istio-token\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:02:40.973423 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:40.973233    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd4a8100-3a8f-4006-b441-514ead15c5e1-istio-podinfo\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:02:40.973423 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:40.973245    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd4a8100-3a8f-4006-b441-514ead15c5e1-istio-data\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:02:41.266591 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:41.266559    2570 generic.go:356] "Generic (PLEG): container finished" podID="cd4a8100-3a8f-4006-b441-514ead15c5e1" containerID="1623e7debeee02f338df282603de654b22b6028c11abb70f757ab592e5a73b5e" exitCode=0
Jul 28 20:02:41.266786 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:41.266619    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"
Jul 28 20:02:41.266786 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:41.266643    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s" event={"ID":"cd4a8100-3a8f-4006-b441-514ead15c5e1","Type":"ContainerDied","Data":"1623e7debeee02f338df282603de654b22b6028c11abb70f757ab592e5a73b5e"}
Jul 28 20:02:41.266786 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:41.266705    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s" event={"ID":"cd4a8100-3a8f-4006-b441-514ead15c5e1","Type":"ContainerDied","Data":"80486f2fb2858e28d4d311bc8dbf0b638360e94c2a3048ed5950b412483bed51"}
Jul 28 20:02:41.266786 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:41.266731    2570 scope.go:117] "RemoveContainer" containerID="1623e7debeee02f338df282603de654b22b6028c11abb70f757ab592e5a73b5e"
Jul 28 20:02:41.267030 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:41.267009    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b2dba1e2-5c67f8cc48-2csqs"
Jul 28 20:02:41.275964 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:41.275945    2570 scope.go:117] "RemoveContainer" containerID="9403b6a235fd6a4b8dfd12f03c428d8371f2a3f1ff10c8f4b7ce66862358ab90"
Jul 28 20:02:41.283253 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:41.283236    2570 scope.go:117] "RemoveContainer" containerID="1623e7debeee02f338df282603de654b22b6028c11abb70f757ab592e5a73b5e"
Jul 28 20:02:41.283509 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:02:41.283489    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1623e7debeee02f338df282603de654b22b6028c11abb70f757ab592e5a73b5e\": container with ID starting with 1623e7debeee02f338df282603de654b22b6028c11abb70f757ab592e5a73b5e not found: ID does not exist" containerID="1623e7debeee02f338df282603de654b22b6028c11abb70f757ab592e5a73b5e"
Jul 28 20:02:41.283564 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:41.283516    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1623e7debeee02f338df282603de654b22b6028c11abb70f757ab592e5a73b5e"} err="failed to get container status \"1623e7debeee02f338df282603de654b22b6028c11abb70f757ab592e5a73b5e\": rpc error: code = NotFound desc = could not find container \"1623e7debeee02f338df282603de654b22b6028c11abb70f757ab592e5a73b5e\": container with ID starting with 1623e7debeee02f338df282603de654b22b6028c11abb70f757ab592e5a73b5e not found: ID does not exist"
Jul 28 20:02:41.283564 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:41.283533    2570 scope.go:117] "RemoveContainer" containerID="9403b6a235fd6a4b8dfd12f03c428d8371f2a3f1ff10c8f4b7ce66862358ab90"
Jul 28 20:02:41.283733 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:02:41.283720    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9403b6a235fd6a4b8dfd12f03c428d8371f2a3f1ff10c8f4b7ce66862358ab90\": container with ID starting with 9403b6a235fd6a4b8dfd12f03c428d8371f2a3f1ff10c8f4b7ce66862358ab90 not found: ID does not exist" containerID="9403b6a235fd6a4b8dfd12f03c428d8371f2a3f1ff10c8f4b7ce66862358ab90"
Jul 28 20:02:41.283776 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:41.283737    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9403b6a235fd6a4b8dfd12f03c428d8371f2a3f1ff10c8f4b7ce66862358ab90"} err="failed to get container status \"9403b6a235fd6a4b8dfd12f03c428d8371f2a3f1ff10c8f4b7ce66862358ab90\": rpc error: code = NotFound desc = could not find container \"9403b6a235fd6a4b8dfd12f03c428d8371f2a3f1ff10c8f4b7ce66862358ab90\": container with ID starting with 9403b6a235fd6a4b8dfd12f03c428d8371f2a3f1ff10c8f4b7ce66862358ab90 not found: ID does not exist"
Jul 28 20:02:41.288188 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:41.288164    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"]
Jul 28 20:02:41.302683 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:41.302659    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-8a457bc8-openshift-default-59bdfdc6cb-6kt4s"]
Jul 28 20:02:41.573687 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:41.573610    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd4a8100-3a8f-4006-b441-514ead15c5e1" path="/var/lib/kubelet/pods/cd4a8100-3a8f-4006-b441-514ead15c5e1/volumes"
Jul 28 20:02:51.269424 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:51.269377    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-b2dba1e2-58ccbc5d57-7rtcq"
Jul 28 20:02:52.275560 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:52.275525    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b2dba1e2-5c67f8cc48-2csqs"
Jul 28 20:02:53.249233 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:53.249201    2570 patch_prober.go:28] interesting pod/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Jul 28 20:02:53.249440 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:53.249265    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd" podUID="4b3279d8-33ad-416b-b2ec-c560d5a95111" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Jul 28 20:02:53.333424 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:53.333394    2570 generic.go:356] "Generic (PLEG): container finished" podID="4b3279d8-33ad-416b-b2ec-c560d5a95111" containerID="1749ca27f5a82f8e1f393a820b7c6b3f8f137704a68f4860834a690309157f80" exitCode=0
Jul 28 20:02:53.333810 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:53.333433    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd" event={"ID":"4b3279d8-33ad-416b-b2ec-c560d5a95111","Type":"ContainerDied","Data":"1749ca27f5a82f8e1f393a820b7c6b3f8f137704a68f4860834a690309157f80"}
Jul 28 20:02:53.333873 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:53.333856    2570 scope.go:117] "RemoveContainer" containerID="1749ca27f5a82f8e1f393a820b7c6b3f8f137704a68f4860834a690309157f80"
Jul 28 20:02:53.334870 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:53.334844    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:02:53.334993 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:53.334923    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:02:53.335074 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:53.334969    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:02:54.338949 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:54.338913    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd" event={"ID":"4b3279d8-33ad-416b-b2ec-c560d5a95111","Type":"ContainerStarted","Data":"3ed0bd6427972e87c0bb6a404d01480f6a879301569c96439d8caa0774e61c58"}
Jul 28 20:02:54.795334 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:54.795299    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:02:54.795666 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:54.795633    2570 patch_prober.go:28] interesting pod/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Jul 28 20:02:54.795762 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:54.795701    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd" podUID="4b3279d8-33ad-416b-b2ec-c560d5a95111" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Jul 28 20:02:55.795763 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:55.795723    2570 patch_prober.go:28] interesting pod/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Jul 28 20:02:55.796374 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:55.796339    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd" podUID="4b3279d8-33ad-416b-b2ec-c560d5a95111" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Jul 28 20:02:56.796426 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:56.795916    2570 patch_prober.go:28] interesting pod/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Jul 28 20:02:56.796426 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:56.796009    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd" podUID="4b3279d8-33ad-416b-b2ec-c560d5a95111" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Jul 28 20:02:57.795789 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:57.795750    2570 patch_prober.go:28] interesting pod/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Jul 28 20:02:57.796074 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:57.796044    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd" podUID="4b3279d8-33ad-416b-b2ec-c560d5a95111" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Jul 28 20:02:58.800323 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:58.800291    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:02:58.800719 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:58.800626    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:02:58.801260 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:02:58.801241    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:03:03.724270 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:03.724237    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2dba1e2-rqljr"]
Jul 28 20:03:03.724637 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:03.724549    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd4a8100-3a8f-4006-b441-514ead15c5e1" containerName="istio-proxy"
Jul 28 20:03:03.724637 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:03.724560    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd4a8100-3a8f-4006-b441-514ead15c5e1" containerName="istio-proxy"
Jul 28 20:03:03.724637 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:03.724572    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd4a8100-3a8f-4006-b441-514ead15c5e1" containerName="istio-proxy"
Jul 28 20:03:03.724637 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:03.724580    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd4a8100-3a8f-4006-b441-514ead15c5e1" containerName="istio-proxy"
Jul 28 20:03:03.724767 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:03.724644    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd4a8100-3a8f-4006-b441-514ead15c5e1" containerName="istio-proxy"
Jul 28 20:03:03.724767 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:03.724651    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd4a8100-3a8f-4006-b441-514ead15c5e1" containerName="istio-proxy"
Jul 28 20:03:03.726711 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:03.726695    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2dba1e2-rqljr"
Jul 28 20:03:03.729098 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:03.729069    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z6zs4\""
Jul 28 20:03:03.735133 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:03.735103    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2dba1e2-rqljr"]
Jul 28 20:03:03.771050 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:03.771022    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4be679f8-832f-410b-ab5c-6de25da83928-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b2dba1e2-rqljr\" (UID: \"4be679f8-832f-410b-ab5c-6de25da83928\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2dba1e2-rqljr"
Jul 28 20:03:03.871877 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:03.871843    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4be679f8-832f-410b-ab5c-6de25da83928-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b2dba1e2-rqljr\" (UID: \"4be679f8-832f-410b-ab5c-6de25da83928\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2dba1e2-rqljr"
Jul 28 20:03:03.872481 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:03.872462    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4be679f8-832f-410b-ab5c-6de25da83928-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b2dba1e2-rqljr\" (UID: \"4be679f8-832f-410b-ab5c-6de25da83928\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2dba1e2-rqljr"
Jul 28 20:03:04.038097 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:04.038020    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2dba1e2-rqljr"
Jul 28 20:03:04.373438 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:04.373413    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2dba1e2-rqljr"]
Jul 28 20:03:04.375662 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:03:04.375618    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4be679f8_832f_410b_ab5c_6de25da83928.slice/crio-eee5457bf261b38314e8005af2014b216b023af4f9315efe717e32246c2b518e WatchSource:0}: Error finding container eee5457bf261b38314e8005af2014b216b023af4f9315efe717e32246c2b518e: Status 404 returned error can't find the container with id eee5457bf261b38314e8005af2014b216b023af4f9315efe717e32246c2b518e
Jul 28 20:03:04.386009 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:04.385962    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2dba1e2-rqljr" event={"ID":"4be679f8-832f-410b-ab5c-6de25da83928","Type":"ContainerStarted","Data":"eee5457bf261b38314e8005af2014b216b023af4f9315efe717e32246c2b518e"}
Jul 28 20:03:05.391539 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:05.391462    2570 generic.go:356] "Generic (PLEG): container finished" podID="4be679f8-832f-410b-ab5c-6de25da83928" containerID="44501919ee61b43eb2c16cd89859ea77cc215a2d6f9cdc4d0ea2e7d524563acc" exitCode=0
Jul 28 20:03:05.391539 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:05.391524    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2dba1e2-rqljr" event={"ID":"4be679f8-832f-410b-ab5c-6de25da83928","Type":"ContainerDied","Data":"44501919ee61b43eb2c16cd89859ea77cc215a2d6f9cdc4d0ea2e7d524563acc"}
Jul 28 20:03:06.523597 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:06.523573    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2dba1e2-rqljr"
Jul 28 20:03:06.595191 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:06.595166    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4be679f8-832f-410b-ab5c-6de25da83928-maas-api-service-ca\") pod \"4be679f8-832f-410b-ab5c-6de25da83928\" (UID: \"4be679f8-832f-410b-ab5c-6de25da83928\") "
Jul 28 20:03:06.595511 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:06.595492    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4be679f8-832f-410b-ab5c-6de25da83928-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4be679f8-832f-410b-ab5c-6de25da83928" (UID: "4be679f8-832f-410b-ab5c-6de25da83928"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:03:06.696264 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:06.696235    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4be679f8-832f-410b-ab5c-6de25da83928-maas-api-service-ca\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:03:07.400849 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:07.400819    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2dba1e2-rqljr"
Jul 28 20:03:07.400849 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:07.400842    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2dba1e2-rqljr" event={"ID":"4be679f8-832f-410b-ab5c-6de25da83928","Type":"ContainerDied","Data":"eee5457bf261b38314e8005af2014b216b023af4f9315efe717e32246c2b518e"}
Jul 28 20:03:07.401086 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:07.400890    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eee5457bf261b38314e8005af2014b216b023af4f9315efe717e32246c2b518e"
Jul 28 20:03:10.291278 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:10.291238    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-b2dba1e2-58ccbc5d57-7rtcq"]
Jul 28 20:03:10.291755 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:10.291466    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-b2dba1e2-58ccbc5d57-7rtcq" podUID="0c6103dd-a61f-4d5d-b6ef-a7f90c9b526d" containerName="payload-processing" containerID="cri-o://e05c44ef088dbdae86f358b9fbfaf8e7791eb318287c87cf7b8361a9bb65d714" gracePeriod=30
Jul 28 20:03:10.298865 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:10.298838    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b2dba1e2-5c67f8cc48-2csqs"]
Jul 28 20:03:10.299276 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:10.299237    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b2dba1e2-5c67f8cc48-2csqs" podUID="a1515f5e-c67f-4318-aa68-5d03b9825df7" containerName="payload-pre-processing" containerID="cri-o://9bdf37c84a0af59f623578cc4322d5e7c5952a8cf4797efaff4c96fc8d27dddd" gracePeriod=30
Jul 28 20:03:10.417327 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:10.417284    2570 generic.go:356] "Generic (PLEG): container finished" podID="a1515f5e-c67f-4318-aa68-5d03b9825df7" containerID="9bdf37c84a0af59f623578cc4322d5e7c5952a8cf4797efaff4c96fc8d27dddd" exitCode=0
Jul 28 20:03:10.417471 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:10.417371    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b2dba1e2-5c67f8cc48-2csqs" event={"ID":"a1515f5e-c67f-4318-aa68-5d03b9825df7","Type":"ContainerDied","Data":"9bdf37c84a0af59f623578cc4322d5e7c5952a8cf4797efaff4c96fc8d27dddd"}
Jul 28 20:03:10.419164 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:10.419142    2570 generic.go:356] "Generic (PLEG): container finished" podID="0c6103dd-a61f-4d5d-b6ef-a7f90c9b526d" containerID="e05c44ef088dbdae86f358b9fbfaf8e7791eb318287c87cf7b8361a9bb65d714" exitCode=0
Jul 28 20:03:10.419275 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:10.419187    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-b2dba1e2-58ccbc5d57-7rtcq" event={"ID":"0c6103dd-a61f-4d5d-b6ef-a7f90c9b526d","Type":"ContainerDied","Data":"e05c44ef088dbdae86f358b9fbfaf8e7791eb318287c87cf7b8361a9bb65d714"}
Jul 28 20:03:10.440756 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:10.440673    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2dba1e2-rqljr"]
Jul 28 20:03:10.442409 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:10.442380    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2dba1e2-rqljr"]
Jul 28 20:03:10.558439 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:10.558375    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-b2dba1e2-58ccbc5d57-7rtcq"
Jul 28 20:03:10.580587 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:10.571535    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"]
Jul 28 20:03:10.580587 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:10.571749    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd" podUID="4b3279d8-33ad-416b-b2ec-c560d5a95111" containerName="istio-proxy" containerID="cri-o://3ed0bd6427972e87c0bb6a404d01480f6a879301569c96439d8caa0774e61c58" gracePeriod=30
Jul 28 20:03:10.609332 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:10.609308    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b2dba1e2-5c67f8cc48-2csqs"
Jul 28 20:03:10.630678 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:10.630650    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1515f5e-c67f-4318-aa68-5d03b9825df7-plugins-config-volume\") pod \"a1515f5e-c67f-4318-aa68-5d03b9825df7\" (UID: \"a1515f5e-c67f-4318-aa68-5d03b9825df7\") "
Jul 28 20:03:10.630801 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:10.630683    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c6103dd-a61f-4d5d-b6ef-a7f90c9b526d-plugins-config-volume\") pod \"0c6103dd-a61f-4d5d-b6ef-a7f90c9b526d\" (UID: \"0c6103dd-a61f-4d5d-b6ef-a7f90c9b526d\") "
Jul 28 20:03:10.630801 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:10.630735    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kg59\" (UniqueName: \"kubernetes.io/projected/a1515f5e-c67f-4318-aa68-5d03b9825df7-kube-api-access-5kg59\") pod \"a1515f5e-c67f-4318-aa68-5d03b9825df7\" (UID: \"a1515f5e-c67f-4318-aa68-5d03b9825df7\") "
Jul 28 20:03:10.630801 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:10.630784    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvdv8\" (UniqueName: \"kubernetes.io/projected/0c6103dd-a61f-4d5d-b6ef-a7f90c9b526d-kube-api-access-lvdv8\") pod \"0c6103dd-a61f-4d5d-b6ef-a7f90c9b526d\" (UID: \"0c6103dd-a61f-4d5d-b6ef-a7f90c9b526d\") "
Jul 28 20:03:10.631114 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:10.631089    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1515f5e-c67f-4318-aa68-5d03b9825df7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a1515f5e-c67f-4318-aa68-5d03b9825df7" (UID: "a1515f5e-c67f-4318-aa68-5d03b9825df7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:03:10.631247 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:10.631138    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c6103dd-a61f-4d5d-b6ef-a7f90c9b526d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0c6103dd-a61f-4d5d-b6ef-a7f90c9b526d" (UID: "0c6103dd-a61f-4d5d-b6ef-a7f90c9b526d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:03:10.633376 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:10.633342    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1515f5e-c67f-4318-aa68-5d03b9825df7-kube-api-access-5kg59" (OuterVolumeSpecName: "kube-api-access-5kg59") pod "a1515f5e-c67f-4318-aa68-5d03b9825df7" (UID: "a1515f5e-c67f-4318-aa68-5d03b9825df7"). InnerVolumeSpecName "kube-api-access-5kg59". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:03:10.633709 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:10.633688    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c6103dd-a61f-4d5d-b6ef-a7f90c9b526d-kube-api-access-lvdv8" (OuterVolumeSpecName: "kube-api-access-lvdv8") pod "0c6103dd-a61f-4d5d-b6ef-a7f90c9b526d" (UID: "0c6103dd-a61f-4d5d-b6ef-a7f90c9b526d"). InnerVolumeSpecName "kube-api-access-lvdv8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:03:10.732457 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:10.732424    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kg59\" (UniqueName: \"kubernetes.io/projected/a1515f5e-c67f-4318-aa68-5d03b9825df7-kube-api-access-5kg59\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:03:10.732457 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:10.732451    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvdv8\" (UniqueName: \"kubernetes.io/projected/0c6103dd-a61f-4d5d-b6ef-a7f90c9b526d-kube-api-access-lvdv8\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:03:10.732457 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:10.732460    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1515f5e-c67f-4318-aa68-5d03b9825df7-plugins-config-volume\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:03:10.732682 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:10.732468    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c6103dd-a61f-4d5d-b6ef-a7f90c9b526d-plugins-config-volume\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:03:11.332248 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.332216    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"]
Jul 28 20:03:11.335366 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.333887    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4be679f8-832f-410b-ab5c-6de25da83928" containerName="revoke-keys"
Jul 28 20:03:11.335366 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.333913    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="4be679f8-832f-410b-ab5c-6de25da83928" containerName="revoke-keys"
Jul 28 20:03:11.335366 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.333944    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1515f5e-c67f-4318-aa68-5d03b9825df7" containerName="payload-pre-processing"
Jul 28 20:03:11.335366 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.333953    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1515f5e-c67f-4318-aa68-5d03b9825df7" containerName="payload-pre-processing"
Jul 28 20:03:11.335366 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.333963    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c6103dd-a61f-4d5d-b6ef-a7f90c9b526d" containerName="payload-processing"
Jul 28 20:03:11.335366 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.333995    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c6103dd-a61f-4d5d-b6ef-a7f90c9b526d" containerName="payload-processing"
Jul 28 20:03:11.335366 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.334088    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="4be679f8-832f-410b-ab5c-6de25da83928" containerName="revoke-keys"
Jul 28 20:03:11.335366 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.334100    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1515f5e-c67f-4318-aa68-5d03b9825df7" containerName="payload-pre-processing"
Jul 28 20:03:11.335366 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.334109    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c6103dd-a61f-4d5d-b6ef-a7f90c9b526d" containerName="payload-processing"
Jul 28 20:03:11.337253 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.337226    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:11.339840 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.339821    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-aaa64e88-openshift-default-dockercfg-lxw6f\""
Jul 28 20:03:11.348001 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.347957    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"]
Jul 28 20:03:11.427867 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.427837    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-b2dba1e2-58ccbc5d57-7rtcq"
Jul 28 20:03:11.427867 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.427857    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-b2dba1e2-58ccbc5d57-7rtcq" event={"ID":"0c6103dd-a61f-4d5d-b6ef-a7f90c9b526d","Type":"ContainerDied","Data":"67792a6abec4f87615f57e918cb224a81adec0cbbf3b9ceb0654c43eb8ee72a5"}
Jul 28 20:03:11.428159 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.427921    2570 scope.go:117] "RemoveContainer" containerID="e05c44ef088dbdae86f358b9fbfaf8e7791eb318287c87cf7b8361a9bb65d714"
Jul 28 20:03:11.429841 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.429816    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b2dba1e2-5c67f8cc48-2csqs" event={"ID":"a1515f5e-c67f-4318-aa68-5d03b9825df7","Type":"ContainerDied","Data":"072dd9f55c3ca1af274c03941185c8464b24fe5eaf0519e579ba2c2898419fa1"}
Jul 28 20:03:11.429952 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.429857    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b2dba1e2-5c67f8cc48-2csqs"
Jul 28 20:03:11.438685 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.438660    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6695582-04a3-4a2e-8c83-e5e0f78a9669-workload-socket\") pod \"e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w\" (UID: \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\") " pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:11.439196 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.438933    2570 scope.go:117] "RemoveContainer" containerID="9bdf37c84a0af59f623578cc4322d5e7c5952a8cf4797efaff4c96fc8d27dddd"
Jul 28 20:03:11.439196 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.440098    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6695582-04a3-4a2e-8c83-e5e0f78a9669-istiod-ca-cert\") pod \"e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w\" (UID: \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\") " pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:11.439196 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.440141    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6695582-04a3-4a2e-8c83-e5e0f78a9669-workload-certs\") pod \"e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w\" (UID: \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\") " pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:11.439196 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.440205    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6695582-04a3-4a2e-8c83-e5e0f78a9669-istio-envoy\") pod \"e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w\" (UID: \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\") " pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:11.439196 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.440236    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6695582-04a3-4a2e-8c83-e5e0f78a9669-credential-socket\") pod \"e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w\" (UID: \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\") " pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:11.439196 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.440268    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-246ns\" (UniqueName: \"kubernetes.io/projected/e6695582-04a3-4a2e-8c83-e5e0f78a9669-kube-api-access-246ns\") pod \"e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w\" (UID: \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\") " pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:11.439196 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.440307    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6695582-04a3-4a2e-8c83-e5e0f78a9669-istio-podinfo\") pod \"e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w\" (UID: \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\") " pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:11.439196 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.440363    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6695582-04a3-4a2e-8c83-e5e0f78a9669-istio-data\") pod \"e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w\" (UID: \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\") " pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:11.439196 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.440434    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6695582-04a3-4a2e-8c83-e5e0f78a9669-istio-token\") pod \"e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w\" (UID: \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\") " pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:11.458716 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.458695    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b2dba1e2-5c67f8cc48-2csqs"]
Jul 28 20:03:11.462901 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.462882    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b2dba1e2-5c67f8cc48-2csqs"]
Jul 28 20:03:11.473942 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.473923    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-b2dba1e2-58ccbc5d57-7rtcq"]
Jul 28 20:03:11.478252 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.478233    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-b2dba1e2-58ccbc5d57-7rtcq"]
Jul 28 20:03:11.541799 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.541777    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6695582-04a3-4a2e-8c83-e5e0f78a9669-istio-podinfo\") pod \"e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w\" (UID: \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\") " pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:11.541921 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.541808    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6695582-04a3-4a2e-8c83-e5e0f78a9669-istio-data\") pod \"e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w\" (UID: \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\") " pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:11.541921 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.541843    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6695582-04a3-4a2e-8c83-e5e0f78a9669-istio-token\") pod \"e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w\" (UID: \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\") " pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:11.542074 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.542029    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6695582-04a3-4a2e-8c83-e5e0f78a9669-workload-socket\") pod \"e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w\" (UID: \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\") " pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:11.542074 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.542063    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6695582-04a3-4a2e-8c83-e5e0f78a9669-istiod-ca-cert\") pod \"e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w\" (UID: \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\") " pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:11.542196 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.542083    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6695582-04a3-4a2e-8c83-e5e0f78a9669-workload-certs\") pod \"e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w\" (UID: \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\") " pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:11.542196 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.542141    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6695582-04a3-4a2e-8c83-e5e0f78a9669-istio-envoy\") pod \"e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w\" (UID: \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\") " pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:11.542196 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.542172    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6695582-04a3-4a2e-8c83-e5e0f78a9669-credential-socket\") pod \"e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w\" (UID: \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\") " pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:11.542196 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.542178    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6695582-04a3-4a2e-8c83-e5e0f78a9669-istio-data\") pod \"e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w\" (UID: \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\") " pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:11.542371 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.542200    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-246ns\" (UniqueName: \"kubernetes.io/projected/e6695582-04a3-4a2e-8c83-e5e0f78a9669-kube-api-access-246ns\") pod \"e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w\" (UID: \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\") " pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:11.542426 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.542373    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6695582-04a3-4a2e-8c83-e5e0f78a9669-workload-socket\") pod \"e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w\" (UID: \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\") " pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:11.542505 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.542481    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6695582-04a3-4a2e-8c83-e5e0f78a9669-credential-socket\") pod \"e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w\" (UID: \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\") " pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:11.542611 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.542593    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6695582-04a3-4a2e-8c83-e5e0f78a9669-workload-certs\") pod \"e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w\" (UID: \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\") " pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:11.542710 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.542692    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6695582-04a3-4a2e-8c83-e5e0f78a9669-istiod-ca-cert\") pod \"e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w\" (UID: \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\") " pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:11.544219 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.544202    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6695582-04a3-4a2e-8c83-e5e0f78a9669-istio-envoy\") pod \"e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w\" (UID: \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\") " pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:11.544375 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.544357    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6695582-04a3-4a2e-8c83-e5e0f78a9669-istio-podinfo\") pod \"e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w\" (UID: \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\") " pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:11.549403 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.549381    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6695582-04a3-4a2e-8c83-e5e0f78a9669-istio-token\") pod \"e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w\" (UID: \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\") " pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:11.549503 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.549459    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-246ns\" (UniqueName: \"kubernetes.io/projected/e6695582-04a3-4a2e-8c83-e5e0f78a9669-kube-api-access-246ns\") pod \"e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w\" (UID: \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\") " pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:11.572502 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.572453    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c6103dd-a61f-4d5d-b6ef-a7f90c9b526d" path="/var/lib/kubelet/pods/0c6103dd-a61f-4d5d-b6ef-a7f90c9b526d/volumes"
Jul 28 20:03:11.572791 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.572778    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4be679f8-832f-410b-ab5c-6de25da83928" path="/var/lib/kubelet/pods/4be679f8-832f-410b-ab5c-6de25da83928/volumes"
Jul 28 20:03:11.573134 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.573121    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1515f5e-c67f-4318-aa68-5d03b9825df7" path="/var/lib/kubelet/pods/a1515f5e-c67f-4318-aa68-5d03b9825df7/volumes"
Jul 28 20:03:11.648920 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.648886    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:11.780906 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.780881    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"]
Jul 28 20:03:11.783079 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:03:11.783049    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6695582_04a3_4a2e_8c83_e5e0f78a9669.slice/crio-fb10cf120139fc72a024f576b16935f6d3788a5d91fdd88ef31a3774093b0592 WatchSource:0}: Error finding container fb10cf120139fc72a024f576b16935f6d3788a5d91fdd88ef31a3774093b0592: Status 404 returned error can't find the container with id fb10cf120139fc72a024f576b16935f6d3788a5d91fdd88ef31a3774093b0592
Jul 28 20:03:11.785108 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.785081    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:03:11.785182 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.785146    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:03:11.785182 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:11.785175    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:03:12.437083 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:12.437045    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w" event={"ID":"e6695582-04a3-4a2e-8c83-e5e0f78a9669","Type":"ContainerStarted","Data":"e6a467598048e28c4b7481915b223922c10949c13d3b8a98646c53ea8d52f764"}
Jul 28 20:03:12.437432 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:12.437137    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w" event={"ID":"e6695582-04a3-4a2e-8c83-e5e0f78a9669","Type":"ContainerStarted","Data":"fb10cf120139fc72a024f576b16935f6d3788a5d91fdd88ef31a3774093b0592"}
Jul 28 20:03:12.457731 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:12.457682    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w" podStartSLOduration=1.457667716 podStartE2EDuration="1.457667716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:03:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:03:12.455944487 +0000 UTC m=+2005.407976841" watchObservedRunningTime="2026-07-28 20:03:12.457667716 +0000 UTC m=+2005.409700046"
Jul 28 20:03:12.649303 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:12.649265    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:12.653963 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:12.653935    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:13.442435 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:13.442406    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:13.443311 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:13.443289    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:13.803301 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:13.803207    2570 patch_prober.go:28] interesting pod/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 28 20:03:13.803301 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:13.803284    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd" podUID="4b3279d8-33ad-416b-b2ec-c560d5a95111" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 20:03:14.492284 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:14.492250    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-aaa64e88-b76fc7948-lzdmn"]
Jul 28 20:03:14.495489 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:14.495469    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-aaa64e88-b76fc7948-lzdmn"
Jul 28 20:03:14.497853 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:14.497834    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-aaa64e88-dockercfg-n8jqv\""
Jul 28 20:03:14.497954 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:14.497854    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-aaa64e88\""
Jul 28 20:03:14.502358 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:14.502339    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-aaa64e88-67c776b956-pbs98"]
Jul 28 20:03:14.505544 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:14.505514    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-aaa64e88-67c776b956-pbs98"
Jul 28 20:03:14.505886 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:14.505859    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-aaa64e88-b76fc7948-lzdmn"]
Jul 28 20:03:14.516028 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:14.515961    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-aaa64e88-67c776b956-pbs98"]
Jul 28 20:03:14.568836 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:14.568787    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d165ff5-e7d1-43b9-bc4a-30ccba833f99-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-aaa64e88-b76fc7948-lzdmn\" (UID: \"9d165ff5-e7d1-43b9-bc4a-30ccba833f99\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-aaa64e88-b76fc7948-lzdmn"
Jul 28 20:03:14.569037 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:14.568857    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/634cc8e5-46bb-4b74-9714-4c6df375bc39-plugins-config-volume\") pod \"payload-processing-e2e-ait-aaa64e88-67c776b956-pbs98\" (UID: \"634cc8e5-46bb-4b74-9714-4c6df375bc39\") " pod="openshift-ingress/payload-processing-e2e-ait-aaa64e88-67c776b956-pbs98"
Jul 28 20:03:14.569108 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:14.569034    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ggqq\" (UniqueName: \"kubernetes.io/projected/9d165ff5-e7d1-43b9-bc4a-30ccba833f99-kube-api-access-2ggqq\") pod \"payload-pre-processing-e2e-ait-aaa64e88-b76fc7948-lzdmn\" (UID: \"9d165ff5-e7d1-43b9-bc4a-30ccba833f99\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-aaa64e88-b76fc7948-lzdmn"
Jul 28 20:03:14.569178 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:14.569107    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srgbh\" (UniqueName: \"kubernetes.io/projected/634cc8e5-46bb-4b74-9714-4c6df375bc39-kube-api-access-srgbh\") pod \"payload-processing-e2e-ait-aaa64e88-67c776b956-pbs98\" (UID: \"634cc8e5-46bb-4b74-9714-4c6df375bc39\") " pod="openshift-ingress/payload-processing-e2e-ait-aaa64e88-67c776b956-pbs98"
Jul 28 20:03:14.670485 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:14.670442    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ggqq\" (UniqueName: \"kubernetes.io/projected/9d165ff5-e7d1-43b9-bc4a-30ccba833f99-kube-api-access-2ggqq\") pod \"payload-pre-processing-e2e-ait-aaa64e88-b76fc7948-lzdmn\" (UID: \"9d165ff5-e7d1-43b9-bc4a-30ccba833f99\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-aaa64e88-b76fc7948-lzdmn"
Jul 28 20:03:14.670665 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:14.670509    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srgbh\" (UniqueName: \"kubernetes.io/projected/634cc8e5-46bb-4b74-9714-4c6df375bc39-kube-api-access-srgbh\") pod \"payload-processing-e2e-ait-aaa64e88-67c776b956-pbs98\" (UID: \"634cc8e5-46bb-4b74-9714-4c6df375bc39\") " pod="openshift-ingress/payload-processing-e2e-ait-aaa64e88-67c776b956-pbs98"
Jul 28 20:03:14.670665 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:14.670553    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d165ff5-e7d1-43b9-bc4a-30ccba833f99-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-aaa64e88-b76fc7948-lzdmn\" (UID: \"9d165ff5-e7d1-43b9-bc4a-30ccba833f99\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-aaa64e88-b76fc7948-lzdmn"
Jul 28 20:03:14.670665 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:14.670588    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/634cc8e5-46bb-4b74-9714-4c6df375bc39-plugins-config-volume\") pod \"payload-processing-e2e-ait-aaa64e88-67c776b956-pbs98\" (UID: \"634cc8e5-46bb-4b74-9714-4c6df375bc39\") " pod="openshift-ingress/payload-processing-e2e-ait-aaa64e88-67c776b956-pbs98"
Jul 28 20:03:14.671517 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:14.671495    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d165ff5-e7d1-43b9-bc4a-30ccba833f99-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-aaa64e88-b76fc7948-lzdmn\" (UID: \"9d165ff5-e7d1-43b9-bc4a-30ccba833f99\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-aaa64e88-b76fc7948-lzdmn"
Jul 28 20:03:14.671580 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:14.671494    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/634cc8e5-46bb-4b74-9714-4c6df375bc39-plugins-config-volume\") pod \"payload-processing-e2e-ait-aaa64e88-67c776b956-pbs98\" (UID: \"634cc8e5-46bb-4b74-9714-4c6df375bc39\") " pod="openshift-ingress/payload-processing-e2e-ait-aaa64e88-67c776b956-pbs98"
Jul 28 20:03:14.678613 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:14.678586    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srgbh\" (UniqueName: \"kubernetes.io/projected/634cc8e5-46bb-4b74-9714-4c6df375bc39-kube-api-access-srgbh\") pod \"payload-processing-e2e-ait-aaa64e88-67c776b956-pbs98\" (UID: \"634cc8e5-46bb-4b74-9714-4c6df375bc39\") " pod="openshift-ingress/payload-processing-e2e-ait-aaa64e88-67c776b956-pbs98"
Jul 28 20:03:14.678827 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:14.678804    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ggqq\" (UniqueName: \"kubernetes.io/projected/9d165ff5-e7d1-43b9-bc4a-30ccba833f99-kube-api-access-2ggqq\") pod \"payload-pre-processing-e2e-ait-aaa64e88-b76fc7948-lzdmn\" (UID: \"9d165ff5-e7d1-43b9-bc4a-30ccba833f99\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-aaa64e88-b76fc7948-lzdmn"
Jul 28 20:03:14.807715 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:14.807641    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-aaa64e88-b76fc7948-lzdmn"
Jul 28 20:03:14.817415 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:14.817392    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-aaa64e88-67c776b956-pbs98"
Jul 28 20:03:14.976127 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:14.976027    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-aaa64e88-b76fc7948-lzdmn"]
Jul 28 20:03:14.979476 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:03:14.979445    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d165ff5_e7d1_43b9_bc4a_30ccba833f99.slice/crio-b8f8a6194e0d530351bfd240aaad7ebc9dcd0885e0c5cba0be82d1fbf919a9c6 WatchSource:0}: Error finding container b8f8a6194e0d530351bfd240aaad7ebc9dcd0885e0c5cba0be82d1fbf919a9c6: Status 404 returned error can't find the container with id b8f8a6194e0d530351bfd240aaad7ebc9dcd0885e0c5cba0be82d1fbf919a9c6
Jul 28 20:03:14.996892 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:14.996869    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-aaa64e88-67c776b956-pbs98"]
Jul 28 20:03:15.000986 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:03:15.000949    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod634cc8e5_46bb_4b74_9714_4c6df375bc39.slice/crio-314c0270fd00d113a9e0cb5e682dd14fda1f0200dfa98b388a11d846f97b59c1 WatchSource:0}: Error finding container 314c0270fd00d113a9e0cb5e682dd14fda1f0200dfa98b388a11d846f97b59c1: Status 404 returned error can't find the container with id 314c0270fd00d113a9e0cb5e682dd14fda1f0200dfa98b388a11d846f97b59c1
Jul 28 20:03:15.452934 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:15.452888    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-aaa64e88-67c776b956-pbs98" event={"ID":"634cc8e5-46bb-4b74-9714-4c6df375bc39","Type":"ContainerStarted","Data":"80b460a1e1da7a33030afa57d9cf0e24d1e00b2aa19fa8a3b5df166e9209a5ba"}
Jul 28 20:03:15.453130 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:15.452951    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-aaa64e88-67c776b956-pbs98" event={"ID":"634cc8e5-46bb-4b74-9714-4c6df375bc39","Type":"ContainerStarted","Data":"314c0270fd00d113a9e0cb5e682dd14fda1f0200dfa98b388a11d846f97b59c1"}
Jul 28 20:03:15.453130 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:15.453074    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-aaa64e88-67c776b956-pbs98"
Jul 28 20:03:15.454360 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:15.454341    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-aaa64e88-b76fc7948-lzdmn" event={"ID":"9d165ff5-e7d1-43b9-bc4a-30ccba833f99","Type":"ContainerStarted","Data":"bb67778b2f3cd04cf69596dec0c5f6fb8f49c60dd3c7f561b3ae369d5a84ecb6"}
Jul 28 20:03:15.454459 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:15.454378    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-aaa64e88-b76fc7948-lzdmn" event={"ID":"9d165ff5-e7d1-43b9-bc4a-30ccba833f99","Type":"ContainerStarted","Data":"b8f8a6194e0d530351bfd240aaad7ebc9dcd0885e0c5cba0be82d1fbf919a9c6"}
Jul 28 20:03:15.454459 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:15.454404    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-aaa64e88-b76fc7948-lzdmn"
Jul 28 20:03:15.467600 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:15.467552    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-aaa64e88-67c776b956-pbs98" podStartSLOduration=1.467536609 podStartE2EDuration="1.467536609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:03:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:03:15.467112246 +0000 UTC m=+2008.419144594" watchObservedRunningTime="2026-07-28 20:03:15.467536609 +0000 UTC m=+2008.419568942"
Jul 28 20:03:15.483848 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:15.483808    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-aaa64e88-b76fc7948-lzdmn" podStartSLOduration=1.483794372 podStartE2EDuration="1.483794372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:03:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:03:15.482745096 +0000 UTC m=+2008.434777431" watchObservedRunningTime="2026-07-28 20:03:15.483794372 +0000 UTC m=+2008.435826701"
Jul 28 20:03:15.827831 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:15.827808    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:03:15.881913 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:15.881880    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b3279d8-33ad-416b-b2ec-c560d5a95111-istio-data\") pod \"4b3279d8-33ad-416b-b2ec-c560d5a95111\" (UID: \"4b3279d8-33ad-416b-b2ec-c560d5a95111\") "
Jul 28 20:03:15.881913 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:15.881917    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b3279d8-33ad-416b-b2ec-c560d5a95111-istiod-ca-cert\") pod \"4b3279d8-33ad-416b-b2ec-c560d5a95111\" (UID: \"4b3279d8-33ad-416b-b2ec-c560d5a95111\") "
Jul 28 20:03:15.882116 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:15.881937    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b3279d8-33ad-416b-b2ec-c560d5a95111-workload-certs\") pod \"4b3279d8-33ad-416b-b2ec-c560d5a95111\" (UID: \"4b3279d8-33ad-416b-b2ec-c560d5a95111\") "
Jul 28 20:03:15.882116 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:15.881965    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b3279d8-33ad-416b-b2ec-c560d5a95111-istio-token\") pod \"4b3279d8-33ad-416b-b2ec-c560d5a95111\" (UID: \"4b3279d8-33ad-416b-b2ec-c560d5a95111\") "
Jul 28 20:03:15.882116 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:15.882023    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b3279d8-33ad-416b-b2ec-c560d5a95111-istio-podinfo\") pod \"4b3279d8-33ad-416b-b2ec-c560d5a95111\" (UID: \"4b3279d8-33ad-416b-b2ec-c560d5a95111\") "
Jul 28 20:03:15.882116 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:15.882081    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b3279d8-33ad-416b-b2ec-c560d5a95111-workload-socket\") pod \"4b3279d8-33ad-416b-b2ec-c560d5a95111\" (UID: \"4b3279d8-33ad-416b-b2ec-c560d5a95111\") "
Jul 28 20:03:15.882116 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:15.882097    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b3279d8-33ad-416b-b2ec-c560d5a95111-istio-envoy\") pod \"4b3279d8-33ad-416b-b2ec-c560d5a95111\" (UID: \"4b3279d8-33ad-416b-b2ec-c560d5a95111\") "
Jul 28 20:03:15.882116 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:15.882115    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8nrjn\" (UniqueName: \"kubernetes.io/projected/4b3279d8-33ad-416b-b2ec-c560d5a95111-kube-api-access-8nrjn\") pod \"4b3279d8-33ad-416b-b2ec-c560d5a95111\" (UID: \"4b3279d8-33ad-416b-b2ec-c560d5a95111\") "
Jul 28 20:03:15.882380 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:15.882137    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b3279d8-33ad-416b-b2ec-c560d5a95111-credential-socket\") pod \"4b3279d8-33ad-416b-b2ec-c560d5a95111\" (UID: \"4b3279d8-33ad-416b-b2ec-c560d5a95111\") "
Jul 28 20:03:15.882380 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:15.882211    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b3279d8-33ad-416b-b2ec-c560d5a95111-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4b3279d8-33ad-416b-b2ec-c560d5a95111" (UID: "4b3279d8-33ad-416b-b2ec-c560d5a95111"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:03:15.882380 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:15.882341    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b3279d8-33ad-416b-b2ec-c560d5a95111-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4b3279d8-33ad-416b-b2ec-c560d5a95111" (UID: "4b3279d8-33ad-416b-b2ec-c560d5a95111"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:03:15.882534 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:15.882507    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b3279d8-33ad-416b-b2ec-c560d5a95111-istiod-ca-cert\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:03:15.882534 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:15.882527    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b3279d8-33ad-416b-b2ec-c560d5a95111-workload-certs\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:03:15.882650 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:15.882593    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b3279d8-33ad-416b-b2ec-c560d5a95111-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4b3279d8-33ad-416b-b2ec-c560d5a95111" (UID: "4b3279d8-33ad-416b-b2ec-c560d5a95111"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:03:15.882650 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:15.882615    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b3279d8-33ad-416b-b2ec-c560d5a95111-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4b3279d8-33ad-416b-b2ec-c560d5a95111" (UID: "4b3279d8-33ad-416b-b2ec-c560d5a95111"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:03:15.882879 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:15.882853    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b3279d8-33ad-416b-b2ec-c560d5a95111-istio-data" (OuterVolumeSpecName: "istio-data") pod "4b3279d8-33ad-416b-b2ec-c560d5a95111" (UID: "4b3279d8-33ad-416b-b2ec-c560d5a95111"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:03:15.884298 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:15.884263    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b3279d8-33ad-416b-b2ec-c560d5a95111-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4b3279d8-33ad-416b-b2ec-c560d5a95111" (UID: "4b3279d8-33ad-416b-b2ec-c560d5a95111"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:03:15.884413 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:15.884347    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b3279d8-33ad-416b-b2ec-c560d5a95111-istio-token" (OuterVolumeSpecName: "istio-token") pod "4b3279d8-33ad-416b-b2ec-c560d5a95111" (UID: "4b3279d8-33ad-416b-b2ec-c560d5a95111"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:03:15.884413 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:15.884376    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4b3279d8-33ad-416b-b2ec-c560d5a95111-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4b3279d8-33ad-416b-b2ec-c560d5a95111" (UID: "4b3279d8-33ad-416b-b2ec-c560d5a95111"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:03:15.884413 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:15.884379    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b3279d8-33ad-416b-b2ec-c560d5a95111-kube-api-access-8nrjn" (OuterVolumeSpecName: "kube-api-access-8nrjn") pod "4b3279d8-33ad-416b-b2ec-c560d5a95111" (UID: "4b3279d8-33ad-416b-b2ec-c560d5a95111"). InnerVolumeSpecName "kube-api-access-8nrjn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:03:15.983929 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:15.983901    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b3279d8-33ad-416b-b2ec-c560d5a95111-istio-token\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:03:15.983929 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:15.983925    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b3279d8-33ad-416b-b2ec-c560d5a95111-istio-podinfo\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:03:15.984091 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:15.983935    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b3279d8-33ad-416b-b2ec-c560d5a95111-workload-socket\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:03:15.984091 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:15.983944    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b3279d8-33ad-416b-b2ec-c560d5a95111-istio-envoy\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:03:15.984091 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:15.983953    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8nrjn\" (UniqueName: \"kubernetes.io/projected/4b3279d8-33ad-416b-b2ec-c560d5a95111-kube-api-access-8nrjn\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:03:15.984091 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:15.983963    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b3279d8-33ad-416b-b2ec-c560d5a95111-credential-socket\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:03:15.984091 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:15.983993    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b3279d8-33ad-416b-b2ec-c560d5a95111-istio-data\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:03:16.460619 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:16.460588    2570 generic.go:356] "Generic (PLEG): container finished" podID="4b3279d8-33ad-416b-b2ec-c560d5a95111" containerID="3ed0bd6427972e87c0bb6a404d01480f6a879301569c96439d8caa0774e61c58" exitCode=0
Jul 28 20:03:16.460799 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:16.460637    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"
Jul 28 20:03:16.460799 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:16.460679    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd" event={"ID":"4b3279d8-33ad-416b-b2ec-c560d5a95111","Type":"ContainerDied","Data":"3ed0bd6427972e87c0bb6a404d01480f6a879301569c96439d8caa0774e61c58"}
Jul 28 20:03:16.460799 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:16.460764    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd" event={"ID":"4b3279d8-33ad-416b-b2ec-c560d5a95111","Type":"ContainerDied","Data":"b76bd715356b55913a2f4cd45bbd952971221ff7f26d932c445933e09aa152a1"}
Jul 28 20:03:16.460799 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:16.460794    2570 scope.go:117] "RemoveContainer" containerID="3ed0bd6427972e87c0bb6a404d01480f6a879301569c96439d8caa0774e61c58"
Jul 28 20:03:16.469800 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:16.469784    2570 scope.go:117] "RemoveContainer" containerID="1749ca27f5a82f8e1f393a820b7c6b3f8f137704a68f4860834a690309157f80"
Jul 28 20:03:16.477562 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:16.477542    2570 scope.go:117] "RemoveContainer" containerID="3ed0bd6427972e87c0bb6a404d01480f6a879301569c96439d8caa0774e61c58"
Jul 28 20:03:16.477799 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:03:16.477780    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ed0bd6427972e87c0bb6a404d01480f6a879301569c96439d8caa0774e61c58\": container with ID starting with 3ed0bd6427972e87c0bb6a404d01480f6a879301569c96439d8caa0774e61c58 not found: ID does not exist" containerID="3ed0bd6427972e87c0bb6a404d01480f6a879301569c96439d8caa0774e61c58"
Jul 28 20:03:16.477844 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:16.477806    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ed0bd6427972e87c0bb6a404d01480f6a879301569c96439d8caa0774e61c58"} err="failed to get container status \"3ed0bd6427972e87c0bb6a404d01480f6a879301569c96439d8caa0774e61c58\": rpc error: code = NotFound desc = could not find container \"3ed0bd6427972e87c0bb6a404d01480f6a879301569c96439d8caa0774e61c58\": container with ID starting with 3ed0bd6427972e87c0bb6a404d01480f6a879301569c96439d8caa0774e61c58 not found: ID does not exist"
Jul 28 20:03:16.477844 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:16.477822    2570 scope.go:117] "RemoveContainer" containerID="1749ca27f5a82f8e1f393a820b7c6b3f8f137704a68f4860834a690309157f80"
Jul 28 20:03:16.478066 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:03:16.478047    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1749ca27f5a82f8e1f393a820b7c6b3f8f137704a68f4860834a690309157f80\": container with ID starting with 1749ca27f5a82f8e1f393a820b7c6b3f8f137704a68f4860834a690309157f80 not found: ID does not exist" containerID="1749ca27f5a82f8e1f393a820b7c6b3f8f137704a68f4860834a690309157f80"
Jul 28 20:03:16.478130 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:16.478077    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1749ca27f5a82f8e1f393a820b7c6b3f8f137704a68f4860834a690309157f80"} err="failed to get container status \"1749ca27f5a82f8e1f393a820b7c6b3f8f137704a68f4860834a690309157f80\": rpc error: code = NotFound desc = could not find container \"1749ca27f5a82f8e1f393a820b7c6b3f8f137704a68f4860834a690309157f80\": container with ID starting with 1749ca27f5a82f8e1f393a820b7c6b3f8f137704a68f4860834a690309157f80 not found: ID does not exist"
Jul 28 20:03:16.483444 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:16.483422    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"]
Jul 28 20:03:16.488041 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:16.488019    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-b2dba1e2-gw-openshift-default-5f54f9ff84-bhnbd"]
Jul 28 20:03:17.572610 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:17.572578    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b3279d8-33ad-416b-b2ec-c560d5a95111" path="/var/lib/kubelet/pods/4b3279d8-33ad-416b-b2ec-c560d5a95111/volumes"
Jul 28 20:03:26.463164 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:26.463131    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-aaa64e88-b76fc7948-lzdmn"
Jul 28 20:03:26.463684 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:26.463320    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-aaa64e88-67c776b956-pbs98"
Jul 28 20:03:28.444298 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:28.444260    2570 patch_prober.go:28] interesting pod/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Jul 28 20:03:28.444768 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:28.444334    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w" podUID="e6695582-04a3-4a2e-8c83-e5e0f78a9669" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 28 20:03:28.524728 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:28.524689    2570 generic.go:356] "Generic (PLEG): container finished" podID="e6695582-04a3-4a2e-8c83-e5e0f78a9669" containerID="e6a467598048e28c4b7481915b223922c10949c13d3b8a98646c53ea8d52f764" exitCode=0
Jul 28 20:03:28.524894 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:28.524759    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w" event={"ID":"e6695582-04a3-4a2e-8c83-e5e0f78a9669","Type":"ContainerDied","Data":"e6a467598048e28c4b7481915b223922c10949c13d3b8a98646c53ea8d52f764"}
Jul 28 20:03:28.525203 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:28.525189    2570 scope.go:117] "RemoveContainer" containerID="e6a467598048e28c4b7481915b223922c10949c13d3b8a98646c53ea8d52f764"
Jul 28 20:03:28.526302 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:28.526275    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:03:28.526374 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:28.526345    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:03:28.526439 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:28.526378    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:03:29.532450 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:29.532415    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w" event={"ID":"e6695582-04a3-4a2e-8c83-e5e0f78a9669","Type":"ContainerStarted","Data":"d5507de0087cf12072ff14c6957e6207137283bfcf10ef338bf0e168650f09cb"}
Jul 28 20:03:29.649310 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:29.649280    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:29.649502 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:29.649480    2570 patch_prober.go:28] interesting pod/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Jul 28 20:03:29.649547 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:29.649531    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w" podUID="e6695582-04a3-4a2e-8c83-e5e0f78a9669" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 28 20:03:30.649356 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:30.649320    2570 patch_prober.go:28] interesting pod/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Jul 28 20:03:30.649754 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:30.649369    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w" podUID="e6695582-04a3-4a2e-8c83-e5e0f78a9669" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 28 20:03:31.650149 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:31.650112    2570 patch_prober.go:28] interesting pod/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Jul 28 20:03:31.650546 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:31.650165    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w" podUID="e6695582-04a3-4a2e-8c83-e5e0f78a9669" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 28 20:03:32.649322 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:32.649285    2570 patch_prober.go:28] interesting pod/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Jul 28 20:03:32.649488 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:32.649346    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w" podUID="e6695582-04a3-4a2e-8c83-e5e0f78a9669" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 28 20:03:33.653323 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:33.653294    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:33.653766 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:33.653562    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:33.654232 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:33.654215    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:39.576661 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:39.576633    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aaa64e88-klkvp"]
Jul 28 20:03:39.577087 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:39.576930    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b3279d8-33ad-416b-b2ec-c560d5a95111" containerName="istio-proxy"
Jul 28 20:03:39.577087 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:39.576940    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b3279d8-33ad-416b-b2ec-c560d5a95111" containerName="istio-proxy"
Jul 28 20:03:39.577087 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:39.576956    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b3279d8-33ad-416b-b2ec-c560d5a95111" containerName="istio-proxy"
Jul 28 20:03:39.577087 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:39.576962    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b3279d8-33ad-416b-b2ec-c560d5a95111" containerName="istio-proxy"
Jul 28 20:03:39.577087 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:39.577046    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b3279d8-33ad-416b-b2ec-c560d5a95111" containerName="istio-proxy"
Jul 28 20:03:39.577087 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:39.577056    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b3279d8-33ad-416b-b2ec-c560d5a95111" containerName="istio-proxy"
Jul 28 20:03:39.579398 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:39.579376    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aaa64e88-klkvp"
Jul 28 20:03:39.586827 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:39.586799    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z6zs4\""
Jul 28 20:03:39.590412 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:39.590384    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aaa64e88-klkvp"]
Jul 28 20:03:39.700166 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:39.700123    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d68cd3cb-bd66-48fa-97d8-cea5cdf56602-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-aaa64e88-klkvp\" (UID: \"d68cd3cb-bd66-48fa-97d8-cea5cdf56602\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aaa64e88-klkvp"
Jul 28 20:03:39.801414 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:39.801380    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d68cd3cb-bd66-48fa-97d8-cea5cdf56602-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-aaa64e88-klkvp\" (UID: \"d68cd3cb-bd66-48fa-97d8-cea5cdf56602\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aaa64e88-klkvp"
Jul 28 20:03:39.802046 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:39.802021    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d68cd3cb-bd66-48fa-97d8-cea5cdf56602-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-aaa64e88-klkvp\" (UID: \"d68cd3cb-bd66-48fa-97d8-cea5cdf56602\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aaa64e88-klkvp"
Jul 28 20:03:39.898739 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:39.898655    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aaa64e88-klkvp"
Jul 28 20:03:40.027730 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:40.027700    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aaa64e88-klkvp"]
Jul 28 20:03:40.030040 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:03:40.030013    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd68cd3cb_bd66_48fa_97d8_cea5cdf56602.slice/crio-5bbc0caa349ba897e0edce965c804e0771fa4abe6e883c9a2ad023e28d05ab26 WatchSource:0}: Error finding container 5bbc0caa349ba897e0edce965c804e0771fa4abe6e883c9a2ad023e28d05ab26: Status 404 returned error can't find the container with id 5bbc0caa349ba897e0edce965c804e0771fa4abe6e883c9a2ad023e28d05ab26
Jul 28 20:03:40.587259 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:40.587163    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aaa64e88-klkvp" event={"ID":"d68cd3cb-bd66-48fa-97d8-cea5cdf56602","Type":"ContainerStarted","Data":"a00afc37f431513b643995097403afacf05c02470983cbecefd481cbc521d883"}
Jul 28 20:03:40.587259 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:40.587229    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aaa64e88-klkvp" event={"ID":"d68cd3cb-bd66-48fa-97d8-cea5cdf56602","Type":"ContainerStarted","Data":"5bbc0caa349ba897e0edce965c804e0771fa4abe6e883c9a2ad023e28d05ab26"}
Jul 28 20:03:40.604124 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:40.604074    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aaa64e88-klkvp" podStartSLOduration=1.604057632 podStartE2EDuration="1.604057632s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:03:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:03:40.601879304 +0000 UTC m=+2033.553911635" watchObservedRunningTime="2026-07-28 20:03:40.604057632 +0000 UTC m=+2033.556089962"
Jul 28 20:03:41.592540 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:41.592503    2570 generic.go:356] "Generic (PLEG): container finished" podID="d68cd3cb-bd66-48fa-97d8-cea5cdf56602" containerID="a00afc37f431513b643995097403afacf05c02470983cbecefd481cbc521d883" exitCode=0
Jul 28 20:03:41.592930 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:41.592594    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aaa64e88-klkvp" event={"ID":"d68cd3cb-bd66-48fa-97d8-cea5cdf56602","Type":"ContainerDied","Data":"a00afc37f431513b643995097403afacf05c02470983cbecefd481cbc521d883"}
Jul 28 20:03:42.727661 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:42.727638    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aaa64e88-klkvp"
Jul 28 20:03:42.828456 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:42.828424    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d68cd3cb-bd66-48fa-97d8-cea5cdf56602-maas-api-service-ca\") pod \"d68cd3cb-bd66-48fa-97d8-cea5cdf56602\" (UID: \"d68cd3cb-bd66-48fa-97d8-cea5cdf56602\") "
Jul 28 20:03:42.828788 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:42.828761    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d68cd3cb-bd66-48fa-97d8-cea5cdf56602-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d68cd3cb-bd66-48fa-97d8-cea5cdf56602" (UID: "d68cd3cb-bd66-48fa-97d8-cea5cdf56602"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:03:42.930040 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:42.930011    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d68cd3cb-bd66-48fa-97d8-cea5cdf56602-maas-api-service-ca\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:03:43.603369 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:43.603330    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aaa64e88-klkvp" event={"ID":"d68cd3cb-bd66-48fa-97d8-cea5cdf56602","Type":"ContainerDied","Data":"5bbc0caa349ba897e0edce965c804e0771fa4abe6e883c9a2ad023e28d05ab26"}
Jul 28 20:03:43.603369 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:43.603366    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aaa64e88-klkvp"
Jul 28 20:03:43.603553 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:43.603385    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5bbc0caa349ba897e0edce965c804e0771fa4abe6e883c9a2ad023e28d05ab26"
Jul 28 20:03:44.656119 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:44.656083    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-aaa64e88-67c776b956-pbs98"]
Jul 28 20:03:44.656810 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:44.656775    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-aaa64e88-67c776b956-pbs98" podUID="634cc8e5-46bb-4b74-9714-4c6df375bc39" containerName="payload-processing" containerID="cri-o://80b460a1e1da7a33030afa57d9cf0e24d1e00b2aa19fa8a3b5df166e9209a5ba" gracePeriod=30
Jul 28 20:03:44.670383 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:44.669795    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-aaa64e88-b76fc7948-lzdmn"]
Jul 28 20:03:44.670383 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:44.670187    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-aaa64e88-b76fc7948-lzdmn" podUID="9d165ff5-e7d1-43b9-bc4a-30ccba833f99" containerName="payload-pre-processing" containerID="cri-o://bb67778b2f3cd04cf69596dec0c5f6fb8f49c60dd3c7f561b3ae369d5a84ecb6" gracePeriod=30
Jul 28 20:03:44.817696 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:44.817646    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aaa64e88-klkvp"]
Jul 28 20:03:44.822640 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:44.822597    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aaa64e88-klkvp"]
Jul 28 20:03:44.923258 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:44.923235    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-aaa64e88-67c776b956-pbs98"
Jul 28 20:03:44.963351 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:44.963327    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-aaa64e88-b76fc7948-lzdmn"
Jul 28 20:03:45.049370 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:45.049339    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/634cc8e5-46bb-4b74-9714-4c6df375bc39-plugins-config-volume\") pod \"634cc8e5-46bb-4b74-9714-4c6df375bc39\" (UID: \"634cc8e5-46bb-4b74-9714-4c6df375bc39\") "
Jul 28 20:03:45.049549 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:45.049411    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srgbh\" (UniqueName: \"kubernetes.io/projected/634cc8e5-46bb-4b74-9714-4c6df375bc39-kube-api-access-srgbh\") pod \"634cc8e5-46bb-4b74-9714-4c6df375bc39\" (UID: \"634cc8e5-46bb-4b74-9714-4c6df375bc39\") "
Jul 28 20:03:45.049738 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:45.049716    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/634cc8e5-46bb-4b74-9714-4c6df375bc39-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "634cc8e5-46bb-4b74-9714-4c6df375bc39" (UID: "634cc8e5-46bb-4b74-9714-4c6df375bc39"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:03:45.051517 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:45.051494    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/634cc8e5-46bb-4b74-9714-4c6df375bc39-kube-api-access-srgbh" (OuterVolumeSpecName: "kube-api-access-srgbh") pod "634cc8e5-46bb-4b74-9714-4c6df375bc39" (UID: "634cc8e5-46bb-4b74-9714-4c6df375bc39"). InnerVolumeSpecName "kube-api-access-srgbh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:03:45.150740 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:45.150702    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ggqq\" (UniqueName: \"kubernetes.io/projected/9d165ff5-e7d1-43b9-bc4a-30ccba833f99-kube-api-access-2ggqq\") pod \"9d165ff5-e7d1-43b9-bc4a-30ccba833f99\" (UID: \"9d165ff5-e7d1-43b9-bc4a-30ccba833f99\") "
Jul 28 20:03:45.150919 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:45.150761    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d165ff5-e7d1-43b9-bc4a-30ccba833f99-plugins-config-volume\") pod \"9d165ff5-e7d1-43b9-bc4a-30ccba833f99\" (UID: \"9d165ff5-e7d1-43b9-bc4a-30ccba833f99\") "
Jul 28 20:03:45.151046 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:45.151028    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/634cc8e5-46bb-4b74-9714-4c6df375bc39-plugins-config-volume\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:03:45.151115 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:45.151052    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srgbh\" (UniqueName: \"kubernetes.io/projected/634cc8e5-46bb-4b74-9714-4c6df375bc39-kube-api-access-srgbh\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:03:45.151185 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:45.151161    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d165ff5-e7d1-43b9-bc4a-30ccba833f99-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9d165ff5-e7d1-43b9-bc4a-30ccba833f99" (UID: "9d165ff5-e7d1-43b9-bc4a-30ccba833f99"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:03:45.152749 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:45.152729    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d165ff5-e7d1-43b9-bc4a-30ccba833f99-kube-api-access-2ggqq" (OuterVolumeSpecName: "kube-api-access-2ggqq") pod "9d165ff5-e7d1-43b9-bc4a-30ccba833f99" (UID: "9d165ff5-e7d1-43b9-bc4a-30ccba833f99"). InnerVolumeSpecName "kube-api-access-2ggqq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:03:45.251814 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:45.251781    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ggqq\" (UniqueName: \"kubernetes.io/projected/9d165ff5-e7d1-43b9-bc4a-30ccba833f99-kube-api-access-2ggqq\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:03:45.251814 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:45.251813    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d165ff5-e7d1-43b9-bc4a-30ccba833f99-plugins-config-volume\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:03:45.572678 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:45.572596    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d68cd3cb-bd66-48fa-97d8-cea5cdf56602" path="/var/lib/kubelet/pods/d68cd3cb-bd66-48fa-97d8-cea5cdf56602/volumes"
Jul 28 20:03:45.614042 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:45.614012    2570 generic.go:356] "Generic (PLEG): container finished" podID="9d165ff5-e7d1-43b9-bc4a-30ccba833f99" containerID="bb67778b2f3cd04cf69596dec0c5f6fb8f49c60dd3c7f561b3ae369d5a84ecb6" exitCode=0
Jul 28 20:03:45.614221 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:45.614065    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-aaa64e88-b76fc7948-lzdmn"
Jul 28 20:03:45.614221 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:45.614096    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-aaa64e88-b76fc7948-lzdmn" event={"ID":"9d165ff5-e7d1-43b9-bc4a-30ccba833f99","Type":"ContainerDied","Data":"bb67778b2f3cd04cf69596dec0c5f6fb8f49c60dd3c7f561b3ae369d5a84ecb6"}
Jul 28 20:03:45.614221 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:45.614144    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-aaa64e88-b76fc7948-lzdmn" event={"ID":"9d165ff5-e7d1-43b9-bc4a-30ccba833f99","Type":"ContainerDied","Data":"b8f8a6194e0d530351bfd240aaad7ebc9dcd0885e0c5cba0be82d1fbf919a9c6"}
Jul 28 20:03:45.614221 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:45.614170    2570 scope.go:117] "RemoveContainer" containerID="bb67778b2f3cd04cf69596dec0c5f6fb8f49c60dd3c7f561b3ae369d5a84ecb6"
Jul 28 20:03:45.615516 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:45.615493    2570 generic.go:356] "Generic (PLEG): container finished" podID="634cc8e5-46bb-4b74-9714-4c6df375bc39" containerID="80b460a1e1da7a33030afa57d9cf0e24d1e00b2aa19fa8a3b5df166e9209a5ba" exitCode=0
Jul 28 20:03:45.615666 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:45.615529    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-aaa64e88-67c776b956-pbs98"
Jul 28 20:03:45.615666 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:45.615543    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-aaa64e88-67c776b956-pbs98" event={"ID":"634cc8e5-46bb-4b74-9714-4c6df375bc39","Type":"ContainerDied","Data":"80b460a1e1da7a33030afa57d9cf0e24d1e00b2aa19fa8a3b5df166e9209a5ba"}
Jul 28 20:03:45.615666 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:45.615580    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-aaa64e88-67c776b956-pbs98" event={"ID":"634cc8e5-46bb-4b74-9714-4c6df375bc39","Type":"ContainerDied","Data":"314c0270fd00d113a9e0cb5e682dd14fda1f0200dfa98b388a11d846f97b59c1"}
Jul 28 20:03:45.623022 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:45.623004    2570 scope.go:117] "RemoveContainer" containerID="bb67778b2f3cd04cf69596dec0c5f6fb8f49c60dd3c7f561b3ae369d5a84ecb6"
Jul 28 20:03:45.623308 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:03:45.623283    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb67778b2f3cd04cf69596dec0c5f6fb8f49c60dd3c7f561b3ae369d5a84ecb6\": container with ID starting with bb67778b2f3cd04cf69596dec0c5f6fb8f49c60dd3c7f561b3ae369d5a84ecb6 not found: ID does not exist" containerID="bb67778b2f3cd04cf69596dec0c5f6fb8f49c60dd3c7f561b3ae369d5a84ecb6"
Jul 28 20:03:45.623371 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:45.623315    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb67778b2f3cd04cf69596dec0c5f6fb8f49c60dd3c7f561b3ae369d5a84ecb6"} err="failed to get container status \"bb67778b2f3cd04cf69596dec0c5f6fb8f49c60dd3c7f561b3ae369d5a84ecb6\": rpc error: code = NotFound desc = could not find container \"bb67778b2f3cd04cf69596dec0c5f6fb8f49c60dd3c7f561b3ae369d5a84ecb6\": container with ID starting with bb67778b2f3cd04cf69596dec0c5f6fb8f49c60dd3c7f561b3ae369d5a84ecb6 not found: ID does not exist"
Jul 28 20:03:45.623371 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:45.623332    2570 scope.go:117] "RemoveContainer" containerID="80b460a1e1da7a33030afa57d9cf0e24d1e00b2aa19fa8a3b5df166e9209a5ba"
Jul 28 20:03:45.631872 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:45.631851    2570 scope.go:117] "RemoveContainer" containerID="80b460a1e1da7a33030afa57d9cf0e24d1e00b2aa19fa8a3b5df166e9209a5ba"
Jul 28 20:03:45.632181 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:03:45.632162    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80b460a1e1da7a33030afa57d9cf0e24d1e00b2aa19fa8a3b5df166e9209a5ba\": container with ID starting with 80b460a1e1da7a33030afa57d9cf0e24d1e00b2aa19fa8a3b5df166e9209a5ba not found: ID does not exist" containerID="80b460a1e1da7a33030afa57d9cf0e24d1e00b2aa19fa8a3b5df166e9209a5ba"
Jul 28 20:03:45.632250 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:45.632186    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80b460a1e1da7a33030afa57d9cf0e24d1e00b2aa19fa8a3b5df166e9209a5ba"} err="failed to get container status \"80b460a1e1da7a33030afa57d9cf0e24d1e00b2aa19fa8a3b5df166e9209a5ba\": rpc error: code = NotFound desc = could not find container \"80b460a1e1da7a33030afa57d9cf0e24d1e00b2aa19fa8a3b5df166e9209a5ba\": container with ID starting with 80b460a1e1da7a33030afa57d9cf0e24d1e00b2aa19fa8a3b5df166e9209a5ba not found: ID does not exist"
Jul 28 20:03:45.632360 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:45.632339    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-aaa64e88-67c776b956-pbs98"]
Jul 28 20:03:45.636536 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:45.636511    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-aaa64e88-67c776b956-pbs98"]
Jul 28 20:03:45.647699 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:45.647676    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-aaa64e88-b76fc7948-lzdmn"]
Jul 28 20:03:45.651487 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:45.651465    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-aaa64e88-b76fc7948-lzdmn"]
Jul 28 20:03:45.932916 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:45.932884    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"]
Jul 28 20:03:45.933426 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:45.933168    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w" podUID="e6695582-04a3-4a2e-8c83-e5e0f78a9669" containerName="istio-proxy" containerID="cri-o://d5507de0087cf12072ff14c6957e6207137283bfcf10ef338bf0e168650f09cb" gracePeriod=30
Jul 28 20:03:46.705891 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.705855    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"]
Jul 28 20:03:46.706242 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.706228    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d68cd3cb-bd66-48fa-97d8-cea5cdf56602" containerName="revoke-keys"
Jul 28 20:03:46.706287 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.706243    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d68cd3cb-bd66-48fa-97d8-cea5cdf56602" containerName="revoke-keys"
Jul 28 20:03:46.706287 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.706256    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d165ff5-e7d1-43b9-bc4a-30ccba833f99" containerName="payload-pre-processing"
Jul 28 20:03:46.706287 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.706264    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d165ff5-e7d1-43b9-bc4a-30ccba833f99" containerName="payload-pre-processing"
Jul 28 20:03:46.706287 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.706273    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="634cc8e5-46bb-4b74-9714-4c6df375bc39" containerName="payload-processing"
Jul 28 20:03:46.706287 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.706280    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="634cc8e5-46bb-4b74-9714-4c6df375bc39" containerName="payload-processing"
Jul 28 20:03:46.706452 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.706329    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d68cd3cb-bd66-48fa-97d8-cea5cdf56602" containerName="revoke-keys"
Jul 28 20:03:46.706452 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.706342    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d165ff5-e7d1-43b9-bc4a-30ccba833f99" containerName="payload-pre-processing"
Jul 28 20:03:46.706452 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.706350    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="634cc8e5-46bb-4b74-9714-4c6df375bc39" containerName="payload-processing"
Jul 28 20:03:46.710636 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.710616    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:03:46.713269 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.713245    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-43e77436-openshift-default-dockercfg-x5h5d\""
Jul 28 20:03:46.722886 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.722864    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"]
Jul 28 20:03:46.866940 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.866897    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c886011c-d2db-46db-8b09-b149a260e452-istio-token\") pod \"e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9\" (UID: \"c886011c-d2db-46db-8b09-b149a260e452\") " pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:03:46.866940 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.866938    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c886011c-d2db-46db-8b09-b149a260e452-istiod-ca-cert\") pod \"e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9\" (UID: \"c886011c-d2db-46db-8b09-b149a260e452\") " pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:03:46.867348 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.866964    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c886011c-d2db-46db-8b09-b149a260e452-workload-certs\") pod \"e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9\" (UID: \"c886011c-d2db-46db-8b09-b149a260e452\") " pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:03:46.867348 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.867065    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c886011c-d2db-46db-8b09-b149a260e452-istio-envoy\") pod \"e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9\" (UID: \"c886011c-d2db-46db-8b09-b149a260e452\") " pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:03:46.867348 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.867098    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c886011c-d2db-46db-8b09-b149a260e452-workload-socket\") pod \"e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9\" (UID: \"c886011c-d2db-46db-8b09-b149a260e452\") " pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:03:46.867348 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.867133    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6mj2\" (UniqueName: \"kubernetes.io/projected/c886011c-d2db-46db-8b09-b149a260e452-kube-api-access-w6mj2\") pod \"e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9\" (UID: \"c886011c-d2db-46db-8b09-b149a260e452\") " pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:03:46.867348 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.867186    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c886011c-d2db-46db-8b09-b149a260e452-istio-data\") pod \"e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9\" (UID: \"c886011c-d2db-46db-8b09-b149a260e452\") " pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:03:46.867348 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.867201    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c886011c-d2db-46db-8b09-b149a260e452-istio-podinfo\") pod \"e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9\" (UID: \"c886011c-d2db-46db-8b09-b149a260e452\") " pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:03:46.867348 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.867266    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c886011c-d2db-46db-8b09-b149a260e452-credential-socket\") pod \"e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9\" (UID: \"c886011c-d2db-46db-8b09-b149a260e452\") " pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:03:46.967786 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.967691    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c886011c-d2db-46db-8b09-b149a260e452-istio-data\") pod \"e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9\" (UID: \"c886011c-d2db-46db-8b09-b149a260e452\") " pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:03:46.967786 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.967731    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c886011c-d2db-46db-8b09-b149a260e452-istio-podinfo\") pod \"e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9\" (UID: \"c886011c-d2db-46db-8b09-b149a260e452\") " pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:03:46.968367 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.967862    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c886011c-d2db-46db-8b09-b149a260e452-credential-socket\") pod \"e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9\" (UID: \"c886011c-d2db-46db-8b09-b149a260e452\") " pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:03:46.968367 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.967922    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c886011c-d2db-46db-8b09-b149a260e452-istio-token\") pod \"e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9\" (UID: \"c886011c-d2db-46db-8b09-b149a260e452\") " pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:03:46.968367 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.967952    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c886011c-d2db-46db-8b09-b149a260e452-istiod-ca-cert\") pod \"e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9\" (UID: \"c886011c-d2db-46db-8b09-b149a260e452\") " pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:03:46.968367 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.968016    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c886011c-d2db-46db-8b09-b149a260e452-workload-certs\") pod \"e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9\" (UID: \"c886011c-d2db-46db-8b09-b149a260e452\") " pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:03:46.968367 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.968060    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c886011c-d2db-46db-8b09-b149a260e452-istio-envoy\") pod \"e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9\" (UID: \"c886011c-d2db-46db-8b09-b149a260e452\") " pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:03:46.968367 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.968089    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c886011c-d2db-46db-8b09-b149a260e452-workload-socket\") pod \"e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9\" (UID: \"c886011c-d2db-46db-8b09-b149a260e452\") " pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:03:46.968367 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.968142    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6mj2\" (UniqueName: \"kubernetes.io/projected/c886011c-d2db-46db-8b09-b149a260e452-kube-api-access-w6mj2\") pod \"e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9\" (UID: \"c886011c-d2db-46db-8b09-b149a260e452\") " pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:03:46.968367 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.968165    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c886011c-d2db-46db-8b09-b149a260e452-istio-data\") pod \"e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9\" (UID: \"c886011c-d2db-46db-8b09-b149a260e452\") " pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:03:46.968367 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.968230    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c886011c-d2db-46db-8b09-b149a260e452-credential-socket\") pod \"e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9\" (UID: \"c886011c-d2db-46db-8b09-b149a260e452\") " pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:03:46.968758 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.968493    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c886011c-d2db-46db-8b09-b149a260e452-workload-socket\") pod \"e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9\" (UID: \"c886011c-d2db-46db-8b09-b149a260e452\") " pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:03:46.968758 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.968637    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c886011c-d2db-46db-8b09-b149a260e452-workload-certs\") pod \"e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9\" (UID: \"c886011c-d2db-46db-8b09-b149a260e452\") " pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:03:46.968758 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.968717    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c886011c-d2db-46db-8b09-b149a260e452-istiod-ca-cert\") pod \"e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9\" (UID: \"c886011c-d2db-46db-8b09-b149a260e452\") " pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:03:46.970213 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.970190    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c886011c-d2db-46db-8b09-b149a260e452-istio-envoy\") pod \"e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9\" (UID: \"c886011c-d2db-46db-8b09-b149a260e452\") " pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:03:46.970298 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.970282    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c886011c-d2db-46db-8b09-b149a260e452-istio-podinfo\") pod \"e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9\" (UID: \"c886011c-d2db-46db-8b09-b149a260e452\") " pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:03:46.976590 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.976551    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c886011c-d2db-46db-8b09-b149a260e452-istio-token\") pod \"e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9\" (UID: \"c886011c-d2db-46db-8b09-b149a260e452\") " pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:03:46.976708 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:46.976680    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6mj2\" (UniqueName: \"kubernetes.io/projected/c886011c-d2db-46db-8b09-b149a260e452-kube-api-access-w6mj2\") pod \"e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9\" (UID: \"c886011c-d2db-46db-8b09-b149a260e452\") " pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:03:47.021401 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:47.021367    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:03:47.168895 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:47.168859    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"]
Jul 28 20:03:47.171651 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:03:47.171605    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc886011c_d2db_46db_8b09_b149a260e452.slice/crio-ba7d6fc14973727453ecbf4a2110886edb9128cf79d33d84602a6d298095bb2e WatchSource:0}: Error finding container ba7d6fc14973727453ecbf4a2110886edb9128cf79d33d84602a6d298095bb2e: Status 404 returned error can't find the container with id ba7d6fc14973727453ecbf4a2110886edb9128cf79d33d84602a6d298095bb2e
Jul 28 20:03:47.174040 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:47.174008    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:03:47.174135 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:47.174076    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:03:47.174135 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:47.174104    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:03:47.576049 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:47.575202    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="634cc8e5-46bb-4b74-9714-4c6df375bc39" path="/var/lib/kubelet/pods/634cc8e5-46bb-4b74-9714-4c6df375bc39/volumes"
Jul 28 20:03:47.576049 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:47.575760    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d165ff5-e7d1-43b9-bc4a-30ccba833f99" path="/var/lib/kubelet/pods/9d165ff5-e7d1-43b9-bc4a-30ccba833f99/volumes"
Jul 28 20:03:47.628929 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:47.628890    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9" event={"ID":"c886011c-d2db-46db-8b09-b149a260e452","Type":"ContainerStarted","Data":"87e11247e6fc4306b0451fe376b33c25c7adf3874111f963278e645cc30f4d9b"}
Jul 28 20:03:47.629158 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:47.628956    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9" event={"ID":"c886011c-d2db-46db-8b09-b149a260e452","Type":"ContainerStarted","Data":"ba7d6fc14973727453ecbf4a2110886edb9128cf79d33d84602a6d298095bb2e"}
Jul 28 20:03:47.651958 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:47.651898    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9" podStartSLOduration=1.65187755 podStartE2EDuration="1.65187755s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:03:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:03:47.651228805 +0000 UTC m=+2040.603261180" watchObservedRunningTime="2026-07-28 20:03:47.65187755 +0000 UTC m=+2040.603909880"
Jul 28 20:03:48.021907 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:48.021873    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:03:48.027122 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:48.027100    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:03:48.632929 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:48.632897    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:03:48.633860 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:48.633841    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:03:48.656078 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:48.656043    2570 patch_prober.go:28] interesting pod/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 28 20:03:48.656209 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:48.656097    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w" podUID="e6695582-04a3-4a2e-8c83-e5e0f78a9669" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 20:03:49.945576 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:49.945542    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-43e77436-779c47678-9dktm"]
Jul 28 20:03:49.950612 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:49.950583    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-43e77436-779c47678-9dktm"
Jul 28 20:03:49.953034 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:49.953004    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-43e77436-dockercfg-284zg\""
Jul 28 20:03:49.953163 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:49.953099    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-43e77436\""
Jul 28 20:03:49.956587 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:49.956560    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-43e77436-779c47678-9dktm"]
Jul 28 20:03:49.976671 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:49.976642    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-43e77436-7dc7d58b9b-nm8jd"]
Jul 28 20:03:49.980208 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:49.980187    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-43e77436-7dc7d58b9b-nm8jd"
Jul 28 20:03:49.990641 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:49.990592    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-43e77436-7dc7d58b9b-nm8jd"]
Jul 28 20:03:49.998628 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:49.998601    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68546462-3864-4b29-b514-979cccea8a91-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-43e77436-7dc7d58b9b-nm8jd\" (UID: \"68546462-3864-4b29-b514-979cccea8a91\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-43e77436-7dc7d58b9b-nm8jd"
Jul 28 20:03:49.998769 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:49.998656    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d76ce6d3-c5cc-4674-a025-87e4ee9e61fd-plugins-config-volume\") pod \"payload-processing-e2e-derive-43e77436-779c47678-9dktm\" (UID: \"d76ce6d3-c5cc-4674-a025-87e4ee9e61fd\") " pod="openshift-ingress/payload-processing-e2e-derive-43e77436-779c47678-9dktm"
Jul 28 20:03:49.998820 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:49.998753    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb5cc\" (UniqueName: \"kubernetes.io/projected/68546462-3864-4b29-b514-979cccea8a91-kube-api-access-sb5cc\") pod \"payload-pre-processing-e2e-derive-43e77436-7dc7d58b9b-nm8jd\" (UID: \"68546462-3864-4b29-b514-979cccea8a91\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-43e77436-7dc7d58b9b-nm8jd"
Jul 28 20:03:49.998879 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:49.998862    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbbgx\" (UniqueName: \"kubernetes.io/projected/d76ce6d3-c5cc-4674-a025-87e4ee9e61fd-kube-api-access-xbbgx\") pod \"payload-processing-e2e-derive-43e77436-779c47678-9dktm\" (UID: \"d76ce6d3-c5cc-4674-a025-87e4ee9e61fd\") " pod="openshift-ingress/payload-processing-e2e-derive-43e77436-779c47678-9dktm"
Jul 28 20:03:50.099428 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:50.099388    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d76ce6d3-c5cc-4674-a025-87e4ee9e61fd-plugins-config-volume\") pod \"payload-processing-e2e-derive-43e77436-779c47678-9dktm\" (UID: \"d76ce6d3-c5cc-4674-a025-87e4ee9e61fd\") " pod="openshift-ingress/payload-processing-e2e-derive-43e77436-779c47678-9dktm"
Jul 28 20:03:50.099601 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:50.099462    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb5cc\" (UniqueName: \"kubernetes.io/projected/68546462-3864-4b29-b514-979cccea8a91-kube-api-access-sb5cc\") pod \"payload-pre-processing-e2e-derive-43e77436-7dc7d58b9b-nm8jd\" (UID: \"68546462-3864-4b29-b514-979cccea8a91\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-43e77436-7dc7d58b9b-nm8jd"
Jul 28 20:03:50.099601 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:50.099517    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbbgx\" (UniqueName: \"kubernetes.io/projected/d76ce6d3-c5cc-4674-a025-87e4ee9e61fd-kube-api-access-xbbgx\") pod \"payload-processing-e2e-derive-43e77436-779c47678-9dktm\" (UID: \"d76ce6d3-c5cc-4674-a025-87e4ee9e61fd\") " pod="openshift-ingress/payload-processing-e2e-derive-43e77436-779c47678-9dktm"
Jul 28 20:03:50.099601 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:50.099542    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68546462-3864-4b29-b514-979cccea8a91-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-43e77436-7dc7d58b9b-nm8jd\" (UID: \"68546462-3864-4b29-b514-979cccea8a91\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-43e77436-7dc7d58b9b-nm8jd"
Jul 28 20:03:50.100423 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:50.100395    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d76ce6d3-c5cc-4674-a025-87e4ee9e61fd-plugins-config-volume\") pod \"payload-processing-e2e-derive-43e77436-779c47678-9dktm\" (UID: \"d76ce6d3-c5cc-4674-a025-87e4ee9e61fd\") " pod="openshift-ingress/payload-processing-e2e-derive-43e77436-779c47678-9dktm"
Jul 28 20:03:50.100512 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:50.100425    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68546462-3864-4b29-b514-979cccea8a91-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-43e77436-7dc7d58b9b-nm8jd\" (UID: \"68546462-3864-4b29-b514-979cccea8a91\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-43e77436-7dc7d58b9b-nm8jd"
Jul 28 20:03:50.107500 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:50.107474    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb5cc\" (UniqueName: \"kubernetes.io/projected/68546462-3864-4b29-b514-979cccea8a91-kube-api-access-sb5cc\") pod \"payload-pre-processing-e2e-derive-43e77436-7dc7d58b9b-nm8jd\" (UID: \"68546462-3864-4b29-b514-979cccea8a91\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-43e77436-7dc7d58b9b-nm8jd"
Jul 28 20:03:50.107500 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:50.107489    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbbgx\" (UniqueName: \"kubernetes.io/projected/d76ce6d3-c5cc-4674-a025-87e4ee9e61fd-kube-api-access-xbbgx\") pod \"payload-processing-e2e-derive-43e77436-779c47678-9dktm\" (UID: \"d76ce6d3-c5cc-4674-a025-87e4ee9e61fd\") " pod="openshift-ingress/payload-processing-e2e-derive-43e77436-779c47678-9dktm"
Jul 28 20:03:50.263271 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:50.263175    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-43e77436-779c47678-9dktm"
Jul 28 20:03:50.292403 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:50.292372    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-43e77436-7dc7d58b9b-nm8jd"
Jul 28 20:03:50.427265 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:50.427159    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-43e77436-779c47678-9dktm"]
Jul 28 20:03:50.432008 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:03:50.431957    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd76ce6d3_c5cc_4674_a025_87e4ee9e61fd.slice/crio-b260b859899c432c50bd9625dbb057eefb3d5192adfc142e358b6d8ea2fd35ae WatchSource:0}: Error finding container b260b859899c432c50bd9625dbb057eefb3d5192adfc142e358b6d8ea2fd35ae: Status 404 returned error can't find the container with id b260b859899c432c50bd9625dbb057eefb3d5192adfc142e358b6d8ea2fd35ae
Jul 28 20:03:50.643455 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:50.643368    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-43e77436-779c47678-9dktm" event={"ID":"d76ce6d3-c5cc-4674-a025-87e4ee9e61fd","Type":"ContainerStarted","Data":"f3524da91d90cec308349feed86b7876bb867e93f21ff06001982c6fbc32e749"}
Jul 28 20:03:50.643455 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:50.643453    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-43e77436-779c47678-9dktm" event={"ID":"d76ce6d3-c5cc-4674-a025-87e4ee9e61fd","Type":"ContainerStarted","Data":"b260b859899c432c50bd9625dbb057eefb3d5192adfc142e358b6d8ea2fd35ae"}
Jul 28 20:03:50.643656 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:50.643545    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-43e77436-779c47678-9dktm"
Jul 28 20:03:50.656353 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:50.656330    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-43e77436-7dc7d58b9b-nm8jd"]
Jul 28 20:03:50.658881 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:50.658837    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-43e77436-779c47678-9dktm" podStartSLOduration=1.658822797 podStartE2EDuration="1.658822797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:03:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:03:50.657587918 +0000 UTC m=+2043.609620297" watchObservedRunningTime="2026-07-28 20:03:50.658822797 +0000 UTC m=+2043.610855127"
Jul 28 20:03:50.659025 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:03:50.658965    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68546462_3864_4b29_b514_979cccea8a91.slice/crio-e45200b3c97d451cd815fe2d55b204e1e70d5d5d96692d6df183a42d821c5c8c WatchSource:0}: Error finding container e45200b3c97d451cd815fe2d55b204e1e70d5d5d96692d6df183a42d821c5c8c: Status 404 returned error can't find the container with id e45200b3c97d451cd815fe2d55b204e1e70d5d5d96692d6df183a42d821c5c8c
Jul 28 20:03:51.207460 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.207388    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:51.312154 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.312112    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6695582-04a3-4a2e-8c83-e5e0f78a9669-workload-certs\") pod \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\" (UID: \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\") "
Jul 28 20:03:51.312349 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.312177    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-246ns\" (UniqueName: \"kubernetes.io/projected/e6695582-04a3-4a2e-8c83-e5e0f78a9669-kube-api-access-246ns\") pod \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\" (UID: \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\") "
Jul 28 20:03:51.312349 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.312211    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6695582-04a3-4a2e-8c83-e5e0f78a9669-workload-socket\") pod \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\" (UID: \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\") "
Jul 28 20:03:51.312349 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.312237    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6695582-04a3-4a2e-8c83-e5e0f78a9669-istio-token\") pod \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\" (UID: \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\") "
Jul 28 20:03:51.312349 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.312261    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6695582-04a3-4a2e-8c83-e5e0f78a9669-istio-podinfo\") pod \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\" (UID: \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\") "
Jul 28 20:03:51.312349 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.312294    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6695582-04a3-4a2e-8c83-e5e0f78a9669-istiod-ca-cert\") pod \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\" (UID: \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\") "
Jul 28 20:03:51.312611 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.312412    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6695582-04a3-4a2e-8c83-e5e0f78a9669-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e6695582-04a3-4a2e-8c83-e5e0f78a9669" (UID: "e6695582-04a3-4a2e-8c83-e5e0f78a9669"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:03:51.312611 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.312564    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6695582-04a3-4a2e-8c83-e5e0f78a9669-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e6695582-04a3-4a2e-8c83-e5e0f78a9669" (UID: "e6695582-04a3-4a2e-8c83-e5e0f78a9669"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:03:51.312860 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.312828    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6695582-04a3-4a2e-8c83-e5e0f78a9669-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e6695582-04a3-4a2e-8c83-e5e0f78a9669" (UID: "e6695582-04a3-4a2e-8c83-e5e0f78a9669"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:03:51.312953 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.312897    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6695582-04a3-4a2e-8c83-e5e0f78a9669-istio-data\") pod \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\" (UID: \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\") "
Jul 28 20:03:51.313042 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.312953    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6695582-04a3-4a2e-8c83-e5e0f78a9669-istio-envoy\") pod \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\" (UID: \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\") "
Jul 28 20:03:51.313042 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.313027    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6695582-04a3-4a2e-8c83-e5e0f78a9669-credential-socket\") pod \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\" (UID: \"e6695582-04a3-4a2e-8c83-e5e0f78a9669\") "
Jul 28 20:03:51.313382 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.313360    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6695582-04a3-4a2e-8c83-e5e0f78a9669-workload-certs\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:03:51.313534 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.313520    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6695582-04a3-4a2e-8c83-e5e0f78a9669-workload-socket\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:03:51.313649 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.313630    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6695582-04a3-4a2e-8c83-e5e0f78a9669-istiod-ca-cert\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:03:51.313649 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.313423    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6695582-04a3-4a2e-8c83-e5e0f78a9669-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e6695582-04a3-4a2e-8c83-e5e0f78a9669" (UID: "e6695582-04a3-4a2e-8c83-e5e0f78a9669"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:03:51.313836 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.313442    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6695582-04a3-4a2e-8c83-e5e0f78a9669-istio-data" (OuterVolumeSpecName: "istio-data") pod "e6695582-04a3-4a2e-8c83-e5e0f78a9669" (UID: "e6695582-04a3-4a2e-8c83-e5e0f78a9669"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:03:51.314674 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.314651    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e6695582-04a3-4a2e-8c83-e5e0f78a9669-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e6695582-04a3-4a2e-8c83-e5e0f78a9669" (UID: "e6695582-04a3-4a2e-8c83-e5e0f78a9669"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:03:51.314780 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.314681    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6695582-04a3-4a2e-8c83-e5e0f78a9669-kube-api-access-246ns" (OuterVolumeSpecName: "kube-api-access-246ns") pod "e6695582-04a3-4a2e-8c83-e5e0f78a9669" (UID: "e6695582-04a3-4a2e-8c83-e5e0f78a9669"). InnerVolumeSpecName "kube-api-access-246ns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:03:51.314826 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.314808    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6695582-04a3-4a2e-8c83-e5e0f78a9669-istio-token" (OuterVolumeSpecName: "istio-token") pod "e6695582-04a3-4a2e-8c83-e5e0f78a9669" (UID: "e6695582-04a3-4a2e-8c83-e5e0f78a9669"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:03:51.315122 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.315104    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6695582-04a3-4a2e-8c83-e5e0f78a9669-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e6695582-04a3-4a2e-8c83-e5e0f78a9669" (UID: "e6695582-04a3-4a2e-8c83-e5e0f78a9669"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:03:51.414757 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.414717    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-246ns\" (UniqueName: \"kubernetes.io/projected/e6695582-04a3-4a2e-8c83-e5e0f78a9669-kube-api-access-246ns\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:03:51.414757 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.414754    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6695582-04a3-4a2e-8c83-e5e0f78a9669-istio-token\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:03:51.414962 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.414769    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6695582-04a3-4a2e-8c83-e5e0f78a9669-istio-podinfo\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:03:51.414962 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.414781    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6695582-04a3-4a2e-8c83-e5e0f78a9669-istio-data\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:03:51.414962 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.414794    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6695582-04a3-4a2e-8c83-e5e0f78a9669-istio-envoy\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:03:51.414962 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.414807    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6695582-04a3-4a2e-8c83-e5e0f78a9669-credential-socket\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:03:51.649819 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.649779    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-43e77436-7dc7d58b9b-nm8jd" event={"ID":"68546462-3864-4b29-b514-979cccea8a91","Type":"ContainerStarted","Data":"417bba0174757306a1dcc3c45851e5f659d6ec1f06abe12bbf12e21d5778e925"}
Jul 28 20:03:51.650029 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.649844    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-43e77436-7dc7d58b9b-nm8jd" event={"ID":"68546462-3864-4b29-b514-979cccea8a91","Type":"ContainerStarted","Data":"e45200b3c97d451cd815fe2d55b204e1e70d5d5d96692d6df183a42d821c5c8c"}
Jul 28 20:03:51.650029 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.649897    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-43e77436-7dc7d58b9b-nm8jd"
Jul 28 20:03:51.651499 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.651473    2570 generic.go:356] "Generic (PLEG): container finished" podID="e6695582-04a3-4a2e-8c83-e5e0f78a9669" containerID="d5507de0087cf12072ff14c6957e6207137283bfcf10ef338bf0e168650f09cb" exitCode=0
Jul 28 20:03:51.651630 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.651533    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"
Jul 28 20:03:51.651630 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.651554    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w" event={"ID":"e6695582-04a3-4a2e-8c83-e5e0f78a9669","Type":"ContainerDied","Data":"d5507de0087cf12072ff14c6957e6207137283bfcf10ef338bf0e168650f09cb"}
Jul 28 20:03:51.651630 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.651608    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w" event={"ID":"e6695582-04a3-4a2e-8c83-e5e0f78a9669","Type":"ContainerDied","Data":"fb10cf120139fc72a024f576b16935f6d3788a5d91fdd88ef31a3774093b0592"}
Jul 28 20:03:51.651789 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.651638    2570 scope.go:117] "RemoveContainer" containerID="d5507de0087cf12072ff14c6957e6207137283bfcf10ef338bf0e168650f09cb"
Jul 28 20:03:51.660418 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.660399    2570 scope.go:117] "RemoveContainer" containerID="e6a467598048e28c4b7481915b223922c10949c13d3b8a98646c53ea8d52f764"
Jul 28 20:03:51.668471 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.668236    2570 scope.go:117] "RemoveContainer" containerID="d5507de0087cf12072ff14c6957e6207137283bfcf10ef338bf0e168650f09cb"
Jul 28 20:03:51.668565 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:03:51.668517    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5507de0087cf12072ff14c6957e6207137283bfcf10ef338bf0e168650f09cb\": container with ID starting with d5507de0087cf12072ff14c6957e6207137283bfcf10ef338bf0e168650f09cb not found: ID does not exist" containerID="d5507de0087cf12072ff14c6957e6207137283bfcf10ef338bf0e168650f09cb"
Jul 28 20:03:51.668565 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.668548    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5507de0087cf12072ff14c6957e6207137283bfcf10ef338bf0e168650f09cb"} err="failed to get container status \"d5507de0087cf12072ff14c6957e6207137283bfcf10ef338bf0e168650f09cb\": rpc error: code = NotFound desc = could not find container \"d5507de0087cf12072ff14c6957e6207137283bfcf10ef338bf0e168650f09cb\": container with ID starting with d5507de0087cf12072ff14c6957e6207137283bfcf10ef338bf0e168650f09cb not found: ID does not exist"
Jul 28 20:03:51.668565 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.668572    2570 scope.go:117] "RemoveContainer" containerID="e6a467598048e28c4b7481915b223922c10949c13d3b8a98646c53ea8d52f764"
Jul 28 20:03:51.668833 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:03:51.668792    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6a467598048e28c4b7481915b223922c10949c13d3b8a98646c53ea8d52f764\": container with ID starting with e6a467598048e28c4b7481915b223922c10949c13d3b8a98646c53ea8d52f764 not found: ID does not exist" containerID="e6a467598048e28c4b7481915b223922c10949c13d3b8a98646c53ea8d52f764"
Jul 28 20:03:51.668833 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.668823    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6a467598048e28c4b7481915b223922c10949c13d3b8a98646c53ea8d52f764"} err="failed to get container status \"e6a467598048e28c4b7481915b223922c10949c13d3b8a98646c53ea8d52f764\": rpc error: code = NotFound desc = could not find container \"e6a467598048e28c4b7481915b223922c10949c13d3b8a98646c53ea8d52f764\": container with ID starting with e6a467598048e28c4b7481915b223922c10949c13d3b8a98646c53ea8d52f764 not found: ID does not exist"
Jul 28 20:03:51.670015 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.669957    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-43e77436-7dc7d58b9b-nm8jd" podStartSLOduration=2.669945152 podStartE2EDuration="2.669945152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:03:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:03:51.667668913 +0000 UTC m=+2044.619701264" watchObservedRunningTime="2026-07-28 20:03:51.669945152 +0000 UTC m=+2044.621977525"
Jul 28 20:03:51.680736 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.680709    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"]
Jul 28 20:03:51.686968 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:51.686944    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-aaa64e88-openshift-default-5b96f495d4-9zf2w"]
Jul 28 20:03:53.572351 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:03:53.572318    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6695582-04a3-4a2e-8c83-e5e0f78a9669" path="/var/lib/kubelet/pods/e6695582-04a3-4a2e-8c83-e5e0f78a9669/volumes"
Jul 28 20:04:01.654681 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:01.654649    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-43e77436-779c47678-9dktm"
Jul 28 20:04:02.659522 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:02.659441    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-43e77436-7dc7d58b9b-nm8jd"
Jul 28 20:04:02.703883 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:02.703850    2570 generic.go:356] "Generic (PLEG): container finished" podID="c886011c-d2db-46db-8b09-b149a260e452" containerID="87e11247e6fc4306b0451fe376b33c25c7adf3874111f963278e645cc30f4d9b" exitCode=0
Jul 28 20:04:02.704056 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:02.703925    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9" event={"ID":"c886011c-d2db-46db-8b09-b149a260e452","Type":"ContainerDied","Data":"87e11247e6fc4306b0451fe376b33c25c7adf3874111f963278e645cc30f4d9b"}
Jul 28 20:04:02.704352 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:02.704338    2570 scope.go:117] "RemoveContainer" containerID="87e11247e6fc4306b0451fe376b33c25c7adf3874111f963278e645cc30f4d9b"
Jul 28 20:04:02.705428 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:02.705399    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:04:02.705533 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:02.705465    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:04:02.705533 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:02.705505    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:04:03.633648 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:03.633605    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:04:03.714521 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:03.714481    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9" event={"ID":"c886011c-d2db-46db-8b09-b149a260e452","Type":"ContainerStarted","Data":"20e097dbf3d90d4119bcd7e42a3cdd9270c5a78a56a4e7310f5ad5ecb0958af5"}
Jul 28 20:04:04.022059 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:04.022023    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:04:04.023183 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:04.023155    2570 patch_prober.go:28] interesting pod/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 28 20:04:04.023308 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:04.023205    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9" podUID="c886011c-d2db-46db-8b09-b149a260e452" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 28 20:04:05.022720 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:05.022675    2570 patch_prober.go:28] interesting pod/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 28 20:04:05.023255 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:05.022737    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9" podUID="c886011c-d2db-46db-8b09-b149a260e452" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 28 20:04:06.022457 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:06.022417    2570 patch_prober.go:28] interesting pod/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 28 20:04:06.022640 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:06.022479    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9" podUID="c886011c-d2db-46db-8b09-b149a260e452" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 28 20:04:07.022783 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:07.022726    2570 patch_prober.go:28] interesting pod/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 28 20:04:07.023224 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:07.022800    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9" podUID="c886011c-d2db-46db-8b09-b149a260e452" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 28 20:04:08.025558 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:08.025530    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:04:08.025914 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:08.025867    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:04:08.026622 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:08.026600    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:04:13.919608 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:13.919518    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-43e77436-ww9gw"]
Jul 28 20:04:13.920034 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:13.920016    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6695582-04a3-4a2e-8c83-e5e0f78a9669" containerName="istio-proxy"
Jul 28 20:04:13.920034 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:13.920030    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6695582-04a3-4a2e-8c83-e5e0f78a9669" containerName="istio-proxy"
Jul 28 20:04:13.920115 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:13.920049    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6695582-04a3-4a2e-8c83-e5e0f78a9669" containerName="istio-proxy"
Jul 28 20:04:13.920115 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:13.920055    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6695582-04a3-4a2e-8c83-e5e0f78a9669" containerName="istio-proxy"
Jul 28 20:04:13.920177 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:13.920116    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6695582-04a3-4a2e-8c83-e5e0f78a9669" containerName="istio-proxy"
Jul 28 20:04:13.920177 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:13.920127    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6695582-04a3-4a2e-8c83-e5e0f78a9669" containerName="istio-proxy"
Jul 28 20:04:13.922243 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:13.922227    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-43e77436-ww9gw"
Jul 28 20:04:13.924749 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:13.924729    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z6zs4\""
Jul 28 20:04:13.928808 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:13.928781    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-43e77436-ww9gw"]
Jul 28 20:04:14.018596 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:14.018552    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28a97064-8a09-4441-915b-40b0d7780c3a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-43e77436-ww9gw\" (UID: \"28a97064-8a09-4441-915b-40b0d7780c3a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-43e77436-ww9gw"
Jul 28 20:04:14.119709 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:14.119663    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28a97064-8a09-4441-915b-40b0d7780c3a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-43e77436-ww9gw\" (UID: \"28a97064-8a09-4441-915b-40b0d7780c3a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-43e77436-ww9gw"
Jul 28 20:04:14.120328 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:14.120308    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28a97064-8a09-4441-915b-40b0d7780c3a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-43e77436-ww9gw\" (UID: \"28a97064-8a09-4441-915b-40b0d7780c3a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-43e77436-ww9gw"
Jul 28 20:04:14.234147 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:14.234059    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-43e77436-ww9gw"
Jul 28 20:04:14.363593 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:14.363569    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-43e77436-ww9gw"]
Jul 28 20:04:14.365902 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:04:14.365873    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28a97064_8a09_4441_915b_40b0d7780c3a.slice/crio-1a66ce60fa33e59f86b034c477d81b5506ea0ff3637e0769c2e19e7da2151531 WatchSource:0}: Error finding container 1a66ce60fa33e59f86b034c477d81b5506ea0ff3637e0769c2e19e7da2151531: Status 404 returned error can't find the container with id 1a66ce60fa33e59f86b034c477d81b5506ea0ff3637e0769c2e19e7da2151531
Jul 28 20:04:14.766839 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:14.766798    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-43e77436-ww9gw" event={"ID":"28a97064-8a09-4441-915b-40b0d7780c3a","Type":"ContainerStarted","Data":"2430418be045735cdfe2e4d9b7d0ea9cf8e15593b1e35861750f3ac52ab25330"}
Jul 28 20:04:14.767037 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:14.766867    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-43e77436-ww9gw" event={"ID":"28a97064-8a09-4441-915b-40b0d7780c3a","Type":"ContainerStarted","Data":"1a66ce60fa33e59f86b034c477d81b5506ea0ff3637e0769c2e19e7da2151531"}
Jul 28 20:04:14.782422 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:14.782372    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-43e77436-ww9gw" podStartSLOduration=1.7823577579999998 podStartE2EDuration="1.782357758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:04:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:04:14.780694818 +0000 UTC m=+2067.732727172" watchObservedRunningTime="2026-07-28 20:04:14.782357758 +0000 UTC m=+2067.734390089"
Jul 28 20:04:15.772892 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:15.772859    2570 generic.go:356] "Generic (PLEG): container finished" podID="28a97064-8a09-4441-915b-40b0d7780c3a" containerID="2430418be045735cdfe2e4d9b7d0ea9cf8e15593b1e35861750f3ac52ab25330" exitCode=0
Jul 28 20:04:15.772892 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:15.772897    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-43e77436-ww9gw" event={"ID":"28a97064-8a09-4441-915b-40b0d7780c3a","Type":"ContainerDied","Data":"2430418be045735cdfe2e4d9b7d0ea9cf8e15593b1e35861750f3ac52ab25330"}
Jul 28 20:04:16.907152 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:16.907128    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-43e77436-ww9gw"
Jul 28 20:04:17.047522 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:17.047434    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28a97064-8a09-4441-915b-40b0d7780c3a-maas-api-service-ca\") pod \"28a97064-8a09-4441-915b-40b0d7780c3a\" (UID: \"28a97064-8a09-4441-915b-40b0d7780c3a\") "
Jul 28 20:04:17.047806 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:17.047782    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28a97064-8a09-4441-915b-40b0d7780c3a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "28a97064-8a09-4441-915b-40b0d7780c3a" (UID: "28a97064-8a09-4441-915b-40b0d7780c3a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:04:17.148497 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:17.148458    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28a97064-8a09-4441-915b-40b0d7780c3a-maas-api-service-ca\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:04:17.784234 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:17.784205    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-43e77436-ww9gw"
Jul 28 20:04:17.784234 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:17.784230    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-43e77436-ww9gw" event={"ID":"28a97064-8a09-4441-915b-40b0d7780c3a","Type":"ContainerDied","Data":"1a66ce60fa33e59f86b034c477d81b5506ea0ff3637e0769c2e19e7da2151531"}
Jul 28 20:04:17.784451 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:17.784271    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a66ce60fa33e59f86b034c477d81b5506ea0ff3637e0769c2e19e7da2151531"
Jul 28 20:04:19.830693 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:19.830658    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-43e77436-779c47678-9dktm"]
Jul 28 20:04:19.831199 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:19.830897    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-43e77436-779c47678-9dktm" podUID="d76ce6d3-c5cc-4674-a025-87e4ee9e61fd" containerName="payload-processing" containerID="cri-o://f3524da91d90cec308349feed86b7876bb867e93f21ff06001982c6fbc32e749" gracePeriod=30
Jul 28 20:04:19.835169 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:19.835141    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-43e77436-7dc7d58b9b-nm8jd"]
Jul 28 20:04:19.835398 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:19.835369    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-43e77436-7dc7d58b9b-nm8jd" podUID="68546462-3864-4b29-b514-979cccea8a91" containerName="payload-pre-processing" containerID="cri-o://417bba0174757306a1dcc3c45851e5f659d6ec1f06abe12bbf12e21d5778e925" gracePeriod=30
Jul 28 20:04:19.962960 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:19.962924    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-43e77436-ww9gw"]
Jul 28 20:04:19.968163 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:19.968060    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-43e77436-ww9gw"]
Jul 28 20:04:20.099632 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:20.099593    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"]
Jul 28 20:04:20.100311 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:20.100197    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9" podUID="c886011c-d2db-46db-8b09-b149a260e452" containerName="istio-proxy" containerID="cri-o://20e097dbf3d90d4119bcd7e42a3cdd9270c5a78a56a4e7310f5ad5ecb0958af5" gracePeriod=30
Jul 28 20:04:20.115377 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:20.115354    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-43e77436-779c47678-9dktm"
Jul 28 20:04:20.135286 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:20.135264    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-43e77436-7dc7d58b9b-nm8jd"
Jul 28 20:04:20.277060 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:20.277025    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbbgx\" (UniqueName: \"kubernetes.io/projected/d76ce6d3-c5cc-4674-a025-87e4ee9e61fd-kube-api-access-xbbgx\") pod \"d76ce6d3-c5cc-4674-a025-87e4ee9e61fd\" (UID: \"d76ce6d3-c5cc-4674-a025-87e4ee9e61fd\") "
Jul 28 20:04:20.277228 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:20.277073    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d76ce6d3-c5cc-4674-a025-87e4ee9e61fd-plugins-config-volume\") pod \"d76ce6d3-c5cc-4674-a025-87e4ee9e61fd\" (UID: \"d76ce6d3-c5cc-4674-a025-87e4ee9e61fd\") "
Jul 28 20:04:20.277228 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:20.277089    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sb5cc\" (UniqueName: \"kubernetes.io/projected/68546462-3864-4b29-b514-979cccea8a91-kube-api-access-sb5cc\") pod \"68546462-3864-4b29-b514-979cccea8a91\" (UID: \"68546462-3864-4b29-b514-979cccea8a91\") "
Jul 28 20:04:20.277228 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:20.277131    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68546462-3864-4b29-b514-979cccea8a91-plugins-config-volume\") pod \"68546462-3864-4b29-b514-979cccea8a91\" (UID: \"68546462-3864-4b29-b514-979cccea8a91\") "
Jul 28 20:04:20.277578 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:20.277546    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68546462-3864-4b29-b514-979cccea8a91-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "68546462-3864-4b29-b514-979cccea8a91" (UID: "68546462-3864-4b29-b514-979cccea8a91"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:04:20.277696 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:20.277577    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d76ce6d3-c5cc-4674-a025-87e4ee9e61fd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d76ce6d3-c5cc-4674-a025-87e4ee9e61fd" (UID: "d76ce6d3-c5cc-4674-a025-87e4ee9e61fd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:04:20.279270 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:20.279246    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d76ce6d3-c5cc-4674-a025-87e4ee9e61fd-kube-api-access-xbbgx" (OuterVolumeSpecName: "kube-api-access-xbbgx") pod "d76ce6d3-c5cc-4674-a025-87e4ee9e61fd" (UID: "d76ce6d3-c5cc-4674-a025-87e4ee9e61fd"). InnerVolumeSpecName "kube-api-access-xbbgx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:04:20.279388 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:20.279371    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68546462-3864-4b29-b514-979cccea8a91-kube-api-access-sb5cc" (OuterVolumeSpecName: "kube-api-access-sb5cc") pod "68546462-3864-4b29-b514-979cccea8a91" (UID: "68546462-3864-4b29-b514-979cccea8a91"). InnerVolumeSpecName "kube-api-access-sb5cc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:04:20.377810 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:20.377723    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d76ce6d3-c5cc-4674-a025-87e4ee9e61fd-plugins-config-volume\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:04:20.377810 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:20.377750    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sb5cc\" (UniqueName: \"kubernetes.io/projected/68546462-3864-4b29-b514-979cccea8a91-kube-api-access-sb5cc\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:04:20.377810 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:20.377761    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68546462-3864-4b29-b514-979cccea8a91-plugins-config-volume\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:04:20.377810 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:20.377770    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbbgx\" (UniqueName: \"kubernetes.io/projected/d76ce6d3-c5cc-4674-a025-87e4ee9e61fd-kube-api-access-xbbgx\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:04:20.800658 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:20.800623    2570 generic.go:356] "Generic (PLEG): container finished" podID="68546462-3864-4b29-b514-979cccea8a91" containerID="417bba0174757306a1dcc3c45851e5f659d6ec1f06abe12bbf12e21d5778e925" exitCode=0
Jul 28 20:04:20.800809 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:20.800667    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-43e77436-7dc7d58b9b-nm8jd"
Jul 28 20:04:20.800809 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:20.800704    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-43e77436-7dc7d58b9b-nm8jd" event={"ID":"68546462-3864-4b29-b514-979cccea8a91","Type":"ContainerDied","Data":"417bba0174757306a1dcc3c45851e5f659d6ec1f06abe12bbf12e21d5778e925"}
Jul 28 20:04:20.800809 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:20.800755    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-43e77436-7dc7d58b9b-nm8jd" event={"ID":"68546462-3864-4b29-b514-979cccea8a91","Type":"ContainerDied","Data":"e45200b3c97d451cd815fe2d55b204e1e70d5d5d96692d6df183a42d821c5c8c"}
Jul 28 20:04:20.800809 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:20.800787    2570 scope.go:117] "RemoveContainer" containerID="417bba0174757306a1dcc3c45851e5f659d6ec1f06abe12bbf12e21d5778e925"
Jul 28 20:04:20.801998 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:20.801962    2570 generic.go:356] "Generic (PLEG): container finished" podID="d76ce6d3-c5cc-4674-a025-87e4ee9e61fd" containerID="f3524da91d90cec308349feed86b7876bb867e93f21ff06001982c6fbc32e749" exitCode=0
Jul 28 20:04:20.802094 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:20.802025    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-43e77436-779c47678-9dktm" event={"ID":"d76ce6d3-c5cc-4674-a025-87e4ee9e61fd","Type":"ContainerDied","Data":"f3524da91d90cec308349feed86b7876bb867e93f21ff06001982c6fbc32e749"}
Jul 28 20:04:20.802094 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:20.802059    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-43e77436-779c47678-9dktm" event={"ID":"d76ce6d3-c5cc-4674-a025-87e4ee9e61fd","Type":"ContainerDied","Data":"b260b859899c432c50bd9625dbb057eefb3d5192adfc142e358b6d8ea2fd35ae"}
Jul 28 20:04:20.802094 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:20.802028    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-43e77436-779c47678-9dktm"
Jul 28 20:04:20.809173 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:20.809151    2570 scope.go:117] "RemoveContainer" containerID="417bba0174757306a1dcc3c45851e5f659d6ec1f06abe12bbf12e21d5778e925"
Jul 28 20:04:20.809488 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:04:20.809440    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"417bba0174757306a1dcc3c45851e5f659d6ec1f06abe12bbf12e21d5778e925\": container with ID starting with 417bba0174757306a1dcc3c45851e5f659d6ec1f06abe12bbf12e21d5778e925 not found: ID does not exist" containerID="417bba0174757306a1dcc3c45851e5f659d6ec1f06abe12bbf12e21d5778e925"
Jul 28 20:04:20.809488 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:20.809465    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"417bba0174757306a1dcc3c45851e5f659d6ec1f06abe12bbf12e21d5778e925"} err="failed to get container status \"417bba0174757306a1dcc3c45851e5f659d6ec1f06abe12bbf12e21d5778e925\": rpc error: code = NotFound desc = could not find container \"417bba0174757306a1dcc3c45851e5f659d6ec1f06abe12bbf12e21d5778e925\": container with ID starting with 417bba0174757306a1dcc3c45851e5f659d6ec1f06abe12bbf12e21d5778e925 not found: ID does not exist"
Jul 28 20:04:20.809488 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:20.809483    2570 scope.go:117] "RemoveContainer" containerID="f3524da91d90cec308349feed86b7876bb867e93f21ff06001982c6fbc32e749"
Jul 28 20:04:20.817479 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:20.817461    2570 scope.go:117] "RemoveContainer" containerID="f3524da91d90cec308349feed86b7876bb867e93f21ff06001982c6fbc32e749"
Jul 28 20:04:20.817776 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:04:20.817756    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3524da91d90cec308349feed86b7876bb867e93f21ff06001982c6fbc32e749\": container with ID starting with f3524da91d90cec308349feed86b7876bb867e93f21ff06001982c6fbc32e749 not found: ID does not exist" containerID="f3524da91d90cec308349feed86b7876bb867e93f21ff06001982c6fbc32e749"
Jul 28 20:04:20.817832 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:20.817784    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3524da91d90cec308349feed86b7876bb867e93f21ff06001982c6fbc32e749"} err="failed to get container status \"f3524da91d90cec308349feed86b7876bb867e93f21ff06001982c6fbc32e749\": rpc error: code = NotFound desc = could not find container \"f3524da91d90cec308349feed86b7876bb867e93f21ff06001982c6fbc32e749\": container with ID starting with f3524da91d90cec308349feed86b7876bb867e93f21ff06001982c6fbc32e749 not found: ID does not exist"
Jul 28 20:04:20.833838 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:20.833810    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-43e77436-779c47678-9dktm"]
Jul 28 20:04:20.836072 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:20.836049    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-43e77436-779c47678-9dktm"]
Jul 28 20:04:20.852054 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:20.852031    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-43e77436-7dc7d58b9b-nm8jd"]
Jul 28 20:04:20.855825 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:20.855801    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-43e77436-7dc7d58b9b-nm8jd"]
Jul 28 20:04:21.572327 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:21.572297    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28a97064-8a09-4441-915b-40b0d7780c3a" path="/var/lib/kubelet/pods/28a97064-8a09-4441-915b-40b0d7780c3a/volumes"
Jul 28 20:04:21.572659 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:21.572646    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68546462-3864-4b29-b514-979cccea8a91" path="/var/lib/kubelet/pods/68546462-3864-4b29-b514-979cccea8a91/volumes"
Jul 28 20:04:21.572951 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:21.572940    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d76ce6d3-c5cc-4674-a025-87e4ee9e61fd" path="/var/lib/kubelet/pods/d76ce6d3-c5cc-4674-a025-87e4ee9e61fd/volumes"
Jul 28 20:04:23.028762 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:23.028726    2570 patch_prober.go:28] interesting pod/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 28 20:04:23.029231 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:23.028794    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9" podUID="c886011c-d2db-46db-8b09-b149a260e452" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 20:04:25.355026 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.355000    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:04:25.523407 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.523357    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c886011c-d2db-46db-8b09-b149a260e452-credential-socket\") pod \"c886011c-d2db-46db-8b09-b149a260e452\" (UID: \"c886011c-d2db-46db-8b09-b149a260e452\") "
Jul 28 20:04:25.523407 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.523412    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c886011c-d2db-46db-8b09-b149a260e452-istio-podinfo\") pod \"c886011c-d2db-46db-8b09-b149a260e452\" (UID: \"c886011c-d2db-46db-8b09-b149a260e452\") "
Jul 28 20:04:25.523682 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.523454    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c886011c-d2db-46db-8b09-b149a260e452-workload-certs\") pod \"c886011c-d2db-46db-8b09-b149a260e452\" (UID: \"c886011c-d2db-46db-8b09-b149a260e452\") "
Jul 28 20:04:25.523682 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.523476    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c886011c-d2db-46db-8b09-b149a260e452-istiod-ca-cert\") pod \"c886011c-d2db-46db-8b09-b149a260e452\" (UID: \"c886011c-d2db-46db-8b09-b149a260e452\") "
Jul 28 20:04:25.523682 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.523494    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c886011c-d2db-46db-8b09-b149a260e452-istio-envoy\") pod \"c886011c-d2db-46db-8b09-b149a260e452\" (UID: \"c886011c-d2db-46db-8b09-b149a260e452\") "
Jul 28 20:04:25.523682 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.523527    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c886011c-d2db-46db-8b09-b149a260e452-istio-data\") pod \"c886011c-d2db-46db-8b09-b149a260e452\" (UID: \"c886011c-d2db-46db-8b09-b149a260e452\") "
Jul 28 20:04:25.523682 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.523584    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6mj2\" (UniqueName: \"kubernetes.io/projected/c886011c-d2db-46db-8b09-b149a260e452-kube-api-access-w6mj2\") pod \"c886011c-d2db-46db-8b09-b149a260e452\" (UID: \"c886011c-d2db-46db-8b09-b149a260e452\") "
Jul 28 20:04:25.523682 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.523645    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c886011c-d2db-46db-8b09-b149a260e452-istio-token\") pod \"c886011c-d2db-46db-8b09-b149a260e452\" (UID: \"c886011c-d2db-46db-8b09-b149a260e452\") "
Jul 28 20:04:25.524014 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.523696    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c886011c-d2db-46db-8b09-b149a260e452-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c886011c-d2db-46db-8b09-b149a260e452" (UID: "c886011c-d2db-46db-8b09-b149a260e452"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:04:25.524014 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.523752    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c886011c-d2db-46db-8b09-b149a260e452-workload-socket\") pod \"c886011c-d2db-46db-8b09-b149a260e452\" (UID: \"c886011c-d2db-46db-8b09-b149a260e452\") "
Jul 28 20:04:25.524014 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.523848    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c886011c-d2db-46db-8b09-b149a260e452-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c886011c-d2db-46db-8b09-b149a260e452" (UID: "c886011c-d2db-46db-8b09-b149a260e452"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:04:25.524194 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.524113    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c886011c-d2db-46db-8b09-b149a260e452-credential-socket\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:04:25.524194 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.524125    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c886011c-d2db-46db-8b09-b149a260e452-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c886011c-d2db-46db-8b09-b149a260e452" (UID: "c886011c-d2db-46db-8b09-b149a260e452"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:04:25.524194 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.524133    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c886011c-d2db-46db-8b09-b149a260e452-workload-certs\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:04:25.524194 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.524148    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c886011c-d2db-46db-8b09-b149a260e452-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c886011c-d2db-46db-8b09-b149a260e452" (UID: "c886011c-d2db-46db-8b09-b149a260e452"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:04:25.524792 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.524763    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c886011c-d2db-46db-8b09-b149a260e452-istio-data" (OuterVolumeSpecName: "istio-data") pod "c886011c-d2db-46db-8b09-b149a260e452" (UID: "c886011c-d2db-46db-8b09-b149a260e452"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:04:25.525835 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.525803    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c886011c-d2db-46db-8b09-b149a260e452-istio-token" (OuterVolumeSpecName: "istio-token") pod "c886011c-d2db-46db-8b09-b149a260e452" (UID: "c886011c-d2db-46db-8b09-b149a260e452"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:04:25.525835 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.525807    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c886011c-d2db-46db-8b09-b149a260e452-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c886011c-d2db-46db-8b09-b149a260e452" (UID: "c886011c-d2db-46db-8b09-b149a260e452"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:04:25.526084 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.525828    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c886011c-d2db-46db-8b09-b149a260e452-kube-api-access-w6mj2" (OuterVolumeSpecName: "kube-api-access-w6mj2") pod "c886011c-d2db-46db-8b09-b149a260e452" (UID: "c886011c-d2db-46db-8b09-b149a260e452"). InnerVolumeSpecName "kube-api-access-w6mj2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:04:25.526084 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.525847    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c886011c-d2db-46db-8b09-b149a260e452-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c886011c-d2db-46db-8b09-b149a260e452" (UID: "c886011c-d2db-46db-8b09-b149a260e452"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:04:25.624707 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.624675    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c886011c-d2db-46db-8b09-b149a260e452-istiod-ca-cert\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:04:25.624707 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.624704    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c886011c-d2db-46db-8b09-b149a260e452-istio-envoy\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:04:25.624707 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.624713    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c886011c-d2db-46db-8b09-b149a260e452-istio-data\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:04:25.625002 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.624725    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6mj2\" (UniqueName: \"kubernetes.io/projected/c886011c-d2db-46db-8b09-b149a260e452-kube-api-access-w6mj2\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:04:25.625002 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.624734    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c886011c-d2db-46db-8b09-b149a260e452-istio-token\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:04:25.625002 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.624742    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c886011c-d2db-46db-8b09-b149a260e452-workload-socket\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:04:25.625002 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.624750    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c886011c-d2db-46db-8b09-b149a260e452-istio-podinfo\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:04:25.830719 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.830631    2570 generic.go:356] "Generic (PLEG): container finished" podID="c886011c-d2db-46db-8b09-b149a260e452" containerID="20e097dbf3d90d4119bcd7e42a3cdd9270c5a78a56a4e7310f5ad5ecb0958af5" exitCode=0
Jul 28 20:04:25.830719 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.830684    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"
Jul 28 20:04:25.830899 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.830681    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9" event={"ID":"c886011c-d2db-46db-8b09-b149a260e452","Type":"ContainerDied","Data":"20e097dbf3d90d4119bcd7e42a3cdd9270c5a78a56a4e7310f5ad5ecb0958af5"}
Jul 28 20:04:25.830899 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.830808    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9" event={"ID":"c886011c-d2db-46db-8b09-b149a260e452","Type":"ContainerDied","Data":"ba7d6fc14973727453ecbf4a2110886edb9128cf79d33d84602a6d298095bb2e"}
Jul 28 20:04:25.830899 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.830842    2570 scope.go:117] "RemoveContainer" containerID="20e097dbf3d90d4119bcd7e42a3cdd9270c5a78a56a4e7310f5ad5ecb0958af5"
Jul 28 20:04:25.839150 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.839132    2570 scope.go:117] "RemoveContainer" containerID="87e11247e6fc4306b0451fe376b33c25c7adf3874111f963278e645cc30f4d9b"
Jul 28 20:04:25.846494 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.846476    2570 scope.go:117] "RemoveContainer" containerID="20e097dbf3d90d4119bcd7e42a3cdd9270c5a78a56a4e7310f5ad5ecb0958af5"
Jul 28 20:04:25.846758 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:04:25.846739    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20e097dbf3d90d4119bcd7e42a3cdd9270c5a78a56a4e7310f5ad5ecb0958af5\": container with ID starting with 20e097dbf3d90d4119bcd7e42a3cdd9270c5a78a56a4e7310f5ad5ecb0958af5 not found: ID does not exist" containerID="20e097dbf3d90d4119bcd7e42a3cdd9270c5a78a56a4e7310f5ad5ecb0958af5"
Jul 28 20:04:25.846830 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.846766    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20e097dbf3d90d4119bcd7e42a3cdd9270c5a78a56a4e7310f5ad5ecb0958af5"} err="failed to get container status \"20e097dbf3d90d4119bcd7e42a3cdd9270c5a78a56a4e7310f5ad5ecb0958af5\": rpc error: code = NotFound desc = could not find container \"20e097dbf3d90d4119bcd7e42a3cdd9270c5a78a56a4e7310f5ad5ecb0958af5\": container with ID starting with 20e097dbf3d90d4119bcd7e42a3cdd9270c5a78a56a4e7310f5ad5ecb0958af5 not found: ID does not exist"
Jul 28 20:04:25.846830 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.846784    2570 scope.go:117] "RemoveContainer" containerID="87e11247e6fc4306b0451fe376b33c25c7adf3874111f963278e645cc30f4d9b"
Jul 28 20:04:25.847023 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:04:25.847005    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87e11247e6fc4306b0451fe376b33c25c7adf3874111f963278e645cc30f4d9b\": container with ID starting with 87e11247e6fc4306b0451fe376b33c25c7adf3874111f963278e645cc30f4d9b not found: ID does not exist" containerID="87e11247e6fc4306b0451fe376b33c25c7adf3874111f963278e645cc30f4d9b"
Jul 28 20:04:25.847093 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.847028    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87e11247e6fc4306b0451fe376b33c25c7adf3874111f963278e645cc30f4d9b"} err="failed to get container status \"87e11247e6fc4306b0451fe376b33c25c7adf3874111f963278e645cc30f4d9b\": rpc error: code = NotFound desc = could not find container \"87e11247e6fc4306b0451fe376b33c25c7adf3874111f963278e645cc30f4d9b\": container with ID starting with 87e11247e6fc4306b0451fe376b33c25c7adf3874111f963278e645cc30f4d9b not found: ID does not exist"
Jul 28 20:04:25.850572 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.850549    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"]
Jul 28 20:04:25.858776 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:25.858756    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-43e77436-openshift-default-7cd94d94cb-vvjv9"]
Jul 28 20:04:27.573056 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:04:27.573023    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c886011c-d2db-46db-8b09-b149a260e452" path="/var/lib/kubelet/pods/c886011c-d2db-46db-8b09-b149a260e452/volumes"
Jul 28 20:06:04.196267 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.196237    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"]
Jul 28 20:06:04.196741 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.196587    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c886011c-d2db-46db-8b09-b149a260e452" containerName="istio-proxy"
Jul 28 20:06:04.196741 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.196600    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c886011c-d2db-46db-8b09-b149a260e452" containerName="istio-proxy"
Jul 28 20:06:04.196741 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.196609    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d76ce6d3-c5cc-4674-a025-87e4ee9e61fd" containerName="payload-processing"
Jul 28 20:06:04.196741 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.196616    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d76ce6d3-c5cc-4674-a025-87e4ee9e61fd" containerName="payload-processing"
Jul 28 20:06:04.196741 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.196634    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68546462-3864-4b29-b514-979cccea8a91" containerName="payload-pre-processing"
Jul 28 20:06:04.196741 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.196641    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="68546462-3864-4b29-b514-979cccea8a91" containerName="payload-pre-processing"
Jul 28 20:06:04.196741 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.196652    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28a97064-8a09-4441-915b-40b0d7780c3a" containerName="revoke-keys"
Jul 28 20:06:04.196741 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.196658    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="28a97064-8a09-4441-915b-40b0d7780c3a" containerName="revoke-keys"
Jul 28 20:06:04.196741 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.196710    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d76ce6d3-c5cc-4674-a025-87e4ee9e61fd" containerName="payload-processing"
Jul 28 20:06:04.196741 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.196719    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c886011c-d2db-46db-8b09-b149a260e452" containerName="istio-proxy"
Jul 28 20:06:04.196741 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.196726    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="68546462-3864-4b29-b514-979cccea8a91" containerName="payload-pre-processing"
Jul 28 20:06:04.196741 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.196732    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="28a97064-8a09-4441-915b-40b0d7780c3a" containerName="revoke-keys"
Jul 28 20:06:04.196741 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.196737    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c886011c-d2db-46db-8b09-b149a260e452" containerName="istio-proxy"
Jul 28 20:06:04.199686 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.199668    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:06:04.202183 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.202161    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-1ca5d531-openshift-default-dockercfg-f5p5h\""
Jul 28 20:06:04.220789 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.220758    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"]
Jul 28 20:06:04.263351 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.263316    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41bd0843-1f3f-45a9-902a-d69ca07235e5-istio-podinfo\") pod \"e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc\" (UID: \"41bd0843-1f3f-45a9-902a-d69ca07235e5\") " pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:06:04.263509 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.263361    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj62n\" (UniqueName: \"kubernetes.io/projected/41bd0843-1f3f-45a9-902a-d69ca07235e5-kube-api-access-vj62n\") pod \"e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc\" (UID: \"41bd0843-1f3f-45a9-902a-d69ca07235e5\") " pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:06:04.263509 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.263426    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41bd0843-1f3f-45a9-902a-d69ca07235e5-istio-token\") pod \"e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc\" (UID: \"41bd0843-1f3f-45a9-902a-d69ca07235e5\") " pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:06:04.263509 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.263462    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41bd0843-1f3f-45a9-902a-d69ca07235e5-workload-socket\") pod \"e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc\" (UID: \"41bd0843-1f3f-45a9-902a-d69ca07235e5\") " pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:06:04.263509 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.263483    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41bd0843-1f3f-45a9-902a-d69ca07235e5-workload-certs\") pod \"e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc\" (UID: \"41bd0843-1f3f-45a9-902a-d69ca07235e5\") " pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:06:04.263509 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.263506    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41bd0843-1f3f-45a9-902a-d69ca07235e5-istio-envoy\") pod \"e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc\" (UID: \"41bd0843-1f3f-45a9-902a-d69ca07235e5\") " pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:06:04.263679 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.263539    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41bd0843-1f3f-45a9-902a-d69ca07235e5-credential-socket\") pod \"e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc\" (UID: \"41bd0843-1f3f-45a9-902a-d69ca07235e5\") " pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:06:04.263679 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.263612    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41bd0843-1f3f-45a9-902a-d69ca07235e5-istiod-ca-cert\") pod \"e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc\" (UID: \"41bd0843-1f3f-45a9-902a-d69ca07235e5\") " pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:06:04.263679 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.263646    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41bd0843-1f3f-45a9-902a-d69ca07235e5-istio-data\") pod \"e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc\" (UID: \"41bd0843-1f3f-45a9-902a-d69ca07235e5\") " pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:06:04.365000 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.364946    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41bd0843-1f3f-45a9-902a-d69ca07235e5-istio-token\") pod \"e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc\" (UID: \"41bd0843-1f3f-45a9-902a-d69ca07235e5\") " pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:06:04.365181 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.365008    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41bd0843-1f3f-45a9-902a-d69ca07235e5-workload-socket\") pod \"e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc\" (UID: \"41bd0843-1f3f-45a9-902a-d69ca07235e5\") " pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:06:04.365181 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.365040    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41bd0843-1f3f-45a9-902a-d69ca07235e5-workload-certs\") pod \"e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc\" (UID: \"41bd0843-1f3f-45a9-902a-d69ca07235e5\") " pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:06:04.365181 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.365072    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41bd0843-1f3f-45a9-902a-d69ca07235e5-istio-envoy\") pod \"e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc\" (UID: \"41bd0843-1f3f-45a9-902a-d69ca07235e5\") " pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:06:04.365306 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.365196    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41bd0843-1f3f-45a9-902a-d69ca07235e5-credential-socket\") pod \"e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc\" (UID: \"41bd0843-1f3f-45a9-902a-d69ca07235e5\") " pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:06:04.365306 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.365237    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41bd0843-1f3f-45a9-902a-d69ca07235e5-istiod-ca-cert\") pod \"e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc\" (UID: \"41bd0843-1f3f-45a9-902a-d69ca07235e5\") " pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:06:04.365306 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.365263    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41bd0843-1f3f-45a9-902a-d69ca07235e5-istio-data\") pod \"e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc\" (UID: \"41bd0843-1f3f-45a9-902a-d69ca07235e5\") " pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:06:04.365306 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.365303    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41bd0843-1f3f-45a9-902a-d69ca07235e5-istio-podinfo\") pod \"e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc\" (UID: \"41bd0843-1f3f-45a9-902a-d69ca07235e5\") " pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:06:04.365493 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.365457    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41bd0843-1f3f-45a9-902a-d69ca07235e5-workload-socket\") pod \"e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc\" (UID: \"41bd0843-1f3f-45a9-902a-d69ca07235e5\") " pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:06:04.365549 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.365487    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj62n\" (UniqueName: \"kubernetes.io/projected/41bd0843-1f3f-45a9-902a-d69ca07235e5-kube-api-access-vj62n\") pod \"e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc\" (UID: \"41bd0843-1f3f-45a9-902a-d69ca07235e5\") " pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:06:04.365549 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.365534    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41bd0843-1f3f-45a9-902a-d69ca07235e5-workload-certs\") pod \"e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc\" (UID: \"41bd0843-1f3f-45a9-902a-d69ca07235e5\") " pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:06:04.365672 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.365648    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41bd0843-1f3f-45a9-902a-d69ca07235e5-credential-socket\") pod \"e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc\" (UID: \"41bd0843-1f3f-45a9-902a-d69ca07235e5\") " pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:06:04.365805 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.365788    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41bd0843-1f3f-45a9-902a-d69ca07235e5-istio-data\") pod \"e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc\" (UID: \"41bd0843-1f3f-45a9-902a-d69ca07235e5\") " pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:06:04.366006 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.365989    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41bd0843-1f3f-45a9-902a-d69ca07235e5-istiod-ca-cert\") pod \"e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc\" (UID: \"41bd0843-1f3f-45a9-902a-d69ca07235e5\") " pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:06:04.368099 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.368073    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41bd0843-1f3f-45a9-902a-d69ca07235e5-istio-envoy\") pod \"e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc\" (UID: \"41bd0843-1f3f-45a9-902a-d69ca07235e5\") " pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:06:04.368274 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.368258    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41bd0843-1f3f-45a9-902a-d69ca07235e5-istio-podinfo\") pod \"e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc\" (UID: \"41bd0843-1f3f-45a9-902a-d69ca07235e5\") " pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:06:04.372534 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.372513    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41bd0843-1f3f-45a9-902a-d69ca07235e5-istio-token\") pod \"e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc\" (UID: \"41bd0843-1f3f-45a9-902a-d69ca07235e5\") " pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:06:04.373183 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.373167    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj62n\" (UniqueName: \"kubernetes.io/projected/41bd0843-1f3f-45a9-902a-d69ca07235e5-kube-api-access-vj62n\") pod \"e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc\" (UID: \"41bd0843-1f3f-45a9-902a-d69ca07235e5\") " pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:06:04.510227 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.510139    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:06:04.638730 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.638705    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"]
Jul 28 20:06:04.641488 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:06:04.641460    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41bd0843_1f3f_45a9_902a_d69ca07235e5.slice/crio-10c599eb53c7b31162fc6cee3e99b7ad7b0bc4838501c4530b2a1db13e55e694 WatchSource:0}: Error finding container 10c599eb53c7b31162fc6cee3e99b7ad7b0bc4838501c4530b2a1db13e55e694: Status 404 returned error can't find the container with id 10c599eb53c7b31162fc6cee3e99b7ad7b0bc4838501c4530b2a1db13e55e694
Jul 28 20:06:04.644069 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.644034    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:06:04.644156 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.644100    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:06:04.644156 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:04.644128    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:06:05.255609 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:05.255570    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc" event={"ID":"41bd0843-1f3f-45a9-902a-d69ca07235e5","Type":"ContainerStarted","Data":"89dc2ce1cc1c10cec0a4bce79f0a9fc0eca6f7c89169edced73584473025c4e4"}
Jul 28 20:06:05.256148 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:05.255646    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc" event={"ID":"41bd0843-1f3f-45a9-902a-d69ca07235e5","Type":"ContainerStarted","Data":"10c599eb53c7b31162fc6cee3e99b7ad7b0bc4838501c4530b2a1db13e55e694"}
Jul 28 20:06:05.278944 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:05.278893    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc" podStartSLOduration=1.278876655 podStartE2EDuration="1.278876655s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:06:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:06:05.277624886 +0000 UTC m=+2178.229657217" watchObservedRunningTime="2026-07-28 20:06:05.278876655 +0000 UTC m=+2178.230908984"
Jul 28 20:06:05.510400 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:05.510319    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:06:05.515117 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:05.515088    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:06:06.260075 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:06.260045    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:06:06.260993 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:06.260960    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:06:08.021586 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:08.021557    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1ca5d531-7c887bfff6-tgcmc"]
Jul 28 20:06:08.021992 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:08.021856    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c886011c-d2db-46db-8b09-b149a260e452" containerName="istio-proxy"
Jul 28 20:06:08.021992 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:08.021867    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c886011c-d2db-46db-8b09-b149a260e452" containerName="istio-proxy"
Jul 28 20:06:08.024877 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:08.024846    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1ca5d531-7c887bfff6-tgcmc"
Jul 28 20:06:08.027912 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:08.027888    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-1ca5d531\""
Jul 28 20:06:08.028048 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:08.027920    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-1ca5d531-dockercfg-m6k8x\""
Jul 28 20:06:08.039606 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:08.039568    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1ca5d531-7c887bfff6-tgcmc"]
Jul 28 20:06:08.051313 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:08.051282    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-1ca5d531-d7bb8f4b-t9lcg"]
Jul 28 20:06:08.061638 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:08.061613    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-1ca5d531-d7bb8f4b-t9lcg"
Jul 28 20:06:08.066599 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:08.066575    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-1ca5d531-d7bb8f4b-t9lcg"]
Jul 28 20:06:08.101887 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:08.101849    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlgr9\" (UniqueName: \"kubernetes.io/projected/97894dfe-834f-4a4e-8897-d975a769cdb5-kube-api-access-qlgr9\") pod \"payload-pre-processing-e2e-mt-1ca5d531-7c887bfff6-tgcmc\" (UID: \"97894dfe-834f-4a4e-8897-d975a769cdb5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1ca5d531-7c887bfff6-tgcmc"
Jul 28 20:06:08.102047 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:08.101923    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97894dfe-834f-4a4e-8897-d975a769cdb5-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-1ca5d531-7c887bfff6-tgcmc\" (UID: \"97894dfe-834f-4a4e-8897-d975a769cdb5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1ca5d531-7c887bfff6-tgcmc"
Jul 28 20:06:08.203375 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:08.203339    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlgr9\" (UniqueName: \"kubernetes.io/projected/97894dfe-834f-4a4e-8897-d975a769cdb5-kube-api-access-qlgr9\") pod \"payload-pre-processing-e2e-mt-1ca5d531-7c887bfff6-tgcmc\" (UID: \"97894dfe-834f-4a4e-8897-d975a769cdb5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1ca5d531-7c887bfff6-tgcmc"
Jul 28 20:06:08.203375 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:08.203384    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97894dfe-834f-4a4e-8897-d975a769cdb5-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-1ca5d531-7c887bfff6-tgcmc\" (UID: \"97894dfe-834f-4a4e-8897-d975a769cdb5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1ca5d531-7c887bfff6-tgcmc"
Jul 28 20:06:08.203663 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:08.203518    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkbzx\" (UniqueName: \"kubernetes.io/projected/985f3f59-a573-4af5-8271-eaa0b79e886b-kube-api-access-xkbzx\") pod \"payload-processing-e2e-mt-1ca5d531-d7bb8f4b-t9lcg\" (UID: \"985f3f59-a573-4af5-8271-eaa0b79e886b\") " pod="openshift-ingress/payload-processing-e2e-mt-1ca5d531-d7bb8f4b-t9lcg"
Jul 28 20:06:08.203663 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:08.203643    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/985f3f59-a573-4af5-8271-eaa0b79e886b-plugins-config-volume\") pod \"payload-processing-e2e-mt-1ca5d531-d7bb8f4b-t9lcg\" (UID: \"985f3f59-a573-4af5-8271-eaa0b79e886b\") " pod="openshift-ingress/payload-processing-e2e-mt-1ca5d531-d7bb8f4b-t9lcg"
Jul 28 20:06:08.204094 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:08.204074    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97894dfe-834f-4a4e-8897-d975a769cdb5-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-1ca5d531-7c887bfff6-tgcmc\" (UID: \"97894dfe-834f-4a4e-8897-d975a769cdb5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1ca5d531-7c887bfff6-tgcmc"
Jul 28 20:06:08.211393 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:08.211366    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlgr9\" (UniqueName: \"kubernetes.io/projected/97894dfe-834f-4a4e-8897-d975a769cdb5-kube-api-access-qlgr9\") pod \"payload-pre-processing-e2e-mt-1ca5d531-7c887bfff6-tgcmc\" (UID: \"97894dfe-834f-4a4e-8897-d975a769cdb5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1ca5d531-7c887bfff6-tgcmc"
Jul 28 20:06:08.305079 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:08.304997    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/985f3f59-a573-4af5-8271-eaa0b79e886b-plugins-config-volume\") pod \"payload-processing-e2e-mt-1ca5d531-d7bb8f4b-t9lcg\" (UID: \"985f3f59-a573-4af5-8271-eaa0b79e886b\") " pod="openshift-ingress/payload-processing-e2e-mt-1ca5d531-d7bb8f4b-t9lcg"
Jul 28 20:06:08.305079 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:08.305068    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkbzx\" (UniqueName: \"kubernetes.io/projected/985f3f59-a573-4af5-8271-eaa0b79e886b-kube-api-access-xkbzx\") pod \"payload-processing-e2e-mt-1ca5d531-d7bb8f4b-t9lcg\" (UID: \"985f3f59-a573-4af5-8271-eaa0b79e886b\") " pod="openshift-ingress/payload-processing-e2e-mt-1ca5d531-d7bb8f4b-t9lcg"
Jul 28 20:06:08.305733 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:08.305713    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/985f3f59-a573-4af5-8271-eaa0b79e886b-plugins-config-volume\") pod \"payload-processing-e2e-mt-1ca5d531-d7bb8f4b-t9lcg\" (UID: \"985f3f59-a573-4af5-8271-eaa0b79e886b\") " pod="openshift-ingress/payload-processing-e2e-mt-1ca5d531-d7bb8f4b-t9lcg"
Jul 28 20:06:08.312880 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:08.312850    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkbzx\" (UniqueName: \"kubernetes.io/projected/985f3f59-a573-4af5-8271-eaa0b79e886b-kube-api-access-xkbzx\") pod \"payload-processing-e2e-mt-1ca5d531-d7bb8f4b-t9lcg\" (UID: \"985f3f59-a573-4af5-8271-eaa0b79e886b\") " pod="openshift-ingress/payload-processing-e2e-mt-1ca5d531-d7bb8f4b-t9lcg"
Jul 28 20:06:08.335926 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:08.335901    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1ca5d531-7c887bfff6-tgcmc"
Jul 28 20:06:08.373237 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:08.373196    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-1ca5d531-d7bb8f4b-t9lcg"
Jul 28 20:06:08.482570 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:08.482540    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1ca5d531-7c887bfff6-tgcmc"]
Jul 28 20:06:08.484420 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:06:08.484389    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97894dfe_834f_4a4e_8897_d975a769cdb5.slice/crio-1bd7f8ee9c754b892c9381f1ab40e2a14d8a8182048b6a43430df1f2fe2bbef3 WatchSource:0}: Error finding container 1bd7f8ee9c754b892c9381f1ab40e2a14d8a8182048b6a43430df1f2fe2bbef3: Status 404 returned error can't find the container with id 1bd7f8ee9c754b892c9381f1ab40e2a14d8a8182048b6a43430df1f2fe2bbef3
Jul 28 20:06:08.527206 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:08.527181    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-1ca5d531-d7bb8f4b-t9lcg"]
Jul 28 20:06:08.538092 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:06:08.538064    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod985f3f59_a573_4af5_8271_eaa0b79e886b.slice/crio-a250d56d75addfbbc55df817a5d3fee993bbe36a5d61001ea1e94bda5d82e05f WatchSource:0}: Error finding container a250d56d75addfbbc55df817a5d3fee993bbe36a5d61001ea1e94bda5d82e05f: Status 404 returned error can't find the container with id a250d56d75addfbbc55df817a5d3fee993bbe36a5d61001ea1e94bda5d82e05f
Jul 28 20:06:09.274654 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:09.274612    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-1ca5d531-d7bb8f4b-t9lcg" event={"ID":"985f3f59-a573-4af5-8271-eaa0b79e886b","Type":"ContainerStarted","Data":"a45ad74cabe69e49b139116b0596b24f43e4c0519be6fa75b88b6e92675e15d0"}
Jul 28 20:06:09.275110 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:09.274674    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-1ca5d531-d7bb8f4b-t9lcg" event={"ID":"985f3f59-a573-4af5-8271-eaa0b79e886b","Type":"ContainerStarted","Data":"a250d56d75addfbbc55df817a5d3fee993bbe36a5d61001ea1e94bda5d82e05f"}
Jul 28 20:06:09.275110 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:09.274700    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-1ca5d531-d7bb8f4b-t9lcg"
Jul 28 20:06:09.276159 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:09.276131    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1ca5d531-7c887bfff6-tgcmc" event={"ID":"97894dfe-834f-4a4e-8897-d975a769cdb5","Type":"ContainerStarted","Data":"47842508f1670a5c28bdf5c02233c311f8ce211f59e77ec5e48be449ab93cad8"}
Jul 28 20:06:09.276284 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:09.276172    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1ca5d531-7c887bfff6-tgcmc" event={"ID":"97894dfe-834f-4a4e-8897-d975a769cdb5","Type":"ContainerStarted","Data":"1bd7f8ee9c754b892c9381f1ab40e2a14d8a8182048b6a43430df1f2fe2bbef3"}
Jul 28 20:06:09.276284 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:09.276207    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-1ca5d531-7c887bfff6-tgcmc"
Jul 28 20:06:09.302564 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:09.302505    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-1ca5d531-d7bb8f4b-t9lcg" podStartSLOduration=1.302486446 podStartE2EDuration="1.302486446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:06:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:06:09.299173794 +0000 UTC m=+2182.251206154" watchObservedRunningTime="2026-07-28 20:06:09.302486446 +0000 UTC m=+2182.254518782"
Jul 28 20:06:09.315708 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:09.315652    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-1ca5d531-7c887bfff6-tgcmc" podStartSLOduration=2.315629768 podStartE2EDuration="2.315629768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:06:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:06:09.313303973 +0000 UTC m=+2182.265336303" watchObservedRunningTime="2026-07-28 20:06:09.315629768 +0000 UTC m=+2182.267662101"
Jul 28 20:06:17.318989 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:17.318940    2570 generic.go:356] "Generic (PLEG): container finished" podID="41bd0843-1f3f-45a9-902a-d69ca07235e5" containerID="89dc2ce1cc1c10cec0a4bce79f0a9fc0eca6f7c89169edced73584473025c4e4" exitCode=0
Jul 28 20:06:17.319583 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:17.319015    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc" event={"ID":"41bd0843-1f3f-45a9-902a-d69ca07235e5","Type":"ContainerDied","Data":"89dc2ce1cc1c10cec0a4bce79f0a9fc0eca6f7c89169edced73584473025c4e4"}
Jul 28 20:06:17.319583 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:17.319416    2570 scope.go:117] "RemoveContainer" containerID="89dc2ce1cc1c10cec0a4bce79f0a9fc0eca6f7c89169edced73584473025c4e4"
Jul 28 20:06:17.320529 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:17.320498    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:06:17.320601 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:17.320585    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:06:17.320644 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:17.320631    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:06:18.326202 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:18.326161    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc" event={"ID":"41bd0843-1f3f-45a9-902a-d69ca07235e5","Type":"ContainerStarted","Data":"8ade7eca36039af29a0c8bf29a116c53180ac3cd2b051193f502316c470830aa"}
Jul 28 20:06:18.512611 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:18.512574    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:06:18.512820 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:18.512738    2570 patch_prober.go:28] interesting pod/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 28 20:06:18.512820 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:18.512785    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc" podUID="41bd0843-1f3f-45a9-902a-d69ca07235e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 28 20:06:19.511355 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:19.511301    2570 patch_prober.go:28] interesting pod/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 28 20:06:19.511874 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:19.511378    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc" podUID="41bd0843-1f3f-45a9-902a-d69ca07235e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 28 20:06:20.282713 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:20.282683    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-1ca5d531-d7bb8f4b-t9lcg"
Jul 28 20:06:20.282886 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:20.282760    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-1ca5d531-7c887bfff6-tgcmc"
Jul 28 20:06:20.511322 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:20.511268    2570 patch_prober.go:28] interesting pod/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 28 20:06:20.512047 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:20.511624    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc" podUID="41bd0843-1f3f-45a9-902a-d69ca07235e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 28 20:06:21.260843 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:21.260806    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:06:21.511837 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:21.511327    2570 patch_prober.go:28] interesting pod/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 28 20:06:21.511837 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:21.511392    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc" podUID="41bd0843-1f3f-45a9-902a-d69ca07235e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 28 20:06:22.511319 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:22.511269    2570 patch_prober.go:28] interesting pod/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 28 20:06:22.511738 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:22.511338    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc" podUID="41bd0843-1f3f-45a9-902a-d69ca07235e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 28 20:06:23.514763 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:23.514731    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:06:23.515775 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:23.515754    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:06:39.832601 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:39.832567    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1ca5d531-hjpd2"]
Jul 28 20:06:39.835922 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:39.835901    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1ca5d531-hjpd2"
Jul 28 20:06:39.838217 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:39.838194    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z6zs4\""
Jul 28 20:06:39.844482 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:39.844457    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1ca5d531-hjpd2"]
Jul 28 20:06:39.884365 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:39.884331    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/658e4c36-93f0-4cc2-a9f0-7ec18fbf9408-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1ca5d531-hjpd2\" (UID: \"658e4c36-93f0-4cc2-a9f0-7ec18fbf9408\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1ca5d531-hjpd2"
Jul 28 20:06:39.985113 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:39.985073    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/658e4c36-93f0-4cc2-a9f0-7ec18fbf9408-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1ca5d531-hjpd2\" (UID: \"658e4c36-93f0-4cc2-a9f0-7ec18fbf9408\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1ca5d531-hjpd2"
Jul 28 20:06:39.985736 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:39.985716    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/658e4c36-93f0-4cc2-a9f0-7ec18fbf9408-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1ca5d531-hjpd2\" (UID: \"658e4c36-93f0-4cc2-a9f0-7ec18fbf9408\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1ca5d531-hjpd2"
Jul 28 20:06:40.147520 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:40.147430    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1ca5d531-hjpd2"
Jul 28 20:06:40.284384 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:40.284350    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1ca5d531-hjpd2"]
Jul 28 20:06:40.287328 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:06:40.287293    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod658e4c36_93f0_4cc2_a9f0_7ec18fbf9408.slice/crio-02450c0a62059ca7d6a3969d976e203634e525e58a96c224594ba2b1a786d6fa WatchSource:0}: Error finding container 02450c0a62059ca7d6a3969d976e203634e525e58a96c224594ba2b1a786d6fa: Status 404 returned error can't find the container with id 02450c0a62059ca7d6a3969d976e203634e525e58a96c224594ba2b1a786d6fa
Jul 28 20:06:40.433210 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:40.433178    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1ca5d531-hjpd2" event={"ID":"658e4c36-93f0-4cc2-a9f0-7ec18fbf9408","Type":"ContainerStarted","Data":"02450c0a62059ca7d6a3969d976e203634e525e58a96c224594ba2b1a786d6fa"}
Jul 28 20:06:41.439281 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:41.439240    2570 generic.go:356] "Generic (PLEG): container finished" podID="658e4c36-93f0-4cc2-a9f0-7ec18fbf9408" containerID="96590766becfa1eea7424570cf322fb121bfd8a098b1cd5736d3a7d5c798e1d9" exitCode=0
Jul 28 20:06:41.439680 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:41.439327    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1ca5d531-hjpd2" event={"ID":"658e4c36-93f0-4cc2-a9f0-7ec18fbf9408","Type":"ContainerDied","Data":"96590766becfa1eea7424570cf322fb121bfd8a098b1cd5736d3a7d5c798e1d9"}
Jul 28 20:06:42.571084 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:42.571056    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1ca5d531-hjpd2"
Jul 28 20:06:42.712884 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:42.712776    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/658e4c36-93f0-4cc2-a9f0-7ec18fbf9408-maas-api-service-ca\") pod \"658e4c36-93f0-4cc2-a9f0-7ec18fbf9408\" (UID: \"658e4c36-93f0-4cc2-a9f0-7ec18fbf9408\") "
Jul 28 20:06:42.713197 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:42.713175    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/658e4c36-93f0-4cc2-a9f0-7ec18fbf9408-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "658e4c36-93f0-4cc2-a9f0-7ec18fbf9408" (UID: "658e4c36-93f0-4cc2-a9f0-7ec18fbf9408"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:06:42.814447 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:42.814409    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/658e4c36-93f0-4cc2-a9f0-7ec18fbf9408-maas-api-service-ca\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:06:43.448782 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:43.448749    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1ca5d531-hjpd2"
Jul 28 20:06:43.448963 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:43.448749    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1ca5d531-hjpd2" event={"ID":"658e4c36-93f0-4cc2-a9f0-7ec18fbf9408","Type":"ContainerDied","Data":"02450c0a62059ca7d6a3969d976e203634e525e58a96c224594ba2b1a786d6fa"}
Jul 28 20:06:43.448963 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:43.448882    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="02450c0a62059ca7d6a3969d976e203634e525e58a96c224594ba2b1a786d6fa"
Jul 28 20:06:50.290126 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:50.290091    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-1ca5d531-d7bb8f4b-t9lcg"]
Jul 28 20:06:50.290754 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:50.290327    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-1ca5d531-d7bb8f4b-t9lcg" podUID="985f3f59-a573-4af5-8271-eaa0b79e886b" containerName="payload-processing" containerID="cri-o://a45ad74cabe69e49b139116b0596b24f43e4c0519be6fa75b88b6e92675e15d0" gracePeriod=30
Jul 28 20:06:50.318868 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:50.318830    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1ca5d531-7c887bfff6-tgcmc"]
Jul 28 20:06:50.319275 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:50.319092    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-1ca5d531-7c887bfff6-tgcmc" podUID="97894dfe-834f-4a4e-8897-d975a769cdb5" containerName="payload-pre-processing" containerID="cri-o://47842508f1670a5c28bdf5c02233c311f8ce211f59e77ec5e48be449ab93cad8" gracePeriod=30
Jul 28 20:06:50.483851 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:50.483759    2570 generic.go:356] "Generic (PLEG): container finished" podID="985f3f59-a573-4af5-8271-eaa0b79e886b" containerID="a45ad74cabe69e49b139116b0596b24f43e4c0519be6fa75b88b6e92675e15d0" exitCode=0
Jul 28 20:06:50.483851 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:50.483828    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-1ca5d531-d7bb8f4b-t9lcg" event={"ID":"985f3f59-a573-4af5-8271-eaa0b79e886b","Type":"ContainerDied","Data":"a45ad74cabe69e49b139116b0596b24f43e4c0519be6fa75b88b6e92675e15d0"}
Jul 28 20:06:50.485744 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:50.485720    2570 generic.go:356] "Generic (PLEG): container finished" podID="97894dfe-834f-4a4e-8897-d975a769cdb5" containerID="47842508f1670a5c28bdf5c02233c311f8ce211f59e77ec5e48be449ab93cad8" exitCode=0
Jul 28 20:06:50.485874 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:50.485758    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1ca5d531-7c887bfff6-tgcmc" event={"ID":"97894dfe-834f-4a4e-8897-d975a769cdb5","Type":"ContainerDied","Data":"47842508f1670a5c28bdf5c02233c311f8ce211f59e77ec5e48be449ab93cad8"}
Jul 28 20:06:50.546279 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:50.546201    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1ca5d531-hjpd2"]
Jul 28 20:06:50.549434 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:50.549403    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1ca5d531-hjpd2"]
Jul 28 20:06:50.587143 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:50.587115    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-1ca5d531-d7bb8f4b-t9lcg"
Jul 28 20:06:50.589783 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:50.589767    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1ca5d531-7c887bfff6-tgcmc"
Jul 28 20:06:50.683548 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:50.683514    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkbzx\" (UniqueName: \"kubernetes.io/projected/985f3f59-a573-4af5-8271-eaa0b79e886b-kube-api-access-xkbzx\") pod \"985f3f59-a573-4af5-8271-eaa0b79e886b\" (UID: \"985f3f59-a573-4af5-8271-eaa0b79e886b\") "
Jul 28 20:06:50.683548 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:50.683551    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97894dfe-834f-4a4e-8897-d975a769cdb5-plugins-config-volume\") pod \"97894dfe-834f-4a4e-8897-d975a769cdb5\" (UID: \"97894dfe-834f-4a4e-8897-d975a769cdb5\") "
Jul 28 20:06:50.683738 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:50.683601    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qlgr9\" (UniqueName: \"kubernetes.io/projected/97894dfe-834f-4a4e-8897-d975a769cdb5-kube-api-access-qlgr9\") pod \"97894dfe-834f-4a4e-8897-d975a769cdb5\" (UID: \"97894dfe-834f-4a4e-8897-d975a769cdb5\") "
Jul 28 20:06:50.683738 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:50.683711    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/985f3f59-a573-4af5-8271-eaa0b79e886b-plugins-config-volume\") pod \"985f3f59-a573-4af5-8271-eaa0b79e886b\" (UID: \"985f3f59-a573-4af5-8271-eaa0b79e886b\") "
Jul 28 20:06:50.684057 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:50.684034    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97894dfe-834f-4a4e-8897-d975a769cdb5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "97894dfe-834f-4a4e-8897-d975a769cdb5" (UID: "97894dfe-834f-4a4e-8897-d975a769cdb5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:06:50.684170 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:50.684098    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/985f3f59-a573-4af5-8271-eaa0b79e886b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "985f3f59-a573-4af5-8271-eaa0b79e886b" (UID: "985f3f59-a573-4af5-8271-eaa0b79e886b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:06:50.685655 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:50.685635    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97894dfe-834f-4a4e-8897-d975a769cdb5-kube-api-access-qlgr9" (OuterVolumeSpecName: "kube-api-access-qlgr9") pod "97894dfe-834f-4a4e-8897-d975a769cdb5" (UID: "97894dfe-834f-4a4e-8897-d975a769cdb5"). InnerVolumeSpecName "kube-api-access-qlgr9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:06:50.685757 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:50.685671    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/985f3f59-a573-4af5-8271-eaa0b79e886b-kube-api-access-xkbzx" (OuterVolumeSpecName: "kube-api-access-xkbzx") pod "985f3f59-a573-4af5-8271-eaa0b79e886b" (UID: "985f3f59-a573-4af5-8271-eaa0b79e886b"). InnerVolumeSpecName "kube-api-access-xkbzx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:06:50.784660 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:50.784627    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlgr9\" (UniqueName: \"kubernetes.io/projected/97894dfe-834f-4a4e-8897-d975a769cdb5-kube-api-access-qlgr9\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:06:50.784660 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:50.784653    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/985f3f59-a573-4af5-8271-eaa0b79e886b-plugins-config-volume\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:06:50.784660 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:50.784662    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkbzx\" (UniqueName: \"kubernetes.io/projected/985f3f59-a573-4af5-8271-eaa0b79e886b-kube-api-access-xkbzx\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:06:50.784886 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:50.784672    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97894dfe-834f-4a4e-8897-d975a769cdb5-plugins-config-volume\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:06:51.497442 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:51.497408    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-1ca5d531-d7bb8f4b-t9lcg"
Jul 28 20:06:51.497442 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:51.497426    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-1ca5d531-d7bb8f4b-t9lcg" event={"ID":"985f3f59-a573-4af5-8271-eaa0b79e886b","Type":"ContainerDied","Data":"a250d56d75addfbbc55df817a5d3fee993bbe36a5d61001ea1e94bda5d82e05f"}
Jul 28 20:06:51.497936 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:51.497506    2570 scope.go:117] "RemoveContainer" containerID="a45ad74cabe69e49b139116b0596b24f43e4c0519be6fa75b88b6e92675e15d0"
Jul 28 20:06:51.498824 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:51.498789    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1ca5d531-7c887bfff6-tgcmc" event={"ID":"97894dfe-834f-4a4e-8897-d975a769cdb5","Type":"ContainerDied","Data":"1bd7f8ee9c754b892c9381f1ab40e2a14d8a8182048b6a43430df1f2fe2bbef3"}
Jul 28 20:06:51.498909 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:51.498850    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1ca5d531-7c887bfff6-tgcmc"
Jul 28 20:06:51.507159 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:51.507145    2570 scope.go:117] "RemoveContainer" containerID="47842508f1670a5c28bdf5c02233c311f8ce211f59e77ec5e48be449ab93cad8"
Jul 28 20:06:51.521508 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:51.521486    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1ca5d531-7c887bfff6-tgcmc"]
Jul 28 20:06:51.528519 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:51.528496    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1ca5d531-7c887bfff6-tgcmc"]
Jul 28 20:06:51.537770 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:51.537750    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-1ca5d531-d7bb8f4b-t9lcg"]
Jul 28 20:06:51.545510 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:51.545491    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-1ca5d531-d7bb8f4b-t9lcg"]
Jul 28 20:06:51.571906 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:51.571881    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="658e4c36-93f0-4cc2-a9f0-7ec18fbf9408" path="/var/lib/kubelet/pods/658e4c36-93f0-4cc2-a9f0-7ec18fbf9408/volumes"
Jul 28 20:06:51.572287 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:51.572271    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97894dfe-834f-4a4e-8897-d975a769cdb5" path="/var/lib/kubelet/pods/97894dfe-834f-4a4e-8897-d975a769cdb5/volumes"
Jul 28 20:06:51.572582 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:51.572571    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="985f3f59-a573-4af5-8271-eaa0b79e886b" path="/var/lib/kubelet/pods/985f3f59-a573-4af5-8271-eaa0b79e886b/volumes"
Jul 28 20:06:56.839234 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:56.839198    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"]
Jul 28 20:06:56.839690 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:06:56.839499    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc" podUID="41bd0843-1f3f-45a9-902a-d69ca07235e5" containerName="istio-proxy" containerID="cri-o://8ade7eca36039af29a0c8bf29a116c53180ac3cd2b051193f502316c470830aa" gracePeriod=30
Jul 28 20:07:02.087691 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.087662    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:07:02.186922 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.186895    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41bd0843-1f3f-45a9-902a-d69ca07235e5-istiod-ca-cert\") pod \"41bd0843-1f3f-45a9-902a-d69ca07235e5\" (UID: \"41bd0843-1f3f-45a9-902a-d69ca07235e5\") "
Jul 28 20:07:02.186922 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.186929    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41bd0843-1f3f-45a9-902a-d69ca07235e5-istio-podinfo\") pod \"41bd0843-1f3f-45a9-902a-d69ca07235e5\" (UID: \"41bd0843-1f3f-45a9-902a-d69ca07235e5\") "
Jul 28 20:07:02.187151 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.187009    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41bd0843-1f3f-45a9-902a-d69ca07235e5-istio-data\") pod \"41bd0843-1f3f-45a9-902a-d69ca07235e5\" (UID: \"41bd0843-1f3f-45a9-902a-d69ca07235e5\") "
Jul 28 20:07:02.187151 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.187032    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41bd0843-1f3f-45a9-902a-d69ca07235e5-workload-certs\") pod \"41bd0843-1f3f-45a9-902a-d69ca07235e5\" (UID: \"41bd0843-1f3f-45a9-902a-d69ca07235e5\") "
Jul 28 20:07:02.187151 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.187065    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41bd0843-1f3f-45a9-902a-d69ca07235e5-istio-envoy\") pod \"41bd0843-1f3f-45a9-902a-d69ca07235e5\" (UID: \"41bd0843-1f3f-45a9-902a-d69ca07235e5\") "
Jul 28 20:07:02.187151 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.187117    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41bd0843-1f3f-45a9-902a-d69ca07235e5-credential-socket\") pod \"41bd0843-1f3f-45a9-902a-d69ca07235e5\" (UID: \"41bd0843-1f3f-45a9-902a-d69ca07235e5\") "
Jul 28 20:07:02.187369 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.187155    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vj62n\" (UniqueName: \"kubernetes.io/projected/41bd0843-1f3f-45a9-902a-d69ca07235e5-kube-api-access-vj62n\") pod \"41bd0843-1f3f-45a9-902a-d69ca07235e5\" (UID: \"41bd0843-1f3f-45a9-902a-d69ca07235e5\") "
Jul 28 20:07:02.187369 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.187179    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41bd0843-1f3f-45a9-902a-d69ca07235e5-workload-socket\") pod \"41bd0843-1f3f-45a9-902a-d69ca07235e5\" (UID: \"41bd0843-1f3f-45a9-902a-d69ca07235e5\") "
Jul 28 20:07:02.187369 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.187201    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41bd0843-1f3f-45a9-902a-d69ca07235e5-istio-token\") pod \"41bd0843-1f3f-45a9-902a-d69ca07235e5\" (UID: \"41bd0843-1f3f-45a9-902a-d69ca07235e5\") "
Jul 28 20:07:02.187369 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.187328    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41bd0843-1f3f-45a9-902a-d69ca07235e5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "41bd0843-1f3f-45a9-902a-d69ca07235e5" (UID: "41bd0843-1f3f-45a9-902a-d69ca07235e5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:07:02.187582 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.187384    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41bd0843-1f3f-45a9-902a-d69ca07235e5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "41bd0843-1f3f-45a9-902a-d69ca07235e5" (UID: "41bd0843-1f3f-45a9-902a-d69ca07235e5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:07:02.187582 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.187429    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41bd0843-1f3f-45a9-902a-d69ca07235e5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "41bd0843-1f3f-45a9-902a-d69ca07235e5" (UID: "41bd0843-1f3f-45a9-902a-d69ca07235e5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:07:02.187582 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.187499    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41bd0843-1f3f-45a9-902a-d69ca07235e5-credential-socket\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:07:02.187582 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.187519    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41bd0843-1f3f-45a9-902a-d69ca07235e5-istiod-ca-cert\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:07:02.187582 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.187533    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41bd0843-1f3f-45a9-902a-d69ca07235e5-workload-certs\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:07:02.187858 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.187589    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41bd0843-1f3f-45a9-902a-d69ca07235e5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "41bd0843-1f3f-45a9-902a-d69ca07235e5" (UID: "41bd0843-1f3f-45a9-902a-d69ca07235e5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:07:02.187961 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.187929    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41bd0843-1f3f-45a9-902a-d69ca07235e5-istio-data" (OuterVolumeSpecName: "istio-data") pod "41bd0843-1f3f-45a9-902a-d69ca07235e5" (UID: "41bd0843-1f3f-45a9-902a-d69ca07235e5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:07:02.189214 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.189190    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/41bd0843-1f3f-45a9-902a-d69ca07235e5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "41bd0843-1f3f-45a9-902a-d69ca07235e5" (UID: "41bd0843-1f3f-45a9-902a-d69ca07235e5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:07:02.189362 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.189345    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41bd0843-1f3f-45a9-902a-d69ca07235e5-istio-token" (OuterVolumeSpecName: "istio-token") pod "41bd0843-1f3f-45a9-902a-d69ca07235e5" (UID: "41bd0843-1f3f-45a9-902a-d69ca07235e5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:07:02.189419 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.189359    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41bd0843-1f3f-45a9-902a-d69ca07235e5-kube-api-access-vj62n" (OuterVolumeSpecName: "kube-api-access-vj62n") pod "41bd0843-1f3f-45a9-902a-d69ca07235e5" (UID: "41bd0843-1f3f-45a9-902a-d69ca07235e5"). InnerVolumeSpecName "kube-api-access-vj62n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:07:02.189458 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.189430    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41bd0843-1f3f-45a9-902a-d69ca07235e5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "41bd0843-1f3f-45a9-902a-d69ca07235e5" (UID: "41bd0843-1f3f-45a9-902a-d69ca07235e5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:07:02.288043 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.288006    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vj62n\" (UniqueName: \"kubernetes.io/projected/41bd0843-1f3f-45a9-902a-d69ca07235e5-kube-api-access-vj62n\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:07:02.288043 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.288036    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41bd0843-1f3f-45a9-902a-d69ca07235e5-workload-socket\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:07:02.288043 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.288046    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41bd0843-1f3f-45a9-902a-d69ca07235e5-istio-token\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:07:02.288280 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.288056    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41bd0843-1f3f-45a9-902a-d69ca07235e5-istio-podinfo\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:07:02.288280 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.288064    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41bd0843-1f3f-45a9-902a-d69ca07235e5-istio-data\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:07:02.288280 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.288072    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41bd0843-1f3f-45a9-902a-d69ca07235e5-istio-envoy\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:07:02.549203 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.549116    2570 generic.go:356] "Generic (PLEG): container finished" podID="41bd0843-1f3f-45a9-902a-d69ca07235e5" containerID="8ade7eca36039af29a0c8bf29a116c53180ac3cd2b051193f502316c470830aa" exitCode=0
Jul 28 20:07:02.549203 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.549184    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"
Jul 28 20:07:02.549396 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.549230    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc" event={"ID":"41bd0843-1f3f-45a9-902a-d69ca07235e5","Type":"ContainerDied","Data":"8ade7eca36039af29a0c8bf29a116c53180ac3cd2b051193f502316c470830aa"}
Jul 28 20:07:02.549396 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.549306    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc" event={"ID":"41bd0843-1f3f-45a9-902a-d69ca07235e5","Type":"ContainerDied","Data":"10c599eb53c7b31162fc6cee3e99b7ad7b0bc4838501c4530b2a1db13e55e694"}
Jul 28 20:07:02.549396 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.549332    2570 scope.go:117] "RemoveContainer" containerID="8ade7eca36039af29a0c8bf29a116c53180ac3cd2b051193f502316c470830aa"
Jul 28 20:07:02.558745 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.558728    2570 scope.go:117] "RemoveContainer" containerID="89dc2ce1cc1c10cec0a4bce79f0a9fc0eca6f7c89169edced73584473025c4e4"
Jul 28 20:07:02.566441 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.566424    2570 scope.go:117] "RemoveContainer" containerID="8ade7eca36039af29a0c8bf29a116c53180ac3cd2b051193f502316c470830aa"
Jul 28 20:07:02.566672 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:07:02.566651    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ade7eca36039af29a0c8bf29a116c53180ac3cd2b051193f502316c470830aa\": container with ID starting with 8ade7eca36039af29a0c8bf29a116c53180ac3cd2b051193f502316c470830aa not found: ID does not exist" containerID="8ade7eca36039af29a0c8bf29a116c53180ac3cd2b051193f502316c470830aa"
Jul 28 20:07:02.566746 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.566683    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ade7eca36039af29a0c8bf29a116c53180ac3cd2b051193f502316c470830aa"} err="failed to get container status \"8ade7eca36039af29a0c8bf29a116c53180ac3cd2b051193f502316c470830aa\": rpc error: code = NotFound desc = could not find container \"8ade7eca36039af29a0c8bf29a116c53180ac3cd2b051193f502316c470830aa\": container with ID starting with 8ade7eca36039af29a0c8bf29a116c53180ac3cd2b051193f502316c470830aa not found: ID does not exist"
Jul 28 20:07:02.566746 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.566708    2570 scope.go:117] "RemoveContainer" containerID="89dc2ce1cc1c10cec0a4bce79f0a9fc0eca6f7c89169edced73584473025c4e4"
Jul 28 20:07:02.566955 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:07:02.566936    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89dc2ce1cc1c10cec0a4bce79f0a9fc0eca6f7c89169edced73584473025c4e4\": container with ID starting with 89dc2ce1cc1c10cec0a4bce79f0a9fc0eca6f7c89169edced73584473025c4e4 not found: ID does not exist" containerID="89dc2ce1cc1c10cec0a4bce79f0a9fc0eca6f7c89169edced73584473025c4e4"
Jul 28 20:07:02.567018 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.566961    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89dc2ce1cc1c10cec0a4bce79f0a9fc0eca6f7c89169edced73584473025c4e4"} err="failed to get container status \"89dc2ce1cc1c10cec0a4bce79f0a9fc0eca6f7c89169edced73584473025c4e4\": rpc error: code = NotFound desc = could not find container \"89dc2ce1cc1c10cec0a4bce79f0a9fc0eca6f7c89169edced73584473025c4e4\": container with ID starting with 89dc2ce1cc1c10cec0a4bce79f0a9fc0eca6f7c89169edced73584473025c4e4 not found: ID does not exist"
Jul 28 20:07:02.571884 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.571864    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"]
Jul 28 20:07:02.575213 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:02.575191    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-1ca5d531-openshift-default-868b6bf464-ljjfc"]
Jul 28 20:07:03.571784 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:03.571753    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41bd0843-1f3f-45a9-902a-d69ca07235e5" path="/var/lib/kubelet/pods/41bd0843-1f3f-45a9-902a-d69ca07235e5/volumes"
Jul 28 20:07:33.625324 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.625270    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"]
Jul 28 20:07:33.625928 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.625837    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="658e4c36-93f0-4cc2-a9f0-7ec18fbf9408" containerName="revoke-keys"
Jul 28 20:07:33.625928 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.625859    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="658e4c36-93f0-4cc2-a9f0-7ec18fbf9408" containerName="revoke-keys"
Jul 28 20:07:33.625928 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.625885    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="985f3f59-a573-4af5-8271-eaa0b79e886b" containerName="payload-processing"
Jul 28 20:07:33.625928 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.625894    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="985f3f59-a573-4af5-8271-eaa0b79e886b" containerName="payload-processing"
Jul 28 20:07:33.625928 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.625906    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97894dfe-834f-4a4e-8897-d975a769cdb5" containerName="payload-pre-processing"
Jul 28 20:07:33.625928 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.625916    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="97894dfe-834f-4a4e-8897-d975a769cdb5" containerName="payload-pre-processing"
Jul 28 20:07:33.625928 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.625931    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41bd0843-1f3f-45a9-902a-d69ca07235e5" containerName="istio-proxy"
Jul 28 20:07:33.626329 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.625940    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="41bd0843-1f3f-45a9-902a-d69ca07235e5" containerName="istio-proxy"
Jul 28 20:07:33.626329 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.625955    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41bd0843-1f3f-45a9-902a-d69ca07235e5" containerName="istio-proxy"
Jul 28 20:07:33.626329 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.625962    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="41bd0843-1f3f-45a9-902a-d69ca07235e5" containerName="istio-proxy"
Jul 28 20:07:33.626329 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.626071    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="985f3f59-a573-4af5-8271-eaa0b79e886b" containerName="payload-processing"
Jul 28 20:07:33.626329 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.626096    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="97894dfe-834f-4a4e-8897-d975a769cdb5" containerName="payload-pre-processing"
Jul 28 20:07:33.626329 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.626110    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="41bd0843-1f3f-45a9-902a-d69ca07235e5" containerName="istio-proxy"
Jul 28 20:07:33.626329 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.626118    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="658e4c36-93f0-4cc2-a9f0-7ec18fbf9408" containerName="revoke-keys"
Jul 28 20:07:33.629244 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.629221    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:07:33.631633 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.631615    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-89688d3f-openshift-default-dockercfg-8vg9b\""
Jul 28 20:07:33.640788 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.640764    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"]
Jul 28 20:07:33.725329 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.725296    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66242426-e150-45e1-bb9f-e42a7052e80c-istio-envoy\") pod \"e2e-mt-89688d3f-openshift-default-56df46844-sb7rx\" (UID: \"66242426-e150-45e1-bb9f-e42a7052e80c\") " pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:07:33.725906 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.725872    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66242426-e150-45e1-bb9f-e42a7052e80c-istio-podinfo\") pod \"e2e-mt-89688d3f-openshift-default-56df46844-sb7rx\" (UID: \"66242426-e150-45e1-bb9f-e42a7052e80c\") " pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:07:33.726081 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.725964    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66242426-e150-45e1-bb9f-e42a7052e80c-istio-token\") pod \"e2e-mt-89688d3f-openshift-default-56df46844-sb7rx\" (UID: \"66242426-e150-45e1-bb9f-e42a7052e80c\") " pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:07:33.726081 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.726036    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66242426-e150-45e1-bb9f-e42a7052e80c-workload-socket\") pod \"e2e-mt-89688d3f-openshift-default-56df46844-sb7rx\" (UID: \"66242426-e150-45e1-bb9f-e42a7052e80c\") " pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:07:33.726081 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.726071    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66242426-e150-45e1-bb9f-e42a7052e80c-istiod-ca-cert\") pod \"e2e-mt-89688d3f-openshift-default-56df46844-sb7rx\" (UID: \"66242426-e150-45e1-bb9f-e42a7052e80c\") " pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:07:33.726382 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.726106    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66242426-e150-45e1-bb9f-e42a7052e80c-istio-data\") pod \"e2e-mt-89688d3f-openshift-default-56df46844-sb7rx\" (UID: \"66242426-e150-45e1-bb9f-e42a7052e80c\") " pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:07:33.726382 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.726141    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66242426-e150-45e1-bb9f-e42a7052e80c-credential-socket\") pod \"e2e-mt-89688d3f-openshift-default-56df46844-sb7rx\" (UID: \"66242426-e150-45e1-bb9f-e42a7052e80c\") " pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:07:33.726382 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.726166    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtsqm\" (UniqueName: \"kubernetes.io/projected/66242426-e150-45e1-bb9f-e42a7052e80c-kube-api-access-gtsqm\") pod \"e2e-mt-89688d3f-openshift-default-56df46844-sb7rx\" (UID: \"66242426-e150-45e1-bb9f-e42a7052e80c\") " pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:07:33.726382 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.726194    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66242426-e150-45e1-bb9f-e42a7052e80c-workload-certs\") pod \"e2e-mt-89688d3f-openshift-default-56df46844-sb7rx\" (UID: \"66242426-e150-45e1-bb9f-e42a7052e80c\") " pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:07:33.827371 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.827316    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66242426-e150-45e1-bb9f-e42a7052e80c-istio-envoy\") pod \"e2e-mt-89688d3f-openshift-default-56df46844-sb7rx\" (UID: \"66242426-e150-45e1-bb9f-e42a7052e80c\") " pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:07:33.827564 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.827380    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66242426-e150-45e1-bb9f-e42a7052e80c-istio-podinfo\") pod \"e2e-mt-89688d3f-openshift-default-56df46844-sb7rx\" (UID: \"66242426-e150-45e1-bb9f-e42a7052e80c\") " pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:07:33.827564 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.827441    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66242426-e150-45e1-bb9f-e42a7052e80c-istio-token\") pod \"e2e-mt-89688d3f-openshift-default-56df46844-sb7rx\" (UID: \"66242426-e150-45e1-bb9f-e42a7052e80c\") " pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:07:33.827564 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.827489    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66242426-e150-45e1-bb9f-e42a7052e80c-workload-socket\") pod \"e2e-mt-89688d3f-openshift-default-56df46844-sb7rx\" (UID: \"66242426-e150-45e1-bb9f-e42a7052e80c\") " pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:07:33.827564 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.827521    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66242426-e150-45e1-bb9f-e42a7052e80c-istiod-ca-cert\") pod \"e2e-mt-89688d3f-openshift-default-56df46844-sb7rx\" (UID: \"66242426-e150-45e1-bb9f-e42a7052e80c\") " pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:07:33.827837 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.827672    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66242426-e150-45e1-bb9f-e42a7052e80c-istio-data\") pod \"e2e-mt-89688d3f-openshift-default-56df46844-sb7rx\" (UID: \"66242426-e150-45e1-bb9f-e42a7052e80c\") " pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:07:33.827837 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.827726    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66242426-e150-45e1-bb9f-e42a7052e80c-credential-socket\") pod \"e2e-mt-89688d3f-openshift-default-56df46844-sb7rx\" (UID: \"66242426-e150-45e1-bb9f-e42a7052e80c\") " pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:07:33.827837 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.827753    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtsqm\" (UniqueName: \"kubernetes.io/projected/66242426-e150-45e1-bb9f-e42a7052e80c-kube-api-access-gtsqm\") pod \"e2e-mt-89688d3f-openshift-default-56df46844-sb7rx\" (UID: \"66242426-e150-45e1-bb9f-e42a7052e80c\") " pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:07:33.827837 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.827779    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66242426-e150-45e1-bb9f-e42a7052e80c-workload-certs\") pod \"e2e-mt-89688d3f-openshift-default-56df46844-sb7rx\" (UID: \"66242426-e150-45e1-bb9f-e42a7052e80c\") " pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:07:33.828097 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.828037    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66242426-e150-45e1-bb9f-e42a7052e80c-credential-socket\") pod \"e2e-mt-89688d3f-openshift-default-56df46844-sb7rx\" (UID: \"66242426-e150-45e1-bb9f-e42a7052e80c\") " pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:07:33.828159 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.828103    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66242426-e150-45e1-bb9f-e42a7052e80c-istio-data\") pod \"e2e-mt-89688d3f-openshift-default-56df46844-sb7rx\" (UID: \"66242426-e150-45e1-bb9f-e42a7052e80c\") " pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:07:33.828215 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.828150    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66242426-e150-45e1-bb9f-e42a7052e80c-workload-certs\") pod \"e2e-mt-89688d3f-openshift-default-56df46844-sb7rx\" (UID: \"66242426-e150-45e1-bb9f-e42a7052e80c\") " pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:07:33.828215 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.828177    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66242426-e150-45e1-bb9f-e42a7052e80c-workload-socket\") pod \"e2e-mt-89688d3f-openshift-default-56df46844-sb7rx\" (UID: \"66242426-e150-45e1-bb9f-e42a7052e80c\") " pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:07:33.828513 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.828493    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66242426-e150-45e1-bb9f-e42a7052e80c-istiod-ca-cert\") pod \"e2e-mt-89688d3f-openshift-default-56df46844-sb7rx\" (UID: \"66242426-e150-45e1-bb9f-e42a7052e80c\") " pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:07:33.829791 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.829765    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66242426-e150-45e1-bb9f-e42a7052e80c-istio-envoy\") pod \"e2e-mt-89688d3f-openshift-default-56df46844-sb7rx\" (UID: \"66242426-e150-45e1-bb9f-e42a7052e80c\") " pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:07:33.829894 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.829820    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66242426-e150-45e1-bb9f-e42a7052e80c-istio-podinfo\") pod \"e2e-mt-89688d3f-openshift-default-56df46844-sb7rx\" (UID: \"66242426-e150-45e1-bb9f-e42a7052e80c\") " pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:07:33.836033 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.836011    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66242426-e150-45e1-bb9f-e42a7052e80c-istio-token\") pod \"e2e-mt-89688d3f-openshift-default-56df46844-sb7rx\" (UID: \"66242426-e150-45e1-bb9f-e42a7052e80c\") " pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:07:33.836306 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.836287    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtsqm\" (UniqueName: \"kubernetes.io/projected/66242426-e150-45e1-bb9f-e42a7052e80c-kube-api-access-gtsqm\") pod \"e2e-mt-89688d3f-openshift-default-56df46844-sb7rx\" (UID: \"66242426-e150-45e1-bb9f-e42a7052e80c\") " pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:07:33.939024 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:33.938968    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:07:34.075918 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:34.075891    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"]
Jul 28 20:07:34.078463 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:07:34.078434    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66242426_e150_45e1_bb9f_e42a7052e80c.slice/crio-5ca85c1f1931a8d4e4200d07afd52d74af3fbb7954ba090e6a733d4de15b11d1 WatchSource:0}: Error finding container 5ca85c1f1931a8d4e4200d07afd52d74af3fbb7954ba090e6a733d4de15b11d1: Status 404 returned error can't find the container with id 5ca85c1f1931a8d4e4200d07afd52d74af3fbb7954ba090e6a733d4de15b11d1
Jul 28 20:07:34.080636 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:34.080606    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:07:34.080722 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:34.080668    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:07:34.080722 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:34.080699    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:07:34.692397 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:34.692350    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx" event={"ID":"66242426-e150-45e1-bb9f-e42a7052e80c","Type":"ContainerStarted","Data":"8a92ad85abf42897bbf16474691615f140d18d939126ee65b96c17e0ec4baea1"}
Jul 28 20:07:34.692397 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:34.692406    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx" event={"ID":"66242426-e150-45e1-bb9f-e42a7052e80c","Type":"ContainerStarted","Data":"5ca85c1f1931a8d4e4200d07afd52d74af3fbb7954ba090e6a733d4de15b11d1"}
Jul 28 20:07:34.714888 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:34.714841    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx" podStartSLOduration=1.714824001 podStartE2EDuration="1.714824001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:07:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:07:34.712517506 +0000 UTC m=+2267.664549858" watchObservedRunningTime="2026-07-28 20:07:34.714824001 +0000 UTC m=+2267.666856329"
Jul 28 20:07:34.939617 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:34.939584    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:07:35.944391 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:35.944363    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:07:36.700829 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:36.700797    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:07:36.701803 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:36.701777    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:07:37.420386 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:37.420354    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-89688d3f-69858b696-k4d2v"]
Jul 28 20:07:37.420757 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:37.420716    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="41bd0843-1f3f-45a9-902a-d69ca07235e5" containerName="istio-proxy"
Jul 28 20:07:37.423882 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:37.423859    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-89688d3f-69858b696-k4d2v"
Jul 28 20:07:37.426168 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:37.426144    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-89688d3f-555ddd84c4-8ltxf"]
Jul 28 20:07:37.426932 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:37.426914    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-89688d3f\""
Jul 28 20:07:37.427604 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:37.427584    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-89688d3f-dockercfg-bhq48\""
Jul 28 20:07:37.429256 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:37.429240    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-89688d3f-555ddd84c4-8ltxf"
Jul 28 20:07:37.450556 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:37.450530    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-89688d3f-555ddd84c4-8ltxf"]
Jul 28 20:07:37.452528 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:37.452506    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-89688d3f-69858b696-k4d2v"]
Jul 28 20:07:37.464524 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:37.464501    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e06746f2-ab0b-4ad5-9b66-ad5673cb7f4f-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-89688d3f-69858b696-k4d2v\" (UID: \"e06746f2-ab0b-4ad5-9b66-ad5673cb7f4f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-89688d3f-69858b696-k4d2v"
Jul 28 20:07:37.464641 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:37.464532    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r2tz\" (UniqueName: \"kubernetes.io/projected/e06746f2-ab0b-4ad5-9b66-ad5673cb7f4f-kube-api-access-4r2tz\") pod \"payload-pre-processing-e2e-mt-89688d3f-69858b696-k4d2v\" (UID: \"e06746f2-ab0b-4ad5-9b66-ad5673cb7f4f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-89688d3f-69858b696-k4d2v"
Jul 28 20:07:37.464641 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:37.464553    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f46e501-5090-4671-9e7e-43fd9fed3d94-plugins-config-volume\") pod \"payload-processing-e2e-mt-89688d3f-555ddd84c4-8ltxf\" (UID: \"4f46e501-5090-4671-9e7e-43fd9fed3d94\") " pod="openshift-ingress/payload-processing-e2e-mt-89688d3f-555ddd84c4-8ltxf"
Jul 28 20:07:37.464641 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:37.464567    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl8v2\" (UniqueName: \"kubernetes.io/projected/4f46e501-5090-4671-9e7e-43fd9fed3d94-kube-api-access-jl8v2\") pod \"payload-processing-e2e-mt-89688d3f-555ddd84c4-8ltxf\" (UID: \"4f46e501-5090-4671-9e7e-43fd9fed3d94\") " pod="openshift-ingress/payload-processing-e2e-mt-89688d3f-555ddd84c4-8ltxf"
Jul 28 20:07:37.565053 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:37.565016    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e06746f2-ab0b-4ad5-9b66-ad5673cb7f4f-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-89688d3f-69858b696-k4d2v\" (UID: \"e06746f2-ab0b-4ad5-9b66-ad5673cb7f4f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-89688d3f-69858b696-k4d2v"
Jul 28 20:07:37.565226 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:37.565064    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r2tz\" (UniqueName: \"kubernetes.io/projected/e06746f2-ab0b-4ad5-9b66-ad5673cb7f4f-kube-api-access-4r2tz\") pod \"payload-pre-processing-e2e-mt-89688d3f-69858b696-k4d2v\" (UID: \"e06746f2-ab0b-4ad5-9b66-ad5673cb7f4f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-89688d3f-69858b696-k4d2v"
Jul 28 20:07:37.565226 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:37.565086    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f46e501-5090-4671-9e7e-43fd9fed3d94-plugins-config-volume\") pod \"payload-processing-e2e-mt-89688d3f-555ddd84c4-8ltxf\" (UID: \"4f46e501-5090-4671-9e7e-43fd9fed3d94\") " pod="openshift-ingress/payload-processing-e2e-mt-89688d3f-555ddd84c4-8ltxf"
Jul 28 20:07:37.565226 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:37.565105    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl8v2\" (UniqueName: \"kubernetes.io/projected/4f46e501-5090-4671-9e7e-43fd9fed3d94-kube-api-access-jl8v2\") pod \"payload-processing-e2e-mt-89688d3f-555ddd84c4-8ltxf\" (UID: \"4f46e501-5090-4671-9e7e-43fd9fed3d94\") " pod="openshift-ingress/payload-processing-e2e-mt-89688d3f-555ddd84c4-8ltxf"
Jul 28 20:07:37.566060 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:37.566033    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e06746f2-ab0b-4ad5-9b66-ad5673cb7f4f-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-89688d3f-69858b696-k4d2v\" (UID: \"e06746f2-ab0b-4ad5-9b66-ad5673cb7f4f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-89688d3f-69858b696-k4d2v"
Jul 28 20:07:37.566168 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:37.566033    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f46e501-5090-4671-9e7e-43fd9fed3d94-plugins-config-volume\") pod \"payload-processing-e2e-mt-89688d3f-555ddd84c4-8ltxf\" (UID: \"4f46e501-5090-4671-9e7e-43fd9fed3d94\") " pod="openshift-ingress/payload-processing-e2e-mt-89688d3f-555ddd84c4-8ltxf"
Jul 28 20:07:37.573145 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:37.573115    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl8v2\" (UniqueName: \"kubernetes.io/projected/4f46e501-5090-4671-9e7e-43fd9fed3d94-kube-api-access-jl8v2\") pod \"payload-processing-e2e-mt-89688d3f-555ddd84c4-8ltxf\" (UID: \"4f46e501-5090-4671-9e7e-43fd9fed3d94\") " pod="openshift-ingress/payload-processing-e2e-mt-89688d3f-555ddd84c4-8ltxf"
Jul 28 20:07:37.573407 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:37.573384    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r2tz\" (UniqueName: \"kubernetes.io/projected/e06746f2-ab0b-4ad5-9b66-ad5673cb7f4f-kube-api-access-4r2tz\") pod \"payload-pre-processing-e2e-mt-89688d3f-69858b696-k4d2v\" (UID: \"e06746f2-ab0b-4ad5-9b66-ad5673cb7f4f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-89688d3f-69858b696-k4d2v"
Jul 28 20:07:37.735924 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:37.735825    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-89688d3f-69858b696-k4d2v"
Jul 28 20:07:37.741893 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:37.741864    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-89688d3f-555ddd84c4-8ltxf"
Jul 28 20:07:37.878534 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:37.878497    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-89688d3f-69858b696-k4d2v"]
Jul 28 20:07:37.882313 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:07:37.882283    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode06746f2_ab0b_4ad5_9b66_ad5673cb7f4f.slice/crio-5a1efd305b7af18cb64b5489bce3385086d89c3d7d831c14956afd890f6357f5 WatchSource:0}: Error finding container 5a1efd305b7af18cb64b5489bce3385086d89c3d7d831c14956afd890f6357f5: Status 404 returned error can't find the container with id 5a1efd305b7af18cb64b5489bce3385086d89c3d7d831c14956afd890f6357f5
Jul 28 20:07:37.898600 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:37.898578    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-89688d3f-555ddd84c4-8ltxf"]
Jul 28 20:07:37.901286 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:07:37.901256    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f46e501_5090_4671_9e7e_43fd9fed3d94.slice/crio-3503847d434bd57ec003c3fdd6ff738413f5a16d55b2ce5161c9781bfaa1d91f WatchSource:0}: Error finding container 3503847d434bd57ec003c3fdd6ff738413f5a16d55b2ce5161c9781bfaa1d91f: Status 404 returned error can't find the container with id 3503847d434bd57ec003c3fdd6ff738413f5a16d55b2ce5161c9781bfaa1d91f
Jul 28 20:07:38.712596 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:38.712559    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-89688d3f-69858b696-k4d2v" event={"ID":"e06746f2-ab0b-4ad5-9b66-ad5673cb7f4f","Type":"ContainerStarted","Data":"9325e3a89a618304ca16a52946250a0adf5560ee5dd7cf38e76487db16cd9045"}
Jul 28 20:07:38.713123 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:38.712645    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-89688d3f-69858b696-k4d2v" event={"ID":"e06746f2-ab0b-4ad5-9b66-ad5673cb7f4f","Type":"ContainerStarted","Data":"5a1efd305b7af18cb64b5489bce3385086d89c3d7d831c14956afd890f6357f5"}
Jul 28 20:07:38.713123 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:38.712762    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-89688d3f-69858b696-k4d2v"
Jul 28 20:07:38.714171 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:38.714144    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-89688d3f-555ddd84c4-8ltxf" event={"ID":"4f46e501-5090-4671-9e7e-43fd9fed3d94","Type":"ContainerStarted","Data":"18bf36fbc7e2e762572817b1b803cc26c6c7f28c51128b40805fd208cf92ed99"}
Jul 28 20:07:38.714343 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:38.714324    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-89688d3f-555ddd84c4-8ltxf"
Jul 28 20:07:38.714402 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:38.714369    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-89688d3f-555ddd84c4-8ltxf" event={"ID":"4f46e501-5090-4671-9e7e-43fd9fed3d94","Type":"ContainerStarted","Data":"3503847d434bd57ec003c3fdd6ff738413f5a16d55b2ce5161c9781bfaa1d91f"}
Jul 28 20:07:38.737960 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:38.737903    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-89688d3f-69858b696-k4d2v" podStartSLOduration=1.737886954 podStartE2EDuration="1.737886954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:07:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:07:38.736546284 +0000 UTC m=+2271.688578615" watchObservedRunningTime="2026-07-28 20:07:38.737886954 +0000 UTC m=+2271.689919285"
Jul 28 20:07:38.767452 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:38.767402    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-89688d3f-555ddd84c4-8ltxf" podStartSLOduration=1.767389028 podStartE2EDuration="1.767389028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:07:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:07:38.765485072 +0000 UTC m=+2271.717517401" watchObservedRunningTime="2026-07-28 20:07:38.767389028 +0000 UTC m=+2271.719421358"
Jul 28 20:07:49.720945 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:49.720908    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-89688d3f-555ddd84c4-8ltxf"
Jul 28 20:07:49.721394 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:49.721017    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-89688d3f-69858b696-k4d2v"
Jul 28 20:07:51.702888 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:51.702855    2570 patch_prober.go:28] interesting pod/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 28 20:07:51.703264 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:51.702923    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx" podUID="66242426-e150-45e1-bb9f-e42a7052e80c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 28 20:07:51.776569 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:51.776508    2570 generic.go:356] "Generic (PLEG): container finished" podID="66242426-e150-45e1-bb9f-e42a7052e80c" containerID="8a92ad85abf42897bbf16474691615f140d18d939126ee65b96c17e0ec4baea1" exitCode=0
Jul 28 20:07:51.776569 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:51.776561    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx" event={"ID":"66242426-e150-45e1-bb9f-e42a7052e80c","Type":"ContainerDied","Data":"8a92ad85abf42897bbf16474691615f140d18d939126ee65b96c17e0ec4baea1"}
Jul 28 20:07:51.777001 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:51.776966    2570 scope.go:117] "RemoveContainer" containerID="8a92ad85abf42897bbf16474691615f140d18d939126ee65b96c17e0ec4baea1"
Jul 28 20:07:51.777922 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:51.777895    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:07:51.778016 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:51.778000    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:07:51.778059 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:51.778038    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:07:52.783604 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:52.783565    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx" event={"ID":"66242426-e150-45e1-bb9f-e42a7052e80c","Type":"ContainerStarted","Data":"e3f5295ebff197014e3cd9e5feb33b6944cb9b958971c457510d488d4f66aadb"}
Jul 28 20:07:52.939692 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:52.939660    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:07:52.939948 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:52.939924    2570 patch_prober.go:28] interesting pod/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 28 20:07:52.940088 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:52.940016    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx" podUID="66242426-e150-45e1-bb9f-e42a7052e80c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 28 20:07:53.939963 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:53.939927    2570 patch_prober.go:28] interesting pod/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 28 20:07:53.940448 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:53.940004    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx" podUID="66242426-e150-45e1-bb9f-e42a7052e80c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 28 20:07:54.939681 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:54.939640    2570 patch_prober.go:28] interesting pod/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 28 20:07:54.939867 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:54.939696    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx" podUID="66242426-e150-45e1-bb9f-e42a7052e80c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 28 20:07:55.940305 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:55.940267    2570 patch_prober.go:28] interesting pod/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 28 20:07:55.940699 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:55.940326    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx" podUID="66242426-e150-45e1-bb9f-e42a7052e80c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 28 20:07:56.943742 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:56.943714    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:07:56.944194 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:56.944071    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:07:56.944695 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:07:56.944677    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:08:40.977481 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:40.977383    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89688d3f-wpvhd"]
Jul 28 20:08:40.979787 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:40.979762    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89688d3f-wpvhd"
Jul 28 20:08:40.982173 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:40.982147    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z6zs4\""
Jul 28 20:08:40.988845 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:40.988819    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89688d3f-wpvhd"]
Jul 28 20:08:41.131838 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:41.131796    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f2dcec3-b996-4d8b-b8e0-d60580410b7e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-89688d3f-wpvhd\" (UID: \"5f2dcec3-b996-4d8b-b8e0-d60580410b7e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89688d3f-wpvhd"
Jul 28 20:08:41.233058 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:41.232951    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f2dcec3-b996-4d8b-b8e0-d60580410b7e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-89688d3f-wpvhd\" (UID: \"5f2dcec3-b996-4d8b-b8e0-d60580410b7e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89688d3f-wpvhd"
Jul 28 20:08:41.233673 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:41.233643    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f2dcec3-b996-4d8b-b8e0-d60580410b7e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-89688d3f-wpvhd\" (UID: \"5f2dcec3-b996-4d8b-b8e0-d60580410b7e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89688d3f-wpvhd"
Jul 28 20:08:41.291800 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:41.291761    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89688d3f-wpvhd"
Jul 28 20:08:41.425907 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:41.425881    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89688d3f-wpvhd"]
Jul 28 20:08:41.428859 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:08:41.428831    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f2dcec3_b996_4d8b_b8e0_d60580410b7e.slice/crio-8895f64e2ccf82c1632e6a482ea72057d3374ecacb035f6a7e02f1c7d9e61850 WatchSource:0}: Error finding container 8895f64e2ccf82c1632e6a482ea72057d3374ecacb035f6a7e02f1c7d9e61850: Status 404 returned error can't find the container with id 8895f64e2ccf82c1632e6a482ea72057d3374ecacb035f6a7e02f1c7d9e61850
Jul 28 20:08:42.013783 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:42.013747    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89688d3f-wpvhd" event={"ID":"5f2dcec3-b996-4d8b-b8e0-d60580410b7e","Type":"ContainerStarted","Data":"e847c84c4253ba78c2f57d0c20eead05b36ec1190cb2b37b9f3729ceabf12de1"}
Jul 28 20:08:42.014264 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:42.013799    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89688d3f-wpvhd" event={"ID":"5f2dcec3-b996-4d8b-b8e0-d60580410b7e","Type":"ContainerStarted","Data":"8895f64e2ccf82c1632e6a482ea72057d3374ecacb035f6a7e02f1c7d9e61850"}
Jul 28 20:08:42.029544 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:42.029489    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89688d3f-wpvhd" podStartSLOduration=2.02947398 podStartE2EDuration="2.02947398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:08:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:08:42.027171684 +0000 UTC m=+2334.979204014" watchObservedRunningTime="2026-07-28 20:08:42.02947398 +0000 UTC m=+2334.981506310"
Jul 28 20:08:43.023041 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:43.023000    2570 generic.go:356] "Generic (PLEG): container finished" podID="5f2dcec3-b996-4d8b-b8e0-d60580410b7e" containerID="e847c84c4253ba78c2f57d0c20eead05b36ec1190cb2b37b9f3729ceabf12de1" exitCode=0
Jul 28 20:08:43.023693 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:43.023075    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89688d3f-wpvhd" event={"ID":"5f2dcec3-b996-4d8b-b8e0-d60580410b7e","Type":"ContainerDied","Data":"e847c84c4253ba78c2f57d0c20eead05b36ec1190cb2b37b9f3729ceabf12de1"}
Jul 28 20:08:44.151618 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:44.151594    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89688d3f-wpvhd"
Jul 28 20:08:44.258684 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:44.258644    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f2dcec3-b996-4d8b-b8e0-d60580410b7e-maas-api-service-ca\") pod \"5f2dcec3-b996-4d8b-b8e0-d60580410b7e\" (UID: \"5f2dcec3-b996-4d8b-b8e0-d60580410b7e\") "
Jul 28 20:08:44.259013 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:44.258993    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f2dcec3-b996-4d8b-b8e0-d60580410b7e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5f2dcec3-b996-4d8b-b8e0-d60580410b7e" (UID: "5f2dcec3-b996-4d8b-b8e0-d60580410b7e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:08:44.359882 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:44.359795    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f2dcec3-b996-4d8b-b8e0-d60580410b7e-maas-api-service-ca\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:08:45.034895 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:45.034865    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89688d3f-wpvhd"
Jul 28 20:08:45.035087 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:45.034865    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89688d3f-wpvhd" event={"ID":"5f2dcec3-b996-4d8b-b8e0-d60580410b7e","Type":"ContainerDied","Data":"8895f64e2ccf82c1632e6a482ea72057d3374ecacb035f6a7e02f1c7d9e61850"}
Jul 28 20:08:45.035087 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:45.035012    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8895f64e2ccf82c1632e6a482ea72057d3374ecacb035f6a7e02f1c7d9e61850"
Jul 28 20:08:56.472613 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:56.472580    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-89688d3f-555ddd84c4-8ltxf"]
Jul 28 20:08:56.473206 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:56.472812    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-89688d3f-555ddd84c4-8ltxf" podUID="4f46e501-5090-4671-9e7e-43fd9fed3d94" containerName="payload-processing" containerID="cri-o://18bf36fbc7e2e762572817b1b803cc26c6c7f28c51128b40805fd208cf92ed99" gracePeriod=30
Jul 28 20:08:56.481577 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:56.481548    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-89688d3f-69858b696-k4d2v"]
Jul 28 20:08:56.481814 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:56.481773    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-89688d3f-69858b696-k4d2v" podUID="e06746f2-ab0b-4ad5-9b66-ad5673cb7f4f" containerName="payload-pre-processing" containerID="cri-o://9325e3a89a618304ca16a52946250a0adf5560ee5dd7cf38e76487db16cd9045" gracePeriod=30
Jul 28 20:08:56.617323 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:56.617281    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89688d3f-wpvhd"]
Jul 28 20:08:56.620563 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:56.620530    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89688d3f-wpvhd"]
Jul 28 20:08:56.756996 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:56.756961    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-89688d3f-555ddd84c4-8ltxf"
Jul 28 20:08:56.760113 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:56.760094    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-89688d3f-69858b696-k4d2v"
Jul 28 20:08:56.769345 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:56.769326    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jl8v2\" (UniqueName: \"kubernetes.io/projected/4f46e501-5090-4671-9e7e-43fd9fed3d94-kube-api-access-jl8v2\") pod \"4f46e501-5090-4671-9e7e-43fd9fed3d94\" (UID: \"4f46e501-5090-4671-9e7e-43fd9fed3d94\") "
Jul 28 20:08:56.769417 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:56.769403    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f46e501-5090-4671-9e7e-43fd9fed3d94-plugins-config-volume\") pod \"4f46e501-5090-4671-9e7e-43fd9fed3d94\" (UID: \"4f46e501-5090-4671-9e7e-43fd9fed3d94\") "
Jul 28 20:08:56.769754 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:56.769727    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f46e501-5090-4671-9e7e-43fd9fed3d94-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4f46e501-5090-4671-9e7e-43fd9fed3d94" (UID: "4f46e501-5090-4671-9e7e-43fd9fed3d94"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:08:56.771308 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:56.771289    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f46e501-5090-4671-9e7e-43fd9fed3d94-kube-api-access-jl8v2" (OuterVolumeSpecName: "kube-api-access-jl8v2") pod "4f46e501-5090-4671-9e7e-43fd9fed3d94" (UID: "4f46e501-5090-4671-9e7e-43fd9fed3d94"). InnerVolumeSpecName "kube-api-access-jl8v2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:08:56.870343 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:56.870315    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e06746f2-ab0b-4ad5-9b66-ad5673cb7f4f-plugins-config-volume\") pod \"e06746f2-ab0b-4ad5-9b66-ad5673cb7f4f\" (UID: \"e06746f2-ab0b-4ad5-9b66-ad5673cb7f4f\") "
Jul 28 20:08:56.870511 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:56.870367    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4r2tz\" (UniqueName: \"kubernetes.io/projected/e06746f2-ab0b-4ad5-9b66-ad5673cb7f4f-kube-api-access-4r2tz\") pod \"e06746f2-ab0b-4ad5-9b66-ad5673cb7f4f\" (UID: \"e06746f2-ab0b-4ad5-9b66-ad5673cb7f4f\") "
Jul 28 20:08:56.870614 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:56.870598    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jl8v2\" (UniqueName: \"kubernetes.io/projected/4f46e501-5090-4671-9e7e-43fd9fed3d94-kube-api-access-jl8v2\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:08:56.870653 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:56.870620    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f46e501-5090-4671-9e7e-43fd9fed3d94-plugins-config-volume\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:08:56.870693 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:56.870676    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e06746f2-ab0b-4ad5-9b66-ad5673cb7f4f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e06746f2-ab0b-4ad5-9b66-ad5673cb7f4f" (UID: "e06746f2-ab0b-4ad5-9b66-ad5673cb7f4f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:08:56.872380 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:56.872361    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e06746f2-ab0b-4ad5-9b66-ad5673cb7f4f-kube-api-access-4r2tz" (OuterVolumeSpecName: "kube-api-access-4r2tz") pod "e06746f2-ab0b-4ad5-9b66-ad5673cb7f4f" (UID: "e06746f2-ab0b-4ad5-9b66-ad5673cb7f4f"). InnerVolumeSpecName "kube-api-access-4r2tz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:08:56.971390 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:56.971349    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e06746f2-ab0b-4ad5-9b66-ad5673cb7f4f-plugins-config-volume\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:08:56.971390 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:56.971382    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4r2tz\" (UniqueName: \"kubernetes.io/projected/e06746f2-ab0b-4ad5-9b66-ad5673cb7f4f-kube-api-access-4r2tz\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:08:57.092290 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:57.092204    2570 generic.go:356] "Generic (PLEG): container finished" podID="e06746f2-ab0b-4ad5-9b66-ad5673cb7f4f" containerID="9325e3a89a618304ca16a52946250a0adf5560ee5dd7cf38e76487db16cd9045" exitCode=0
Jul 28 20:08:57.092290 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:57.092251    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-89688d3f-69858b696-k4d2v"
Jul 28 20:08:57.092520 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:57.092293    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-89688d3f-69858b696-k4d2v" event={"ID":"e06746f2-ab0b-4ad5-9b66-ad5673cb7f4f","Type":"ContainerDied","Data":"9325e3a89a618304ca16a52946250a0adf5560ee5dd7cf38e76487db16cd9045"}
Jul 28 20:08:57.092520 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:57.092345    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-89688d3f-69858b696-k4d2v" event={"ID":"e06746f2-ab0b-4ad5-9b66-ad5673cb7f4f","Type":"ContainerDied","Data":"5a1efd305b7af18cb64b5489bce3385086d89c3d7d831c14956afd890f6357f5"}
Jul 28 20:08:57.092520 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:57.092373    2570 scope.go:117] "RemoveContainer" containerID="9325e3a89a618304ca16a52946250a0adf5560ee5dd7cf38e76487db16cd9045"
Jul 28 20:08:57.093646 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:57.093625    2570 generic.go:356] "Generic (PLEG): container finished" podID="4f46e501-5090-4671-9e7e-43fd9fed3d94" containerID="18bf36fbc7e2e762572817b1b803cc26c6c7f28c51128b40805fd208cf92ed99" exitCode=0
Jul 28 20:08:57.093765 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:57.093658    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-89688d3f-555ddd84c4-8ltxf" event={"ID":"4f46e501-5090-4671-9e7e-43fd9fed3d94","Type":"ContainerDied","Data":"18bf36fbc7e2e762572817b1b803cc26c6c7f28c51128b40805fd208cf92ed99"}
Jul 28 20:08:57.093765 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:57.093665    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-89688d3f-555ddd84c4-8ltxf"
Jul 28 20:08:57.093765 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:57.093710    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-89688d3f-555ddd84c4-8ltxf" event={"ID":"4f46e501-5090-4671-9e7e-43fd9fed3d94","Type":"ContainerDied","Data":"3503847d434bd57ec003c3fdd6ff738413f5a16d55b2ce5161c9781bfaa1d91f"}
Jul 28 20:08:57.102384 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:57.102369    2570 scope.go:117] "RemoveContainer" containerID="9325e3a89a618304ca16a52946250a0adf5560ee5dd7cf38e76487db16cd9045"
Jul 28 20:08:57.102630 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:08:57.102610    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9325e3a89a618304ca16a52946250a0adf5560ee5dd7cf38e76487db16cd9045\": container with ID starting with 9325e3a89a618304ca16a52946250a0adf5560ee5dd7cf38e76487db16cd9045 not found: ID does not exist" containerID="9325e3a89a618304ca16a52946250a0adf5560ee5dd7cf38e76487db16cd9045"
Jul 28 20:08:57.102699 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:57.102635    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9325e3a89a618304ca16a52946250a0adf5560ee5dd7cf38e76487db16cd9045"} err="failed to get container status \"9325e3a89a618304ca16a52946250a0adf5560ee5dd7cf38e76487db16cd9045\": rpc error: code = NotFound desc = could not find container \"9325e3a89a618304ca16a52946250a0adf5560ee5dd7cf38e76487db16cd9045\": container with ID starting with 9325e3a89a618304ca16a52946250a0adf5560ee5dd7cf38e76487db16cd9045 not found: ID does not exist"
Jul 28 20:08:57.102699 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:57.102650    2570 scope.go:117] "RemoveContainer" containerID="18bf36fbc7e2e762572817b1b803cc26c6c7f28c51128b40805fd208cf92ed99"
Jul 28 20:08:57.110234 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:57.110216    2570 scope.go:117] "RemoveContainer" containerID="18bf36fbc7e2e762572817b1b803cc26c6c7f28c51128b40805fd208cf92ed99"
Jul 28 20:08:57.110471 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:08:57.110455    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18bf36fbc7e2e762572817b1b803cc26c6c7f28c51128b40805fd208cf92ed99\": container with ID starting with 18bf36fbc7e2e762572817b1b803cc26c6c7f28c51128b40805fd208cf92ed99 not found: ID does not exist" containerID="18bf36fbc7e2e762572817b1b803cc26c6c7f28c51128b40805fd208cf92ed99"
Jul 28 20:08:57.110532 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:57.110476    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18bf36fbc7e2e762572817b1b803cc26c6c7f28c51128b40805fd208cf92ed99"} err="failed to get container status \"18bf36fbc7e2e762572817b1b803cc26c6c7f28c51128b40805fd208cf92ed99\": rpc error: code = NotFound desc = could not find container \"18bf36fbc7e2e762572817b1b803cc26c6c7f28c51128b40805fd208cf92ed99\": container with ID starting with 18bf36fbc7e2e762572817b1b803cc26c6c7f28c51128b40805fd208cf92ed99 not found: ID does not exist"
Jul 28 20:08:57.117072 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:57.117050    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-89688d3f-555ddd84c4-8ltxf"]
Jul 28 20:08:57.120059 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:57.120041    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-89688d3f-555ddd84c4-8ltxf"]
Jul 28 20:08:57.129635 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:57.129614    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-89688d3f-69858b696-k4d2v"]
Jul 28 20:08:57.131846 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:57.131827    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-89688d3f-69858b696-k4d2v"]
Jul 28 20:08:57.572574 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:57.572543    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f46e501-5090-4671-9e7e-43fd9fed3d94" path="/var/lib/kubelet/pods/4f46e501-5090-4671-9e7e-43fd9fed3d94/volumes"
Jul 28 20:08:57.572921 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:57.572868    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f2dcec3-b996-4d8b-b8e0-d60580410b7e" path="/var/lib/kubelet/pods/5f2dcec3-b996-4d8b-b8e0-d60580410b7e/volumes"
Jul 28 20:08:57.573193 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:08:57.573179    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e06746f2-ab0b-4ad5-9b66-ad5673cb7f4f" path="/var/lib/kubelet/pods/e06746f2-ab0b-4ad5-9b66-ad5673cb7f4f/volumes"
Jul 28 20:09:47.711648 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:09:47.711610    2570 scope.go:117] "RemoveContainer" containerID="44501919ee61b43eb2c16cd89859ea77cc215a2d6f9cdc4d0ea2e7d524563acc"
Jul 28 20:09:47.719335 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:09:47.719315    2570 scope.go:117] "RemoveContainer" containerID="a00afc37f431513b643995097403afacf05c02470983cbecefd481cbc521d883"
Jul 28 20:10:10.556810 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:10.556725    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"]
Jul 28 20:10:10.557292 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:10.557008    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx" podUID="66242426-e150-45e1-bb9f-e42a7052e80c" containerName="istio-proxy" containerID="cri-o://e3f5295ebff197014e3cd9e5feb33b6944cb9b958971c457510d488d4f66aadb" gracePeriod=30
Jul 28 20:10:11.946411 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:11.946367    2570 patch_prober.go:28] interesting pod/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 20:10:11.946792 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:11.946440    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx" podUID="66242426-e150-45e1-bb9f-e42a7052e80c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 20:10:15.806766 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:15.806739    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:10:15.955040 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:15.955002    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66242426-e150-45e1-bb9f-e42a7052e80c-istio-podinfo\") pod \"66242426-e150-45e1-bb9f-e42a7052e80c\" (UID: \"66242426-e150-45e1-bb9f-e42a7052e80c\") "
Jul 28 20:10:15.955040 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:15.955044    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66242426-e150-45e1-bb9f-e42a7052e80c-istio-data\") pod \"66242426-e150-45e1-bb9f-e42a7052e80c\" (UID: \"66242426-e150-45e1-bb9f-e42a7052e80c\") "
Jul 28 20:10:15.955265 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:15.955065    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66242426-e150-45e1-bb9f-e42a7052e80c-credential-socket\") pod \"66242426-e150-45e1-bb9f-e42a7052e80c\" (UID: \"66242426-e150-45e1-bb9f-e42a7052e80c\") "
Jul 28 20:10:15.955265 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:15.955188    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66242426-e150-45e1-bb9f-e42a7052e80c-istio-token\") pod \"66242426-e150-45e1-bb9f-e42a7052e80c\" (UID: \"66242426-e150-45e1-bb9f-e42a7052e80c\") "
Jul 28 20:10:15.955265 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:15.955233    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66242426-e150-45e1-bb9f-e42a7052e80c-istio-envoy\") pod \"66242426-e150-45e1-bb9f-e42a7052e80c\" (UID: \"66242426-e150-45e1-bb9f-e42a7052e80c\") "
Jul 28 20:10:15.955393 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:15.955268    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66242426-e150-45e1-bb9f-e42a7052e80c-workload-certs\") pod \"66242426-e150-45e1-bb9f-e42a7052e80c\" (UID: \"66242426-e150-45e1-bb9f-e42a7052e80c\") "
Jul 28 20:10:15.955393 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:15.955301    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66242426-e150-45e1-bb9f-e42a7052e80c-workload-socket\") pod \"66242426-e150-45e1-bb9f-e42a7052e80c\" (UID: \"66242426-e150-45e1-bb9f-e42a7052e80c\") "
Jul 28 20:10:15.955393 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:15.955346    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66242426-e150-45e1-bb9f-e42a7052e80c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "66242426-e150-45e1-bb9f-e42a7052e80c" (UID: "66242426-e150-45e1-bb9f-e42a7052e80c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:10:15.955393 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:15.955350    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66242426-e150-45e1-bb9f-e42a7052e80c-istiod-ca-cert\") pod \"66242426-e150-45e1-bb9f-e42a7052e80c\" (UID: \"66242426-e150-45e1-bb9f-e42a7052e80c\") "
Jul 28 20:10:15.955614 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:15.955401    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtsqm\" (UniqueName: \"kubernetes.io/projected/66242426-e150-45e1-bb9f-e42a7052e80c-kube-api-access-gtsqm\") pod \"66242426-e150-45e1-bb9f-e42a7052e80c\" (UID: \"66242426-e150-45e1-bb9f-e42a7052e80c\") "
Jul 28 20:10:15.955614 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:15.955542    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66242426-e150-45e1-bb9f-e42a7052e80c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "66242426-e150-45e1-bb9f-e42a7052e80c" (UID: "66242426-e150-45e1-bb9f-e42a7052e80c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:10:15.955731 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:15.955637    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66242426-e150-45e1-bb9f-e42a7052e80c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "66242426-e150-45e1-bb9f-e42a7052e80c" (UID: "66242426-e150-45e1-bb9f-e42a7052e80c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:10:15.955731 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:15.955656    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66242426-e150-45e1-bb9f-e42a7052e80c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "66242426-e150-45e1-bb9f-e42a7052e80c" (UID: "66242426-e150-45e1-bb9f-e42a7052e80c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:10:15.955841 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:15.955769    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66242426-e150-45e1-bb9f-e42a7052e80c-workload-socket\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:10:15.955841 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:15.955789    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66242426-e150-45e1-bb9f-e42a7052e80c-istiod-ca-cert\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:10:15.955841 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:15.955804    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66242426-e150-45e1-bb9f-e42a7052e80c-credential-socket\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:10:15.955841 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:15.955818    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66242426-e150-45e1-bb9f-e42a7052e80c-workload-certs\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:10:15.956090 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:15.956068    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66242426-e150-45e1-bb9f-e42a7052e80c-istio-data" (OuterVolumeSpecName: "istio-data") pod "66242426-e150-45e1-bb9f-e42a7052e80c" (UID: "66242426-e150-45e1-bb9f-e42a7052e80c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:10:15.957366 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:15.957337    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66242426-e150-45e1-bb9f-e42a7052e80c-istio-token" (OuterVolumeSpecName: "istio-token") pod "66242426-e150-45e1-bb9f-e42a7052e80c" (UID: "66242426-e150-45e1-bb9f-e42a7052e80c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:10:15.957480 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:15.957409    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66242426-e150-45e1-bb9f-e42a7052e80c-kube-api-access-gtsqm" (OuterVolumeSpecName: "kube-api-access-gtsqm") pod "66242426-e150-45e1-bb9f-e42a7052e80c" (UID: "66242426-e150-45e1-bb9f-e42a7052e80c"). InnerVolumeSpecName "kube-api-access-gtsqm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:10:15.957788 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:15.957765    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66242426-e150-45e1-bb9f-e42a7052e80c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "66242426-e150-45e1-bb9f-e42a7052e80c" (UID: "66242426-e150-45e1-bb9f-e42a7052e80c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:10:15.957896 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:15.957771    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/66242426-e150-45e1-bb9f-e42a7052e80c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "66242426-e150-45e1-bb9f-e42a7052e80c" (UID: "66242426-e150-45e1-bb9f-e42a7052e80c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:10:16.057068 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:16.057033    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66242426-e150-45e1-bb9f-e42a7052e80c-istio-token\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:10:16.057068 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:16.057060    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66242426-e150-45e1-bb9f-e42a7052e80c-istio-envoy\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:10:16.057068 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:16.057070    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtsqm\" (UniqueName: \"kubernetes.io/projected/66242426-e150-45e1-bb9f-e42a7052e80c-kube-api-access-gtsqm\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:10:16.057307 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:16.057081    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66242426-e150-45e1-bb9f-e42a7052e80c-istio-podinfo\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:10:16.057307 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:16.057091    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66242426-e150-45e1-bb9f-e42a7052e80c-istio-data\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:10:16.447488 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:16.447454    2570 generic.go:356] "Generic (PLEG): container finished" podID="66242426-e150-45e1-bb9f-e42a7052e80c" containerID="e3f5295ebff197014e3cd9e5feb33b6944cb9b958971c457510d488d4f66aadb" exitCode=0
Jul 28 20:10:16.447665 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:16.447513    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"
Jul 28 20:10:16.447665 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:16.447539    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx" event={"ID":"66242426-e150-45e1-bb9f-e42a7052e80c","Type":"ContainerDied","Data":"e3f5295ebff197014e3cd9e5feb33b6944cb9b958971c457510d488d4f66aadb"}
Jul 28 20:10:16.447665 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:16.447618    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx" event={"ID":"66242426-e150-45e1-bb9f-e42a7052e80c","Type":"ContainerDied","Data":"5ca85c1f1931a8d4e4200d07afd52d74af3fbb7954ba090e6a733d4de15b11d1"}
Jul 28 20:10:16.447665 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:16.447641    2570 scope.go:117] "RemoveContainer" containerID="e3f5295ebff197014e3cd9e5feb33b6944cb9b958971c457510d488d4f66aadb"
Jul 28 20:10:16.456809 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:16.456792    2570 scope.go:117] "RemoveContainer" containerID="8a92ad85abf42897bbf16474691615f140d18d939126ee65b96c17e0ec4baea1"
Jul 28 20:10:16.464341 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:16.464325    2570 scope.go:117] "RemoveContainer" containerID="e3f5295ebff197014e3cd9e5feb33b6944cb9b958971c457510d488d4f66aadb"
Jul 28 20:10:16.464581 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:10:16.464561    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3f5295ebff197014e3cd9e5feb33b6944cb9b958971c457510d488d4f66aadb\": container with ID starting with e3f5295ebff197014e3cd9e5feb33b6944cb9b958971c457510d488d4f66aadb not found: ID does not exist" containerID="e3f5295ebff197014e3cd9e5feb33b6944cb9b958971c457510d488d4f66aadb"
Jul 28 20:10:16.464649 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:16.464594    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3f5295ebff197014e3cd9e5feb33b6944cb9b958971c457510d488d4f66aadb"} err="failed to get container status \"e3f5295ebff197014e3cd9e5feb33b6944cb9b958971c457510d488d4f66aadb\": rpc error: code = NotFound desc = could not find container \"e3f5295ebff197014e3cd9e5feb33b6944cb9b958971c457510d488d4f66aadb\": container with ID starting with e3f5295ebff197014e3cd9e5feb33b6944cb9b958971c457510d488d4f66aadb not found: ID does not exist"
Jul 28 20:10:16.464649 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:16.464615    2570 scope.go:117] "RemoveContainer" containerID="8a92ad85abf42897bbf16474691615f140d18d939126ee65b96c17e0ec4baea1"
Jul 28 20:10:16.464842 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:10:16.464827    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a92ad85abf42897bbf16474691615f140d18d939126ee65b96c17e0ec4baea1\": container with ID starting with 8a92ad85abf42897bbf16474691615f140d18d939126ee65b96c17e0ec4baea1 not found: ID does not exist" containerID="8a92ad85abf42897bbf16474691615f140d18d939126ee65b96c17e0ec4baea1"
Jul 28 20:10:16.464891 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:16.464845    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a92ad85abf42897bbf16474691615f140d18d939126ee65b96c17e0ec4baea1"} err="failed to get container status \"8a92ad85abf42897bbf16474691615f140d18d939126ee65b96c17e0ec4baea1\": rpc error: code = NotFound desc = could not find container \"8a92ad85abf42897bbf16474691615f140d18d939126ee65b96c17e0ec4baea1\": container with ID starting with 8a92ad85abf42897bbf16474691615f140d18d939126ee65b96c17e0ec4baea1 not found: ID does not exist"
Jul 28 20:10:16.469667 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:16.469639    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"]
Jul 28 20:10:16.475598 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:16.475577    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-89688d3f-openshift-default-56df46844-sb7rx"]
Jul 28 20:10:17.572800 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:17.572767    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66242426-e150-45e1-bb9f-e42a7052e80c" path="/var/lib/kubelet/pods/66242426-e150-45e1-bb9f-e42a7052e80c/volumes"
Jul 28 20:10:47.748674 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:10:47.748643    2570 scope.go:117] "RemoveContainer" containerID="2430418be045735cdfe2e4d9b7d0ea9cf8e15593b1e35861750f3ac52ab25330"
Jul 28 20:11:06.297253 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.297206    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"]
Jul 28 20:11:06.297826 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.297668    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f46e501-5090-4671-9e7e-43fd9fed3d94" containerName="payload-processing"
Jul 28 20:11:06.297826 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.297688    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f46e501-5090-4671-9e7e-43fd9fed3d94" containerName="payload-processing"
Jul 28 20:11:06.297826 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.297707    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66242426-e150-45e1-bb9f-e42a7052e80c" containerName="istio-proxy"
Jul 28 20:11:06.297826 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.297716    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="66242426-e150-45e1-bb9f-e42a7052e80c" containerName="istio-proxy"
Jul 28 20:11:06.297826 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.297732    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e06746f2-ab0b-4ad5-9b66-ad5673cb7f4f" containerName="payload-pre-processing"
Jul 28 20:11:06.297826 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.297741    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e06746f2-ab0b-4ad5-9b66-ad5673cb7f4f" containerName="payload-pre-processing"
Jul 28 20:11:06.297826 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.297750    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f2dcec3-b996-4d8b-b8e0-d60580410b7e" containerName="revoke-keys"
Jul 28 20:11:06.297826 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.297759    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f2dcec3-b996-4d8b-b8e0-d60580410b7e" containerName="revoke-keys"
Jul 28 20:11:06.297826 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.297771    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66242426-e150-45e1-bb9f-e42a7052e80c" containerName="istio-proxy"
Jul 28 20:11:06.297826 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.297780    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="66242426-e150-45e1-bb9f-e42a7052e80c" containerName="istio-proxy"
Jul 28 20:11:06.298353 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.297858    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="66242426-e150-45e1-bb9f-e42a7052e80c" containerName="istio-proxy"
Jul 28 20:11:06.298353 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.297871    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="66242426-e150-45e1-bb9f-e42a7052e80c" containerName="istio-proxy"
Jul 28 20:11:06.298353 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.297882    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f2dcec3-b996-4d8b-b8e0-d60580410b7e" containerName="revoke-keys"
Jul 28 20:11:06.298353 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.297894    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f46e501-5090-4671-9e7e-43fd9fed3d94" containerName="payload-processing"
Jul 28 20:11:06.298353 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.297904    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e06746f2-ab0b-4ad5-9b66-ad5673cb7f4f" containerName="payload-pre-processing"
Jul 28 20:11:06.299958 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.299936    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:11:06.302507 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.302489    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-68aa77-openshift-default-dockercfg-jdf9s\""
Jul 28 20:11:06.311504 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.311483    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"]
Jul 28 20:11:06.395704 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.395671    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/746e9260-a76e-4f8d-991d-1977860c3790-workload-socket\") pod \"e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs\" (UID: \"746e9260-a76e-4f8d-991d-1977860c3790\") " pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:11:06.395870 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.395711    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htj7q\" (UniqueName: \"kubernetes.io/projected/746e9260-a76e-4f8d-991d-1977860c3790-kube-api-access-htj7q\") pod \"e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs\" (UID: \"746e9260-a76e-4f8d-991d-1977860c3790\") " pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:11:06.395870 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.395735    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/746e9260-a76e-4f8d-991d-1977860c3790-istio-data\") pod \"e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs\" (UID: \"746e9260-a76e-4f8d-991d-1977860c3790\") " pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:11:06.395870 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.395779    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/746e9260-a76e-4f8d-991d-1977860c3790-istio-podinfo\") pod \"e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs\" (UID: \"746e9260-a76e-4f8d-991d-1977860c3790\") " pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:11:06.395870 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.395807    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/746e9260-a76e-4f8d-991d-1977860c3790-istio-token\") pod \"e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs\" (UID: \"746e9260-a76e-4f8d-991d-1977860c3790\") " pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:11:06.395870 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.395843    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/746e9260-a76e-4f8d-991d-1977860c3790-istio-envoy\") pod \"e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs\" (UID: \"746e9260-a76e-4f8d-991d-1977860c3790\") " pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:11:06.395870 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.395861    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/746e9260-a76e-4f8d-991d-1977860c3790-credential-socket\") pod \"e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs\" (UID: \"746e9260-a76e-4f8d-991d-1977860c3790\") " pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:11:06.396103 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.395876    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/746e9260-a76e-4f8d-991d-1977860c3790-workload-certs\") pod \"e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs\" (UID: \"746e9260-a76e-4f8d-991d-1977860c3790\") " pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:11:06.396103 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.395912    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/746e9260-a76e-4f8d-991d-1977860c3790-istiod-ca-cert\") pod \"e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs\" (UID: \"746e9260-a76e-4f8d-991d-1977860c3790\") " pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:11:06.497210 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.497171    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/746e9260-a76e-4f8d-991d-1977860c3790-istio-token\") pod \"e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs\" (UID: \"746e9260-a76e-4f8d-991d-1977860c3790\") " pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:11:06.497415 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.497227    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/746e9260-a76e-4f8d-991d-1977860c3790-istio-envoy\") pod \"e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs\" (UID: \"746e9260-a76e-4f8d-991d-1977860c3790\") " pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:11:06.497415 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.497252    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/746e9260-a76e-4f8d-991d-1977860c3790-credential-socket\") pod \"e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs\" (UID: \"746e9260-a76e-4f8d-991d-1977860c3790\") " pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:11:06.497415 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.497276    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/746e9260-a76e-4f8d-991d-1977860c3790-workload-certs\") pod \"e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs\" (UID: \"746e9260-a76e-4f8d-991d-1977860c3790\") " pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:11:06.497415 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.497296    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/746e9260-a76e-4f8d-991d-1977860c3790-istiod-ca-cert\") pod \"e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs\" (UID: \"746e9260-a76e-4f8d-991d-1977860c3790\") " pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:11:06.497415 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.497368    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/746e9260-a76e-4f8d-991d-1977860c3790-workload-socket\") pod \"e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs\" (UID: \"746e9260-a76e-4f8d-991d-1977860c3790\") " pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:11:06.497415 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.497397    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htj7q\" (UniqueName: \"kubernetes.io/projected/746e9260-a76e-4f8d-991d-1977860c3790-kube-api-access-htj7q\") pod \"e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs\" (UID: \"746e9260-a76e-4f8d-991d-1977860c3790\") " pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:11:06.497743 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.497428    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/746e9260-a76e-4f8d-991d-1977860c3790-istio-data\") pod \"e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs\" (UID: \"746e9260-a76e-4f8d-991d-1977860c3790\") " pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:11:06.497743 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.497464    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/746e9260-a76e-4f8d-991d-1977860c3790-istio-podinfo\") pod \"e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs\" (UID: \"746e9260-a76e-4f8d-991d-1977860c3790\") " pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:11:06.497743 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.497693    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/746e9260-a76e-4f8d-991d-1977860c3790-credential-socket\") pod \"e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs\" (UID: \"746e9260-a76e-4f8d-991d-1977860c3790\") " pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:11:06.497898 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.497752    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/746e9260-a76e-4f8d-991d-1977860c3790-workload-certs\") pod \"e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs\" (UID: \"746e9260-a76e-4f8d-991d-1977860c3790\") " pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:11:06.497898 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.497856    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/746e9260-a76e-4f8d-991d-1977860c3790-workload-socket\") pod \"e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs\" (UID: \"746e9260-a76e-4f8d-991d-1977860c3790\") " pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:11:06.498051 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.498015    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/746e9260-a76e-4f8d-991d-1977860c3790-istio-data\") pod \"e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs\" (UID: \"746e9260-a76e-4f8d-991d-1977860c3790\") " pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:11:06.498124 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.498104    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/746e9260-a76e-4f8d-991d-1977860c3790-istiod-ca-cert\") pod \"e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs\" (UID: \"746e9260-a76e-4f8d-991d-1977860c3790\") " pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:11:06.499767 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.499744    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/746e9260-a76e-4f8d-991d-1977860c3790-istio-envoy\") pod \"e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs\" (UID: \"746e9260-a76e-4f8d-991d-1977860c3790\") " pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:11:06.500216 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.500195    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/746e9260-a76e-4f8d-991d-1977860c3790-istio-podinfo\") pod \"e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs\" (UID: \"746e9260-a76e-4f8d-991d-1977860c3790\") " pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:11:06.504937 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.504919    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/746e9260-a76e-4f8d-991d-1977860c3790-istio-token\") pod \"e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs\" (UID: \"746e9260-a76e-4f8d-991d-1977860c3790\") " pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:11:06.505108 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.505085    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htj7q\" (UniqueName: \"kubernetes.io/projected/746e9260-a76e-4f8d-991d-1977860c3790-kube-api-access-htj7q\") pod \"e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs\" (UID: \"746e9260-a76e-4f8d-991d-1977860c3790\") " pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:11:06.609814 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.609707    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:11:06.746042 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.746013    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"]
Jul 28 20:11:06.748429 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:11:06.748401    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod746e9260_a76e_4f8d_991d_1977860c3790.slice/crio-98aa4c2963714647a722ad75638126f66de3aa26e242afe69bc3ff8b719ac3b0 WatchSource:0}: Error finding container 98aa4c2963714647a722ad75638126f66de3aa26e242afe69bc3ff8b719ac3b0: Status 404 returned error can't find the container with id 98aa4c2963714647a722ad75638126f66de3aa26e242afe69bc3ff8b719ac3b0
Jul 28 20:11:06.750594 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.750560    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:11:06.750690 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.750631    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:11:06.750690 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:06.750658    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:11:07.671251 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:07.671216    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs" event={"ID":"746e9260-a76e-4f8d-991d-1977860c3790","Type":"ContainerStarted","Data":"0c18adbd7d82425d86a9367d2b832473f5380ac546e993be0c473c783c7f5d01"}
Jul 28 20:11:07.671645 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:07.671268    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs" event={"ID":"746e9260-a76e-4f8d-991d-1977860c3790","Type":"ContainerStarted","Data":"98aa4c2963714647a722ad75638126f66de3aa26e242afe69bc3ff8b719ac3b0"}
Jul 28 20:11:07.693149 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:07.693097    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs" podStartSLOduration=1.6930803129999998 podStartE2EDuration="1.693080313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:11:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:11:07.691004509 +0000 UTC m=+2480.643036854" watchObservedRunningTime="2026-07-28 20:11:07.693080313 +0000 UTC m=+2480.645112692"
Jul 28 20:11:08.610335 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:08.610298    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:11:08.615115 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:08.615090    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:11:08.676030 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:08.676003    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:11:08.677001 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:08.676966    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:11:10.284095 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:10.284056    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-68aa77-5b6bfd66c6-cshbq"]
Jul 28 20:11:10.286355 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:10.286337    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-68aa77-5b6bfd66c6-cshbq"
Jul 28 20:11:10.288894 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:10.288870    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-68aa77-dockercfg-l9m2j\""
Jul 28 20:11:10.289024 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:10.288918    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-68aa77\""
Jul 28 20:11:10.298501 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:10.298473    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-68aa77-5b6bfd66c6-cshbq"]
Jul 28 20:11:10.311447 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:10.311420    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-68aa77-5c84f466b-hzmqm"]
Jul 28 20:11:10.314266 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:10.314246    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-68aa77-5c84f466b-hzmqm"
Jul 28 20:11:10.328864 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:10.328840    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-68aa77-5c84f466b-hzmqm"]
Jul 28 20:11:10.437377 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:10.437342    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st4c5\" (UniqueName: \"kubernetes.io/projected/204f145f-c7fe-43f4-8e21-e2bcc947bb2f-kube-api-access-st4c5\") pod \"payload-processing-e2e-inf-a-68aa77-5c84f466b-hzmqm\" (UID: \"204f145f-c7fe-43f4-8e21-e2bcc947bb2f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-68aa77-5c84f466b-hzmqm"
Jul 28 20:11:10.437543 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:10.437429    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/204f145f-c7fe-43f4-8e21-e2bcc947bb2f-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-68aa77-5c84f466b-hzmqm\" (UID: \"204f145f-c7fe-43f4-8e21-e2bcc947bb2f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-68aa77-5c84f466b-hzmqm"
Jul 28 20:11:10.437543 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:10.437468    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7ec3b30-8d86-47ab-9c37-d3de4c1e7ddd-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-68aa77-5b6bfd66c6-cshbq\" (UID: \"b7ec3b30-8d86-47ab-9c37-d3de4c1e7ddd\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-68aa77-5b6bfd66c6-cshbq"
Jul 28 20:11:10.437543 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:10.437484    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m26cm\" (UniqueName: \"kubernetes.io/projected/b7ec3b30-8d86-47ab-9c37-d3de4c1e7ddd-kube-api-access-m26cm\") pod \"payload-pre-processing-e2e-inf-a-68aa77-5b6bfd66c6-cshbq\" (UID: \"b7ec3b30-8d86-47ab-9c37-d3de4c1e7ddd\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-68aa77-5b6bfd66c6-cshbq"
Jul 28 20:11:10.538758 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:10.538674    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/204f145f-c7fe-43f4-8e21-e2bcc947bb2f-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-68aa77-5c84f466b-hzmqm\" (UID: \"204f145f-c7fe-43f4-8e21-e2bcc947bb2f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-68aa77-5c84f466b-hzmqm"
Jul 28 20:11:10.538758 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:10.538720    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7ec3b30-8d86-47ab-9c37-d3de4c1e7ddd-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-68aa77-5b6bfd66c6-cshbq\" (UID: \"b7ec3b30-8d86-47ab-9c37-d3de4c1e7ddd\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-68aa77-5b6bfd66c6-cshbq"
Jul 28 20:11:10.538758 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:10.538740    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m26cm\" (UniqueName: \"kubernetes.io/projected/b7ec3b30-8d86-47ab-9c37-d3de4c1e7ddd-kube-api-access-m26cm\") pod \"payload-pre-processing-e2e-inf-a-68aa77-5b6bfd66c6-cshbq\" (UID: \"b7ec3b30-8d86-47ab-9c37-d3de4c1e7ddd\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-68aa77-5b6bfd66c6-cshbq"
Jul 28 20:11:10.539018 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:10.538770    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st4c5\" (UniqueName: \"kubernetes.io/projected/204f145f-c7fe-43f4-8e21-e2bcc947bb2f-kube-api-access-st4c5\") pod \"payload-processing-e2e-inf-a-68aa77-5c84f466b-hzmqm\" (UID: \"204f145f-c7fe-43f4-8e21-e2bcc947bb2f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-68aa77-5c84f466b-hzmqm"
Jul 28 20:11:10.539683 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:10.539657    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/204f145f-c7fe-43f4-8e21-e2bcc947bb2f-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-68aa77-5c84f466b-hzmqm\" (UID: \"204f145f-c7fe-43f4-8e21-e2bcc947bb2f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-68aa77-5c84f466b-hzmqm"
Jul 28 20:11:10.539724 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:10.539657    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7ec3b30-8d86-47ab-9c37-d3de4c1e7ddd-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-68aa77-5b6bfd66c6-cshbq\" (UID: \"b7ec3b30-8d86-47ab-9c37-d3de4c1e7ddd\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-68aa77-5b6bfd66c6-cshbq"
Jul 28 20:11:10.546705 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:10.546672    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m26cm\" (UniqueName: \"kubernetes.io/projected/b7ec3b30-8d86-47ab-9c37-d3de4c1e7ddd-kube-api-access-m26cm\") pod \"payload-pre-processing-e2e-inf-a-68aa77-5b6bfd66c6-cshbq\" (UID: \"b7ec3b30-8d86-47ab-9c37-d3de4c1e7ddd\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-68aa77-5b6bfd66c6-cshbq"
Jul 28 20:11:10.547049 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:10.547032    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-st4c5\" (UniqueName: \"kubernetes.io/projected/204f145f-c7fe-43f4-8e21-e2bcc947bb2f-kube-api-access-st4c5\") pod \"payload-processing-e2e-inf-a-68aa77-5c84f466b-hzmqm\" (UID: \"204f145f-c7fe-43f4-8e21-e2bcc947bb2f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-68aa77-5c84f466b-hzmqm"
Jul 28 20:11:10.598027 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:10.597993    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-68aa77-5b6bfd66c6-cshbq"
Jul 28 20:11:10.624581 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:10.624544    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-68aa77-5c84f466b-hzmqm"
Jul 28 20:11:10.736217 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:10.736143    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-68aa77-5b6bfd66c6-cshbq"]
Jul 28 20:11:10.739094 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:11:10.739059    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7ec3b30_8d86_47ab_9c37_d3de4c1e7ddd.slice/crio-71e5c1642001ce5522039414fe21e52a17815ace989e7ab59b0192af6c287ea5 WatchSource:0}: Error finding container 71e5c1642001ce5522039414fe21e52a17815ace989e7ab59b0192af6c287ea5: Status 404 returned error can't find the container with id 71e5c1642001ce5522039414fe21e52a17815ace989e7ab59b0192af6c287ea5
Jul 28 20:11:10.772077 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:10.772017    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-68aa77-5c84f466b-hzmqm"]
Jul 28 20:11:10.776013 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:11:10.775989    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod204f145f_c7fe_43f4_8e21_e2bcc947bb2f.slice/crio-dc6af9d65f7934c02c958a37cf06c9853d326e0977ee5868fdb1a0ad8968bedb WatchSource:0}: Error finding container dc6af9d65f7934c02c958a37cf06c9853d326e0977ee5868fdb1a0ad8968bedb: Status 404 returned error can't find the container with id dc6af9d65f7934c02c958a37cf06c9853d326e0977ee5868fdb1a0ad8968bedb
Jul 28 20:11:11.692894 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:11.692786    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-68aa77-5c84f466b-hzmqm" event={"ID":"204f145f-c7fe-43f4-8e21-e2bcc947bb2f","Type":"ContainerStarted","Data":"54d21ca6754d2c1e32f530cd041e60d0c527b63d9a9f3e303cae6b0ff2f54ec4"}
Jul 28 20:11:11.692894 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:11.692856    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-68aa77-5c84f466b-hzmqm" event={"ID":"204f145f-c7fe-43f4-8e21-e2bcc947bb2f","Type":"ContainerStarted","Data":"dc6af9d65f7934c02c958a37cf06c9853d326e0977ee5868fdb1a0ad8968bedb"}
Jul 28 20:11:11.692894 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:11.692888    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-68aa77-5c84f466b-hzmqm"
Jul 28 20:11:11.694552 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:11.694524    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-68aa77-5b6bfd66c6-cshbq" event={"ID":"b7ec3b30-8d86-47ab-9c37-d3de4c1e7ddd","Type":"ContainerStarted","Data":"5b6132ed28d592c56383caf8a44f56ee81598d0bafba0e590fdf171e5e491c6a"}
Jul 28 20:11:11.694687 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:11.694571    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-68aa77-5b6bfd66c6-cshbq"
Jul 28 20:11:11.694687 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:11.694588    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-68aa77-5b6bfd66c6-cshbq" event={"ID":"b7ec3b30-8d86-47ab-9c37-d3de4c1e7ddd","Type":"ContainerStarted","Data":"71e5c1642001ce5522039414fe21e52a17815ace989e7ab59b0192af6c287ea5"}
Jul 28 20:11:11.713017 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:11.712954    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-68aa77-5c84f466b-hzmqm" podStartSLOduration=1.712938278 podStartE2EDuration="1.712938278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:11:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:11:11.711928338 +0000 UTC m=+2484.663960692" watchObservedRunningTime="2026-07-28 20:11:11.712938278 +0000 UTC m=+2484.664970608"
Jul 28 20:11:11.730462 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:11.730412    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-68aa77-5b6bfd66c6-cshbq" podStartSLOduration=1.7303959660000001 podStartE2EDuration="1.730395966s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:11:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:11:11.727941965 +0000 UTC m=+2484.679974296" watchObservedRunningTime="2026-07-28 20:11:11.730395966 +0000 UTC m=+2484.682428296"
Jul 28 20:11:21.746013 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:21.745908    2570 generic.go:356] "Generic (PLEG): container finished" podID="746e9260-a76e-4f8d-991d-1977860c3790" containerID="0c18adbd7d82425d86a9367d2b832473f5380ac546e993be0c473c783c7f5d01" exitCode=0
Jul 28 20:11:21.746412 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:21.746007    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs" event={"ID":"746e9260-a76e-4f8d-991d-1977860c3790","Type":"ContainerDied","Data":"0c18adbd7d82425d86a9367d2b832473f5380ac546e993be0c473c783c7f5d01"}
Jul 28 20:11:21.746412 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:21.746373    2570 scope.go:117] "RemoveContainer" containerID="0c18adbd7d82425d86a9367d2b832473f5380ac546e993be0c473c783c7f5d01"
Jul 28 20:11:21.747295 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:21.747271    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:11:21.747414 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:21.747375    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:11:21.747482 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:21.747424    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:11:22.703606 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:22.703559    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-68aa77-5c84f466b-hzmqm"
Jul 28 20:11:22.705190 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:22.705158    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-68aa77-5b6bfd66c6-cshbq"
Jul 28 20:11:22.752907 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:22.752859    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs" event={"ID":"746e9260-a76e-4f8d-991d-1977860c3790","Type":"ContainerStarted","Data":"b7afb7e9ccf5d2e319ef8666715bdcc6de81bf8b234d1786cfa9ff21c8d11349"}
Jul 28 20:11:23.611937 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:23.611897    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:11:23.612175 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:23.612049    2570 patch_prober.go:28] interesting pod/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 28 20:11:23.612175 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:23.612113    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs" podUID="746e9260-a76e-4f8d-991d-1977860c3790" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 28 20:11:23.676866 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:23.676836    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:11:24.611046 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:24.611007    2570 patch_prober.go:28] interesting pod/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 28 20:11:24.611672 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:24.611636    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs" podUID="746e9260-a76e-4f8d-991d-1977860c3790" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 28 20:11:25.610844 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:25.610807    2570 patch_prober.go:28] interesting pod/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 28 20:11:25.611144 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:25.611112    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs" podUID="746e9260-a76e-4f8d-991d-1977860c3790" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 28 20:11:26.610330 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:26.610293    2570 patch_prober.go:28] interesting pod/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 28 20:11:26.610503 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:26.610359    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs" podUID="746e9260-a76e-4f8d-991d-1977860c3790" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 28 20:11:27.614651 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:27.614619    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:11:27.620906 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:27.615696    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:11:35.185046 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.184955    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"]
Jul 28 20:11:35.187403 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.187370    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:11:35.190559 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.190536    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-e98043-openshift-default-dockercfg-5w8pp\""
Jul 28 20:11:35.199126 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.199104    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"]
Jul 28 20:11:35.254837 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.254800    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26b45581-edb6-43f0-9090-a409e545dce6-istiod-ca-cert\") pod \"e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8\" (UID: \"26b45581-edb6-43f0-9090-a409e545dce6\") " pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:11:35.254837 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.254835    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj4pg\" (UniqueName: \"kubernetes.io/projected/26b45581-edb6-43f0-9090-a409e545dce6-kube-api-access-rj4pg\") pod \"e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8\" (UID: \"26b45581-edb6-43f0-9090-a409e545dce6\") " pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:11:35.255186 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.254861    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26b45581-edb6-43f0-9090-a409e545dce6-workload-certs\") pod \"e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8\" (UID: \"26b45581-edb6-43f0-9090-a409e545dce6\") " pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:11:35.255186 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.254906    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26b45581-edb6-43f0-9090-a409e545dce6-istio-podinfo\") pod \"e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8\" (UID: \"26b45581-edb6-43f0-9090-a409e545dce6\") " pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:11:35.255186 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.254957    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26b45581-edb6-43f0-9090-a409e545dce6-credential-socket\") pod \"e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8\" (UID: \"26b45581-edb6-43f0-9090-a409e545dce6\") " pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:11:35.255186 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.255012    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26b45581-edb6-43f0-9090-a409e545dce6-istio-data\") pod \"e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8\" (UID: \"26b45581-edb6-43f0-9090-a409e545dce6\") " pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:11:35.255186 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.255046    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26b45581-edb6-43f0-9090-a409e545dce6-istio-token\") pod \"e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8\" (UID: \"26b45581-edb6-43f0-9090-a409e545dce6\") " pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:11:35.255186 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.255086    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26b45581-edb6-43f0-9090-a409e545dce6-workload-socket\") pod \"e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8\" (UID: \"26b45581-edb6-43f0-9090-a409e545dce6\") " pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:11:35.255186 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.255103    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26b45581-edb6-43f0-9090-a409e545dce6-istio-envoy\") pod \"e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8\" (UID: \"26b45581-edb6-43f0-9090-a409e545dce6\") " pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:11:35.356470 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.356430    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26b45581-edb6-43f0-9090-a409e545dce6-istiod-ca-cert\") pod \"e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8\" (UID: \"26b45581-edb6-43f0-9090-a409e545dce6\") " pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:11:35.356470 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.356470    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj4pg\" (UniqueName: \"kubernetes.io/projected/26b45581-edb6-43f0-9090-a409e545dce6-kube-api-access-rj4pg\") pod \"e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8\" (UID: \"26b45581-edb6-43f0-9090-a409e545dce6\") " pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:11:35.356711 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.356497    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26b45581-edb6-43f0-9090-a409e545dce6-workload-certs\") pod \"e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8\" (UID: \"26b45581-edb6-43f0-9090-a409e545dce6\") " pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:11:35.356711 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.356512    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26b45581-edb6-43f0-9090-a409e545dce6-istio-podinfo\") pod \"e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8\" (UID: \"26b45581-edb6-43f0-9090-a409e545dce6\") " pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:11:35.356711 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.356536    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26b45581-edb6-43f0-9090-a409e545dce6-credential-socket\") pod \"e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8\" (UID: \"26b45581-edb6-43f0-9090-a409e545dce6\") " pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:11:35.356711 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.356553    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26b45581-edb6-43f0-9090-a409e545dce6-istio-data\") pod \"e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8\" (UID: \"26b45581-edb6-43f0-9090-a409e545dce6\") " pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:11:35.356711 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.356574    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26b45581-edb6-43f0-9090-a409e545dce6-istio-token\") pod \"e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8\" (UID: \"26b45581-edb6-43f0-9090-a409e545dce6\") " pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:11:35.357080 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.356918    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26b45581-edb6-43f0-9090-a409e545dce6-workload-certs\") pod \"e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8\" (UID: \"26b45581-edb6-43f0-9090-a409e545dce6\") " pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:11:35.357080 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.356931    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26b45581-edb6-43f0-9090-a409e545dce6-workload-socket\") pod \"e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8\" (UID: \"26b45581-edb6-43f0-9090-a409e545dce6\") " pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:11:35.357080 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.356956    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26b45581-edb6-43f0-9090-a409e545dce6-credential-socket\") pod \"e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8\" (UID: \"26b45581-edb6-43f0-9090-a409e545dce6\") " pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:11:35.357080 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.356999    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26b45581-edb6-43f0-9090-a409e545dce6-istio-envoy\") pod \"e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8\" (UID: \"26b45581-edb6-43f0-9090-a409e545dce6\") " pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:11:35.357080 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.357060    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26b45581-edb6-43f0-9090-a409e545dce6-istio-data\") pod \"e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8\" (UID: \"26b45581-edb6-43f0-9090-a409e545dce6\") " pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:11:35.357257 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.357197    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26b45581-edb6-43f0-9090-a409e545dce6-workload-socket\") pod \"e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8\" (UID: \"26b45581-edb6-43f0-9090-a409e545dce6\") " pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:11:35.357393 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.357369    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26b45581-edb6-43f0-9090-a409e545dce6-istiod-ca-cert\") pod \"e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8\" (UID: \"26b45581-edb6-43f0-9090-a409e545dce6\") " pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:11:35.359018 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.358996    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26b45581-edb6-43f0-9090-a409e545dce6-istio-envoy\") pod \"e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8\" (UID: \"26b45581-edb6-43f0-9090-a409e545dce6\") " pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:11:35.359228 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.359213    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26b45581-edb6-43f0-9090-a409e545dce6-istio-podinfo\") pod \"e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8\" (UID: \"26b45581-edb6-43f0-9090-a409e545dce6\") " pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:11:35.364719 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.364689    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj4pg\" (UniqueName: \"kubernetes.io/projected/26b45581-edb6-43f0-9090-a409e545dce6-kube-api-access-rj4pg\") pod \"e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8\" (UID: \"26b45581-edb6-43f0-9090-a409e545dce6\") " pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:11:35.364830 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.364783    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26b45581-edb6-43f0-9090-a409e545dce6-istio-token\") pod \"e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8\" (UID: \"26b45581-edb6-43f0-9090-a409e545dce6\") " pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:11:35.498072 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.497995    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:11:35.631034 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.630889    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"]
Jul 28 20:11:35.633854 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:11:35.633821    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26b45581_edb6_43f0_9090_a409e545dce6.slice/crio-c653c8a6761d6ca4b2e1019dfbf02bc775e62696b1f6fba47f684062958c24c8 WatchSource:0}: Error finding container c653c8a6761d6ca4b2e1019dfbf02bc775e62696b1f6fba47f684062958c24c8: Status 404 returned error can't find the container with id c653c8a6761d6ca4b2e1019dfbf02bc775e62696b1f6fba47f684062958c24c8
Jul 28 20:11:35.636139 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.636102    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:11:35.636226 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.636185    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:11:35.636267 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.636225    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:11:35.812900 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.812811    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8" event={"ID":"26b45581-edb6-43f0-9090-a409e545dce6","Type":"ContainerStarted","Data":"a0f2f9c2ef1c38eb24b466597d40f98db416c6ff1e966106e5cb4c15aa40aea4"}
Jul 28 20:11:35.812900 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.812871    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8" event={"ID":"26b45581-edb6-43f0-9090-a409e545dce6","Type":"ContainerStarted","Data":"c653c8a6761d6ca4b2e1019dfbf02bc775e62696b1f6fba47f684062958c24c8"}
Jul 28 20:11:35.832392 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:35.832342    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8" podStartSLOduration=0.832321744 podStartE2EDuration="832.321744ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:11:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:11:35.83170993 +0000 UTC m=+2508.783742288" watchObservedRunningTime="2026-07-28 20:11:35.832321744 +0000 UTC m=+2508.784354076"
Jul 28 20:11:36.498423 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:36.498389    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:11:36.503310 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:36.503285    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:11:36.818756 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:36.818669    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:11:36.819573 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:36.819556    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:11:38.433601 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:38.433555    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-e98043-84fb6bcffb-7bwrm"]
Jul 28 20:11:38.436196 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:38.436177    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e98043-84fb6bcffb-7bwrm"
Jul 28 20:11:38.439131 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:38.439116    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-e98043\""
Jul 28 20:11:38.446189 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:38.446168    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-e98043-84fb6bcffb-7bwrm"]
Jul 28 20:11:38.480173 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:38.480147    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-e98043-7f4d859bc8-fz7lm"]
Jul 28 20:11:38.482608 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:38.482594    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-e98043-7f4d859bc8-fz7lm"
Jul 28 20:11:38.484967 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:38.484948    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-e98043-dockercfg-x6gtc\""
Jul 28 20:11:38.485052 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:38.485014    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e8bcdd7-1771-4503-a172-f53dc33857f5-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-e98043-84fb6bcffb-7bwrm\" (UID: \"3e8bcdd7-1771-4503-a172-f53dc33857f5\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e98043-84fb6bcffb-7bwrm"
Jul 28 20:11:38.485103 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:38.485082    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxnqd\" (UniqueName: \"kubernetes.io/projected/3e8bcdd7-1771-4503-a172-f53dc33857f5-kube-api-access-hxnqd\") pod \"payload-pre-processing-e2e-inf-b-e98043-84fb6bcffb-7bwrm\" (UID: \"3e8bcdd7-1771-4503-a172-f53dc33857f5\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e98043-84fb6bcffb-7bwrm"
Jul 28 20:11:38.492443 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:38.492418    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-e98043-7f4d859bc8-fz7lm"]
Jul 28 20:11:38.586373 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:38.586340    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pbt8\" (UniqueName: \"kubernetes.io/projected/9163fed7-4384-446e-afc7-9dd141375611-kube-api-access-5pbt8\") pod \"payload-processing-e2e-inf-b-e98043-7f4d859bc8-fz7lm\" (UID: \"9163fed7-4384-446e-afc7-9dd141375611\") " pod="openshift-ingress/payload-processing-e2e-inf-b-e98043-7f4d859bc8-fz7lm"
Jul 28 20:11:38.586543 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:38.586380    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e8bcdd7-1771-4503-a172-f53dc33857f5-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-e98043-84fb6bcffb-7bwrm\" (UID: \"3e8bcdd7-1771-4503-a172-f53dc33857f5\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e98043-84fb6bcffb-7bwrm"
Jul 28 20:11:38.586543 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:38.586414    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9163fed7-4384-446e-afc7-9dd141375611-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-e98043-7f4d859bc8-fz7lm\" (UID: \"9163fed7-4384-446e-afc7-9dd141375611\") " pod="openshift-ingress/payload-processing-e2e-inf-b-e98043-7f4d859bc8-fz7lm"
Jul 28 20:11:38.586543 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:38.586440    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxnqd\" (UniqueName: \"kubernetes.io/projected/3e8bcdd7-1771-4503-a172-f53dc33857f5-kube-api-access-hxnqd\") pod \"payload-pre-processing-e2e-inf-b-e98043-84fb6bcffb-7bwrm\" (UID: \"3e8bcdd7-1771-4503-a172-f53dc33857f5\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e98043-84fb6bcffb-7bwrm"
Jul 28 20:11:38.587319 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:38.587296    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e8bcdd7-1771-4503-a172-f53dc33857f5-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-e98043-84fb6bcffb-7bwrm\" (UID: \"3e8bcdd7-1771-4503-a172-f53dc33857f5\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e98043-84fb6bcffb-7bwrm"
Jul 28 20:11:38.595121 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:38.595097    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxnqd\" (UniqueName: \"kubernetes.io/projected/3e8bcdd7-1771-4503-a172-f53dc33857f5-kube-api-access-hxnqd\") pod \"payload-pre-processing-e2e-inf-b-e98043-84fb6bcffb-7bwrm\" (UID: \"3e8bcdd7-1771-4503-a172-f53dc33857f5\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e98043-84fb6bcffb-7bwrm"
Jul 28 20:11:38.687318 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:38.687228    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pbt8\" (UniqueName: \"kubernetes.io/projected/9163fed7-4384-446e-afc7-9dd141375611-kube-api-access-5pbt8\") pod \"payload-processing-e2e-inf-b-e98043-7f4d859bc8-fz7lm\" (UID: \"9163fed7-4384-446e-afc7-9dd141375611\") " pod="openshift-ingress/payload-processing-e2e-inf-b-e98043-7f4d859bc8-fz7lm"
Jul 28 20:11:38.687318 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:38.687276    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9163fed7-4384-446e-afc7-9dd141375611-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-e98043-7f4d859bc8-fz7lm\" (UID: \"9163fed7-4384-446e-afc7-9dd141375611\") " pod="openshift-ingress/payload-processing-e2e-inf-b-e98043-7f4d859bc8-fz7lm"
Jul 28 20:11:38.687919 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:38.687900    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9163fed7-4384-446e-afc7-9dd141375611-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-e98043-7f4d859bc8-fz7lm\" (UID: \"9163fed7-4384-446e-afc7-9dd141375611\") " pod="openshift-ingress/payload-processing-e2e-inf-b-e98043-7f4d859bc8-fz7lm"
Jul 28 20:11:38.696592 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:38.696559    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pbt8\" (UniqueName: \"kubernetes.io/projected/9163fed7-4384-446e-afc7-9dd141375611-kube-api-access-5pbt8\") pod \"payload-processing-e2e-inf-b-e98043-7f4d859bc8-fz7lm\" (UID: \"9163fed7-4384-446e-afc7-9dd141375611\") " pod="openshift-ingress/payload-processing-e2e-inf-b-e98043-7f4d859bc8-fz7lm"
Jul 28 20:11:38.748407 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:38.748373    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e98043-84fb6bcffb-7bwrm"
Jul 28 20:11:38.792623 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:38.792590    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-e98043-7f4d859bc8-fz7lm"
Jul 28 20:11:38.893686 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:38.892736    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-e98043-84fb6bcffb-7bwrm"]
Jul 28 20:11:38.896188 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:11:38.896146    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e8bcdd7_1771_4503_a172_f53dc33857f5.slice/crio-272c7b8fc37aa91665bacfa4eb4e934b767d37af623050965989fcfad6d14d4c WatchSource:0}: Error finding container 272c7b8fc37aa91665bacfa4eb4e934b767d37af623050965989fcfad6d14d4c: Status 404 returned error can't find the container with id 272c7b8fc37aa91665bacfa4eb4e934b767d37af623050965989fcfad6d14d4c
Jul 28 20:11:39.157814 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:39.157788    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-e98043-7f4d859bc8-fz7lm"]
Jul 28 20:11:39.159828 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:11:39.159798    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9163fed7_4384_446e_afc7_9dd141375611.slice/crio-373afa3aa422a850341665ad3f96f710f1edca241b18381dc6d7fa616c7946a0 WatchSource:0}: Error finding container 373afa3aa422a850341665ad3f96f710f1edca241b18381dc6d7fa616c7946a0: Status 404 returned error can't find the container with id 373afa3aa422a850341665ad3f96f710f1edca241b18381dc6d7fa616c7946a0
Jul 28 20:11:39.836244 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:39.836204    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-e98043-7f4d859bc8-fz7lm" event={"ID":"9163fed7-4384-446e-afc7-9dd141375611","Type":"ContainerStarted","Data":"7357f14a79ddedbd50e02bf91fe8da13a58f3be8ba902631cbc5155fecd3f672"}
Jul 28 20:11:39.836704 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:39.836262    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-e98043-7f4d859bc8-fz7lm" event={"ID":"9163fed7-4384-446e-afc7-9dd141375611","Type":"ContainerStarted","Data":"373afa3aa422a850341665ad3f96f710f1edca241b18381dc6d7fa616c7946a0"}
Jul 28 20:11:39.836704 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:39.836333    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-e98043-7f4d859bc8-fz7lm"
Jul 28 20:11:39.837698 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:39.837672    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e98043-84fb6bcffb-7bwrm" event={"ID":"3e8bcdd7-1771-4503-a172-f53dc33857f5","Type":"ContainerStarted","Data":"654283ab33a02e8cdb2a68df2fcfabb40b057f623243fb3a8c0783b4449d694c"}
Jul 28 20:11:39.837811 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:39.837717    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e98043-84fb6bcffb-7bwrm" event={"ID":"3e8bcdd7-1771-4503-a172-f53dc33857f5","Type":"ContainerStarted","Data":"272c7b8fc37aa91665bacfa4eb4e934b767d37af623050965989fcfad6d14d4c"}
Jul 28 20:11:39.837811 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:39.837755    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e98043-84fb6bcffb-7bwrm"
Jul 28 20:11:39.854944 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:39.854894    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-e98043-7f4d859bc8-fz7lm" podStartSLOduration=1.854879685 podStartE2EDuration="1.854879685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:11:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:11:39.852593434 +0000 UTC m=+2512.804625763" watchObservedRunningTime="2026-07-28 20:11:39.854879685 +0000 UTC m=+2512.806912374"
Jul 28 20:11:39.870668 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:39.870625    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e98043-84fb6bcffb-7bwrm" podStartSLOduration=1.870610184 podStartE2EDuration="1.870610184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:11:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:11:39.869163981 +0000 UTC m=+2512.821196357" watchObservedRunningTime="2026-07-28 20:11:39.870610184 +0000 UTC m=+2512.822642514"
Jul 28 20:11:50.845315 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:50.845281    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-e98043-7f4d859bc8-fz7lm"
Jul 28 20:11:50.845721 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:50.845355    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e98043-84fb6bcffb-7bwrm"
Jul 28 20:11:52.842181 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:52.841042    2570 patch_prober.go:28] interesting pod/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 28 20:11:52.842181 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:52.841112    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8" podUID="26b45581-edb6-43f0-9090-a409e545dce6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 28 20:11:52.899518 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:52.899485    2570 generic.go:356] "Generic (PLEG): container finished" podID="26b45581-edb6-43f0-9090-a409e545dce6" containerID="a0f2f9c2ef1c38eb24b466597d40f98db416c6ff1e966106e5cb4c15aa40aea4" exitCode=0
Jul 28 20:11:52.899677 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:52.899559    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8" event={"ID":"26b45581-edb6-43f0-9090-a409e545dce6","Type":"ContainerDied","Data":"a0f2f9c2ef1c38eb24b466597d40f98db416c6ff1e966106e5cb4c15aa40aea4"}
Jul 28 20:11:52.900006 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:52.899968    2570 scope.go:117] "RemoveContainer" containerID="a0f2f9c2ef1c38eb24b466597d40f98db416c6ff1e966106e5cb4c15aa40aea4"
Jul 28 20:11:52.901096 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:52.901065    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:11:52.901221 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:52.901163    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:11:52.901289 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:52.901218    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:11:53.920986 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:53.920941    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8" event={"ID":"26b45581-edb6-43f0-9090-a409e545dce6","Type":"ContainerStarted","Data":"cf6a1ce88eab63b48731ec96247629abab1f4b82fd1ed6fd3df179238fdad474"}
Jul 28 20:11:54.498857 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:54.498812    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:11:54.499147 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:54.499113    2570 patch_prober.go:28] interesting pod/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 28 20:11:54.499391 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:54.499362    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8" podUID="26b45581-edb6-43f0-9090-a409e545dce6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 28 20:11:55.498947 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:55.498906    2570 patch_prober.go:28] interesting pod/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 28 20:11:55.499485 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:55.499004    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8" podUID="26b45581-edb6-43f0-9090-a409e545dce6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 28 20:11:56.499476 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:56.499433    2570 patch_prober.go:28] interesting pod/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 28 20:11:56.500001 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:56.499518    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8" podUID="26b45581-edb6-43f0-9090-a409e545dce6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 28 20:11:57.499218 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:57.498739    2570 patch_prober.go:28] interesting pod/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 28 20:11:57.499218 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:57.498809    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8" podUID="26b45581-edb6-43f0-9090-a409e545dce6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 28 20:11:58.502194 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:58.502158    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:11:58.502582 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:58.502499    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:11:58.503190 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:11:58.503172    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:12:47.779066 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:12:47.779035    2570 scope.go:117] "RemoveContainer" containerID="96590766becfa1eea7424570cf322fb121bfd8a098b1cd5736d3a7d5c798e1d9"
Jul 28 20:13:44.352204 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:44.352171    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-68aa77-5c84f466b-hzmqm"]
Jul 28 20:13:44.352769 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:44.352387    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-68aa77-5c84f466b-hzmqm" podUID="204f145f-c7fe-43f4-8e21-e2bcc947bb2f" containerName="payload-processing" containerID="cri-o://54d21ca6754d2c1e32f530cd041e60d0c527b63d9a9f3e303cae6b0ff2f54ec4" gracePeriod=30
Jul 28 20:13:44.357918 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:44.357891    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-68aa77-5b6bfd66c6-cshbq"]
Jul 28 20:13:44.358279 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:44.358214    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-68aa77-5b6bfd66c6-cshbq" podUID="b7ec3b30-8d86-47ab-9c37-d3de4c1e7ddd" containerName="payload-pre-processing" containerID="cri-o://5b6132ed28d592c56383caf8a44f56ee81598d0bafba0e590fdf171e5e491c6a" gracePeriod=30
Jul 28 20:13:44.644850 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:44.644828    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-68aa77-5c84f466b-hzmqm"
Jul 28 20:13:44.648030 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:44.648008    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-68aa77-5b6bfd66c6-cshbq"
Jul 28 20:13:44.727715 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:44.727688    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7ec3b30-8d86-47ab-9c37-d3de4c1e7ddd-plugins-config-volume\") pod \"b7ec3b30-8d86-47ab-9c37-d3de4c1e7ddd\" (UID: \"b7ec3b30-8d86-47ab-9c37-d3de4c1e7ddd\") "
Jul 28 20:13:44.727889 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:44.727731    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/204f145f-c7fe-43f4-8e21-e2bcc947bb2f-plugins-config-volume\") pod \"204f145f-c7fe-43f4-8e21-e2bcc947bb2f\" (UID: \"204f145f-c7fe-43f4-8e21-e2bcc947bb2f\") "
Jul 28 20:13:44.727889 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:44.727760    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-st4c5\" (UniqueName: \"kubernetes.io/projected/204f145f-c7fe-43f4-8e21-e2bcc947bb2f-kube-api-access-st4c5\") pod \"204f145f-c7fe-43f4-8e21-e2bcc947bb2f\" (UID: \"204f145f-c7fe-43f4-8e21-e2bcc947bb2f\") "
Jul 28 20:13:44.727889 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:44.727788    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m26cm\" (UniqueName: \"kubernetes.io/projected/b7ec3b30-8d86-47ab-9c37-d3de4c1e7ddd-kube-api-access-m26cm\") pod \"b7ec3b30-8d86-47ab-9c37-d3de4c1e7ddd\" (UID: \"b7ec3b30-8d86-47ab-9c37-d3de4c1e7ddd\") "
Jul 28 20:13:44.728180 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:44.728154    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/204f145f-c7fe-43f4-8e21-e2bcc947bb2f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "204f145f-c7fe-43f4-8e21-e2bcc947bb2f" (UID: "204f145f-c7fe-43f4-8e21-e2bcc947bb2f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:13:44.728180 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:44.728165    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7ec3b30-8d86-47ab-9c37-d3de4c1e7ddd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b7ec3b30-8d86-47ab-9c37-d3de4c1e7ddd" (UID: "b7ec3b30-8d86-47ab-9c37-d3de4c1e7ddd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:13:44.729828 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:44.729800    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/204f145f-c7fe-43f4-8e21-e2bcc947bb2f-kube-api-access-st4c5" (OuterVolumeSpecName: "kube-api-access-st4c5") pod "204f145f-c7fe-43f4-8e21-e2bcc947bb2f" (UID: "204f145f-c7fe-43f4-8e21-e2bcc947bb2f"). InnerVolumeSpecName "kube-api-access-st4c5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:13:44.729828 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:44.729817    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7ec3b30-8d86-47ab-9c37-d3de4c1e7ddd-kube-api-access-m26cm" (OuterVolumeSpecName: "kube-api-access-m26cm") pod "b7ec3b30-8d86-47ab-9c37-d3de4c1e7ddd" (UID: "b7ec3b30-8d86-47ab-9c37-d3de4c1e7ddd"). InnerVolumeSpecName "kube-api-access-m26cm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:13:44.829121 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:44.829082    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7ec3b30-8d86-47ab-9c37-d3de4c1e7ddd-plugins-config-volume\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:13:44.829121 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:44.829113    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/204f145f-c7fe-43f4-8e21-e2bcc947bb2f-plugins-config-volume\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:13:44.829121 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:44.829122    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-st4c5\" (UniqueName: \"kubernetes.io/projected/204f145f-c7fe-43f4-8e21-e2bcc947bb2f-kube-api-access-st4c5\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:13:44.829121 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:44.829131    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m26cm\" (UniqueName: \"kubernetes.io/projected/b7ec3b30-8d86-47ab-9c37-d3de4c1e7ddd-kube-api-access-m26cm\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:13:45.442046 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:45.442011    2570 generic.go:356] "Generic (PLEG): container finished" podID="b7ec3b30-8d86-47ab-9c37-d3de4c1e7ddd" containerID="5b6132ed28d592c56383caf8a44f56ee81598d0bafba0e590fdf171e5e491c6a" exitCode=0
Jul 28 20:13:45.442515 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:45.442101    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-68aa77-5b6bfd66c6-cshbq"
Jul 28 20:13:45.442515 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:45.442127    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-68aa77-5b6bfd66c6-cshbq" event={"ID":"b7ec3b30-8d86-47ab-9c37-d3de4c1e7ddd","Type":"ContainerDied","Data":"5b6132ed28d592c56383caf8a44f56ee81598d0bafba0e590fdf171e5e491c6a"}
Jul 28 20:13:45.442515 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:45.442205    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-68aa77-5b6bfd66c6-cshbq" event={"ID":"b7ec3b30-8d86-47ab-9c37-d3de4c1e7ddd","Type":"ContainerDied","Data":"71e5c1642001ce5522039414fe21e52a17815ace989e7ab59b0192af6c287ea5"}
Jul 28 20:13:45.442515 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:45.442231    2570 scope.go:117] "RemoveContainer" containerID="5b6132ed28d592c56383caf8a44f56ee81598d0bafba0e590fdf171e5e491c6a"
Jul 28 20:13:45.443585 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:45.443561    2570 generic.go:356] "Generic (PLEG): container finished" podID="204f145f-c7fe-43f4-8e21-e2bcc947bb2f" containerID="54d21ca6754d2c1e32f530cd041e60d0c527b63d9a9f3e303cae6b0ff2f54ec4" exitCode=0
Jul 28 20:13:45.443671 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:45.443612    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-68aa77-5c84f466b-hzmqm"
Jul 28 20:13:45.443671 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:45.443626    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-68aa77-5c84f466b-hzmqm" event={"ID":"204f145f-c7fe-43f4-8e21-e2bcc947bb2f","Type":"ContainerDied","Data":"54d21ca6754d2c1e32f530cd041e60d0c527b63d9a9f3e303cae6b0ff2f54ec4"}
Jul 28 20:13:45.443671 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:45.443665    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-68aa77-5c84f466b-hzmqm" event={"ID":"204f145f-c7fe-43f4-8e21-e2bcc947bb2f","Type":"ContainerDied","Data":"dc6af9d65f7934c02c958a37cf06c9853d326e0977ee5868fdb1a0ad8968bedb"}
Jul 28 20:13:45.450615 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:45.450599    2570 scope.go:117] "RemoveContainer" containerID="5b6132ed28d592c56383caf8a44f56ee81598d0bafba0e590fdf171e5e491c6a"
Jul 28 20:13:45.450838 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:13:45.450818    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b6132ed28d592c56383caf8a44f56ee81598d0bafba0e590fdf171e5e491c6a\": container with ID starting with 5b6132ed28d592c56383caf8a44f56ee81598d0bafba0e590fdf171e5e491c6a not found: ID does not exist" containerID="5b6132ed28d592c56383caf8a44f56ee81598d0bafba0e590fdf171e5e491c6a"
Jul 28 20:13:45.450892 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:45.450846    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b6132ed28d592c56383caf8a44f56ee81598d0bafba0e590fdf171e5e491c6a"} err="failed to get container status \"5b6132ed28d592c56383caf8a44f56ee81598d0bafba0e590fdf171e5e491c6a\": rpc error: code = NotFound desc = could not find container \"5b6132ed28d592c56383caf8a44f56ee81598d0bafba0e590fdf171e5e491c6a\": container with ID starting with 5b6132ed28d592c56383caf8a44f56ee81598d0bafba0e590fdf171e5e491c6a not found: ID does not exist"
Jul 28 20:13:45.450892 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:45.450861    2570 scope.go:117] "RemoveContainer" containerID="54d21ca6754d2c1e32f530cd041e60d0c527b63d9a9f3e303cae6b0ff2f54ec4"
Jul 28 20:13:45.459447 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:45.459429    2570 scope.go:117] "RemoveContainer" containerID="54d21ca6754d2c1e32f530cd041e60d0c527b63d9a9f3e303cae6b0ff2f54ec4"
Jul 28 20:13:45.459705 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:13:45.459686    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54d21ca6754d2c1e32f530cd041e60d0c527b63d9a9f3e303cae6b0ff2f54ec4\": container with ID starting with 54d21ca6754d2c1e32f530cd041e60d0c527b63d9a9f3e303cae6b0ff2f54ec4 not found: ID does not exist" containerID="54d21ca6754d2c1e32f530cd041e60d0c527b63d9a9f3e303cae6b0ff2f54ec4"
Jul 28 20:13:45.459758 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:45.459715    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54d21ca6754d2c1e32f530cd041e60d0c527b63d9a9f3e303cae6b0ff2f54ec4"} err="failed to get container status \"54d21ca6754d2c1e32f530cd041e60d0c527b63d9a9f3e303cae6b0ff2f54ec4\": rpc error: code = NotFound desc = could not find container \"54d21ca6754d2c1e32f530cd041e60d0c527b63d9a9f3e303cae6b0ff2f54ec4\": container with ID starting with 54d21ca6754d2c1e32f530cd041e60d0c527b63d9a9f3e303cae6b0ff2f54ec4 not found: ID does not exist"
Jul 28 20:13:45.467718 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:45.467697    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-68aa77-5c84f466b-hzmqm"]
Jul 28 20:13:45.472597 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:45.472570    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-68aa77-5c84f466b-hzmqm"]
Jul 28 20:13:45.481077 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:45.481058    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-68aa77-5b6bfd66c6-cshbq"]
Jul 28 20:13:45.488143 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:45.488122    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-68aa77-5b6bfd66c6-cshbq"]
Jul 28 20:13:45.572498 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:45.572458    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="204f145f-c7fe-43f4-8e21-e2bcc947bb2f" path="/var/lib/kubelet/pods/204f145f-c7fe-43f4-8e21-e2bcc947bb2f/volumes"
Jul 28 20:13:45.572919 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:45.572898    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7ec3b30-8d86-47ab-9c37-d3de4c1e7ddd" path="/var/lib/kubelet/pods/b7ec3b30-8d86-47ab-9c37-d3de4c1e7ddd/volumes"
Jul 28 20:13:51.063881 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:51.063844    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"]
Jul 28 20:13:51.064390 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:51.064088    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs" podUID="746e9260-a76e-4f8d-991d-1977860c3790" containerName="istio-proxy" containerID="cri-o://b7afb7e9ccf5d2e319ef8666715bdcc6de81bf8b234d1786cfa9ff21c8d11349" gracePeriod=30
Jul 28 20:13:56.313635 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.313613    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:13:56.426248 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.426211    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/746e9260-a76e-4f8d-991d-1977860c3790-workload-certs\") pod \"746e9260-a76e-4f8d-991d-1977860c3790\" (UID: \"746e9260-a76e-4f8d-991d-1977860c3790\") "
Jul 28 20:13:56.426439 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.426262    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htj7q\" (UniqueName: \"kubernetes.io/projected/746e9260-a76e-4f8d-991d-1977860c3790-kube-api-access-htj7q\") pod \"746e9260-a76e-4f8d-991d-1977860c3790\" (UID: \"746e9260-a76e-4f8d-991d-1977860c3790\") "
Jul 28 20:13:56.426439 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.426305    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/746e9260-a76e-4f8d-991d-1977860c3790-istiod-ca-cert\") pod \"746e9260-a76e-4f8d-991d-1977860c3790\" (UID: \"746e9260-a76e-4f8d-991d-1977860c3790\") "
Jul 28 20:13:56.426439 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.426378    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/746e9260-a76e-4f8d-991d-1977860c3790-istio-envoy\") pod \"746e9260-a76e-4f8d-991d-1977860c3790\" (UID: \"746e9260-a76e-4f8d-991d-1977860c3790\") "
Jul 28 20:13:56.426611 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.426534    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/746e9260-a76e-4f8d-991d-1977860c3790-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "746e9260-a76e-4f8d-991d-1977860c3790" (UID: "746e9260-a76e-4f8d-991d-1977860c3790"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:13:56.426611 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.426566    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/746e9260-a76e-4f8d-991d-1977860c3790-istio-data\") pod \"746e9260-a76e-4f8d-991d-1977860c3790\" (UID: \"746e9260-a76e-4f8d-991d-1977860c3790\") "
Jul 28 20:13:56.426611 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.426597    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/746e9260-a76e-4f8d-991d-1977860c3790-credential-socket\") pod \"746e9260-a76e-4f8d-991d-1977860c3790\" (UID: \"746e9260-a76e-4f8d-991d-1977860c3790\") "
Jul 28 20:13:56.426774 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.426625    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/746e9260-a76e-4f8d-991d-1977860c3790-workload-socket\") pod \"746e9260-a76e-4f8d-991d-1977860c3790\" (UID: \"746e9260-a76e-4f8d-991d-1977860c3790\") "
Jul 28 20:13:56.426774 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.426649    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/746e9260-a76e-4f8d-991d-1977860c3790-istio-token\") pod \"746e9260-a76e-4f8d-991d-1977860c3790\" (UID: \"746e9260-a76e-4f8d-991d-1977860c3790\") "
Jul 28 20:13:56.426774 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.426686    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/746e9260-a76e-4f8d-991d-1977860c3790-istio-podinfo\") pod \"746e9260-a76e-4f8d-991d-1977860c3790\" (UID: \"746e9260-a76e-4f8d-991d-1977860c3790\") "
Jul 28 20:13:56.426931 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.426819    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/746e9260-a76e-4f8d-991d-1977860c3790-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "746e9260-a76e-4f8d-991d-1977860c3790" (UID: "746e9260-a76e-4f8d-991d-1977860c3790"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:13:56.426931 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.426859    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/746e9260-a76e-4f8d-991d-1977860c3790-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "746e9260-a76e-4f8d-991d-1977860c3790" (UID: "746e9260-a76e-4f8d-991d-1977860c3790"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:13:56.426931 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.426885    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/746e9260-a76e-4f8d-991d-1977860c3790-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "746e9260-a76e-4f8d-991d-1977860c3790" (UID: "746e9260-a76e-4f8d-991d-1977860c3790"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:13:56.427111 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.427056    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/746e9260-a76e-4f8d-991d-1977860c3790-credential-socket\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:13:56.427111 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.427076    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/746e9260-a76e-4f8d-991d-1977860c3790-workload-socket\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:13:56.427111 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.427092    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/746e9260-a76e-4f8d-991d-1977860c3790-workload-certs\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:13:56.427111 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.427105    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/746e9260-a76e-4f8d-991d-1977860c3790-istiod-ca-cert\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:13:56.427625 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.427594    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/746e9260-a76e-4f8d-991d-1977860c3790-istio-data" (OuterVolumeSpecName: "istio-data") pod "746e9260-a76e-4f8d-991d-1977860c3790" (UID: "746e9260-a76e-4f8d-991d-1977860c3790"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:13:56.428698 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.428668    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/746e9260-a76e-4f8d-991d-1977860c3790-kube-api-access-htj7q" (OuterVolumeSpecName: "kube-api-access-htj7q") pod "746e9260-a76e-4f8d-991d-1977860c3790" (UID: "746e9260-a76e-4f8d-991d-1977860c3790"). InnerVolumeSpecName "kube-api-access-htj7q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:13:56.428942 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.428918    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/746e9260-a76e-4f8d-991d-1977860c3790-istio-token" (OuterVolumeSpecName: "istio-token") pod "746e9260-a76e-4f8d-991d-1977860c3790" (UID: "746e9260-a76e-4f8d-991d-1977860c3790"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:13:56.428942 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.428929    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/746e9260-a76e-4f8d-991d-1977860c3790-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "746e9260-a76e-4f8d-991d-1977860c3790" (UID: "746e9260-a76e-4f8d-991d-1977860c3790"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:13:56.429084 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.428953    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/746e9260-a76e-4f8d-991d-1977860c3790-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "746e9260-a76e-4f8d-991d-1977860c3790" (UID: "746e9260-a76e-4f8d-991d-1977860c3790"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:13:56.498261 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.498223    2570 generic.go:356] "Generic (PLEG): container finished" podID="746e9260-a76e-4f8d-991d-1977860c3790" containerID="b7afb7e9ccf5d2e319ef8666715bdcc6de81bf8b234d1786cfa9ff21c8d11349" exitCode=0
Jul 28 20:13:56.498460 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.498292    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"
Jul 28 20:13:56.498460 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.498308    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs" event={"ID":"746e9260-a76e-4f8d-991d-1977860c3790","Type":"ContainerDied","Data":"b7afb7e9ccf5d2e319ef8666715bdcc6de81bf8b234d1786cfa9ff21c8d11349"}
Jul 28 20:13:56.498460 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.498391    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs" event={"ID":"746e9260-a76e-4f8d-991d-1977860c3790","Type":"ContainerDied","Data":"98aa4c2963714647a722ad75638126f66de3aa26e242afe69bc3ff8b719ac3b0"}
Jul 28 20:13:56.498460 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.498414    2570 scope.go:117] "RemoveContainer" containerID="b7afb7e9ccf5d2e319ef8666715bdcc6de81bf8b234d1786cfa9ff21c8d11349"
Jul 28 20:13:56.507873 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.507854    2570 scope.go:117] "RemoveContainer" containerID="0c18adbd7d82425d86a9367d2b832473f5380ac546e993be0c473c783c7f5d01"
Jul 28 20:13:56.515839 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.515821    2570 scope.go:117] "RemoveContainer" containerID="b7afb7e9ccf5d2e319ef8666715bdcc6de81bf8b234d1786cfa9ff21c8d11349"
Jul 28 20:13:56.516097 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:13:56.516077    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7afb7e9ccf5d2e319ef8666715bdcc6de81bf8b234d1786cfa9ff21c8d11349\": container with ID starting with b7afb7e9ccf5d2e319ef8666715bdcc6de81bf8b234d1786cfa9ff21c8d11349 not found: ID does not exist" containerID="b7afb7e9ccf5d2e319ef8666715bdcc6de81bf8b234d1786cfa9ff21c8d11349"
Jul 28 20:13:56.516173 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.516137    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7afb7e9ccf5d2e319ef8666715bdcc6de81bf8b234d1786cfa9ff21c8d11349"} err="failed to get container status \"b7afb7e9ccf5d2e319ef8666715bdcc6de81bf8b234d1786cfa9ff21c8d11349\": rpc error: code = NotFound desc = could not find container \"b7afb7e9ccf5d2e319ef8666715bdcc6de81bf8b234d1786cfa9ff21c8d11349\": container with ID starting with b7afb7e9ccf5d2e319ef8666715bdcc6de81bf8b234d1786cfa9ff21c8d11349 not found: ID does not exist"
Jul 28 20:13:56.516173 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.516162    2570 scope.go:117] "RemoveContainer" containerID="0c18adbd7d82425d86a9367d2b832473f5380ac546e993be0c473c783c7f5d01"
Jul 28 20:13:56.516422 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:13:56.516404    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c18adbd7d82425d86a9367d2b832473f5380ac546e993be0c473c783c7f5d01\": container with ID starting with 0c18adbd7d82425d86a9367d2b832473f5380ac546e993be0c473c783c7f5d01 not found: ID does not exist" containerID="0c18adbd7d82425d86a9367d2b832473f5380ac546e993be0c473c783c7f5d01"
Jul 28 20:13:56.516465 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.516429    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c18adbd7d82425d86a9367d2b832473f5380ac546e993be0c473c783c7f5d01"} err="failed to get container status \"0c18adbd7d82425d86a9367d2b832473f5380ac546e993be0c473c783c7f5d01\": rpc error: code = NotFound desc = could not find container \"0c18adbd7d82425d86a9367d2b832473f5380ac546e993be0c473c783c7f5d01\": container with ID starting with 0c18adbd7d82425d86a9367d2b832473f5380ac546e993be0c473c783c7f5d01 not found: ID does not exist"
Jul 28 20:13:56.520346 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.520323    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"]
Jul 28 20:13:56.525724 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.525703    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-68aa77-openshift-default-6df69976b6-q94hs"]
Jul 28 20:13:56.528224 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.528207    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/746e9260-a76e-4f8d-991d-1977860c3790-istio-podinfo\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:13:56.528276 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.528228    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htj7q\" (UniqueName: \"kubernetes.io/projected/746e9260-a76e-4f8d-991d-1977860c3790-kube-api-access-htj7q\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:13:56.528276 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.528240    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/746e9260-a76e-4f8d-991d-1977860c3790-istio-envoy\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:13:56.528276 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.528249    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/746e9260-a76e-4f8d-991d-1977860c3790-istio-data\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:13:56.528276 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:56.528257    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/746e9260-a76e-4f8d-991d-1977860c3790-istio-token\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:13:57.572608 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:13:57.572578    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="746e9260-a76e-4f8d-991d-1977860c3790" path="/var/lib/kubelet/pods/746e9260-a76e-4f8d-991d-1977860c3790/volumes"
Jul 28 20:14:01.883118 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:01.883084    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-e98043-7f4d859bc8-fz7lm"]
Jul 28 20:14:01.883542 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:01.883292    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-e98043-7f4d859bc8-fz7lm" podUID="9163fed7-4384-446e-afc7-9dd141375611" containerName="payload-processing" containerID="cri-o://7357f14a79ddedbd50e02bf91fe8da13a58f3be8ba902631cbc5155fecd3f672" gracePeriod=30
Jul 28 20:14:01.890744 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:01.890716    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-e98043-84fb6bcffb-7bwrm"]
Jul 28 20:14:01.891028 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:01.890956    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e98043-84fb6bcffb-7bwrm" podUID="3e8bcdd7-1771-4503-a172-f53dc33857f5" containerName="payload-pre-processing" containerID="cri-o://654283ab33a02e8cdb2a68df2fcfabb40b057f623243fb3a8c0783b4449d694c" gracePeriod=30
Jul 28 20:14:02.167724 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:02.167700    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-e98043-7f4d859bc8-fz7lm"
Jul 28 20:14:02.170906 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:02.170880    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e98043-84fb6bcffb-7bwrm"
Jul 28 20:14:02.279618 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:02.279585    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pbt8\" (UniqueName: \"kubernetes.io/projected/9163fed7-4384-446e-afc7-9dd141375611-kube-api-access-5pbt8\") pod \"9163fed7-4384-446e-afc7-9dd141375611\" (UID: \"9163fed7-4384-446e-afc7-9dd141375611\") "
Jul 28 20:14:02.279801 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:02.279629    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9163fed7-4384-446e-afc7-9dd141375611-plugins-config-volume\") pod \"9163fed7-4384-446e-afc7-9dd141375611\" (UID: \"9163fed7-4384-446e-afc7-9dd141375611\") "
Jul 28 20:14:02.279801 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:02.279721    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e8bcdd7-1771-4503-a172-f53dc33857f5-plugins-config-volume\") pod \"3e8bcdd7-1771-4503-a172-f53dc33857f5\" (UID: \"3e8bcdd7-1771-4503-a172-f53dc33857f5\") "
Jul 28 20:14:02.279801 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:02.279748    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxnqd\" (UniqueName: \"kubernetes.io/projected/3e8bcdd7-1771-4503-a172-f53dc33857f5-kube-api-access-hxnqd\") pod \"3e8bcdd7-1771-4503-a172-f53dc33857f5\" (UID: \"3e8bcdd7-1771-4503-a172-f53dc33857f5\") "
Jul 28 20:14:02.280103 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:02.280075    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9163fed7-4384-446e-afc7-9dd141375611-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9163fed7-4384-446e-afc7-9dd141375611" (UID: "9163fed7-4384-446e-afc7-9dd141375611"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:14:02.280173 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:02.280122    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e8bcdd7-1771-4503-a172-f53dc33857f5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3e8bcdd7-1771-4503-a172-f53dc33857f5" (UID: "3e8bcdd7-1771-4503-a172-f53dc33857f5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:14:02.281786 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:02.281764    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e8bcdd7-1771-4503-a172-f53dc33857f5-kube-api-access-hxnqd" (OuterVolumeSpecName: "kube-api-access-hxnqd") pod "3e8bcdd7-1771-4503-a172-f53dc33857f5" (UID: "3e8bcdd7-1771-4503-a172-f53dc33857f5"). InnerVolumeSpecName "kube-api-access-hxnqd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:14:02.281857 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:02.281788    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9163fed7-4384-446e-afc7-9dd141375611-kube-api-access-5pbt8" (OuterVolumeSpecName: "kube-api-access-5pbt8") pod "9163fed7-4384-446e-afc7-9dd141375611" (UID: "9163fed7-4384-446e-afc7-9dd141375611"). InnerVolumeSpecName "kube-api-access-5pbt8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:14:02.381378 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:02.381335    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pbt8\" (UniqueName: \"kubernetes.io/projected/9163fed7-4384-446e-afc7-9dd141375611-kube-api-access-5pbt8\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:14:02.381378 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:02.381364    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9163fed7-4384-446e-afc7-9dd141375611-plugins-config-volume\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:14:02.381378 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:02.381373    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e8bcdd7-1771-4503-a172-f53dc33857f5-plugins-config-volume\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:14:02.381378 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:02.381384    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxnqd\" (UniqueName: \"kubernetes.io/projected/3e8bcdd7-1771-4503-a172-f53dc33857f5-kube-api-access-hxnqd\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:14:02.527252 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:02.527211    2570 generic.go:356] "Generic (PLEG): container finished" podID="9163fed7-4384-446e-afc7-9dd141375611" containerID="7357f14a79ddedbd50e02bf91fe8da13a58f3be8ba902631cbc5155fecd3f672" exitCode=0
Jul 28 20:14:02.527252 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:02.527250    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-e98043-7f4d859bc8-fz7lm"
Jul 28 20:14:02.527525 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:02.527246    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-e98043-7f4d859bc8-fz7lm" event={"ID":"9163fed7-4384-446e-afc7-9dd141375611","Type":"ContainerDied","Data":"7357f14a79ddedbd50e02bf91fe8da13a58f3be8ba902631cbc5155fecd3f672"}
Jul 28 20:14:02.527525 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:02.527367    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-e98043-7f4d859bc8-fz7lm" event={"ID":"9163fed7-4384-446e-afc7-9dd141375611","Type":"ContainerDied","Data":"373afa3aa422a850341665ad3f96f710f1edca241b18381dc6d7fa616c7946a0"}
Jul 28 20:14:02.527525 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:02.527397    2570 scope.go:117] "RemoveContainer" containerID="7357f14a79ddedbd50e02bf91fe8da13a58f3be8ba902631cbc5155fecd3f672"
Jul 28 20:14:02.528585 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:02.528564    2570 generic.go:356] "Generic (PLEG): container finished" podID="3e8bcdd7-1771-4503-a172-f53dc33857f5" containerID="654283ab33a02e8cdb2a68df2fcfabb40b057f623243fb3a8c0783b4449d694c" exitCode=0
Jul 28 20:14:02.528684 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:02.528592    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e98043-84fb6bcffb-7bwrm" event={"ID":"3e8bcdd7-1771-4503-a172-f53dc33857f5","Type":"ContainerDied","Data":"654283ab33a02e8cdb2a68df2fcfabb40b057f623243fb3a8c0783b4449d694c"}
Jul 28 20:14:02.528684 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:02.528641    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e98043-84fb6bcffb-7bwrm" event={"ID":"3e8bcdd7-1771-4503-a172-f53dc33857f5","Type":"ContainerDied","Data":"272c7b8fc37aa91665bacfa4eb4e934b767d37af623050965989fcfad6d14d4c"}
Jul 28 20:14:02.528684 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:02.528597    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e98043-84fb6bcffb-7bwrm"
Jul 28 20:14:02.539496 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:02.537458    2570 scope.go:117] "RemoveContainer" containerID="7357f14a79ddedbd50e02bf91fe8da13a58f3be8ba902631cbc5155fecd3f672"
Jul 28 20:14:02.539496 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:14:02.538171    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7357f14a79ddedbd50e02bf91fe8da13a58f3be8ba902631cbc5155fecd3f672\": container with ID starting with 7357f14a79ddedbd50e02bf91fe8da13a58f3be8ba902631cbc5155fecd3f672 not found: ID does not exist" containerID="7357f14a79ddedbd50e02bf91fe8da13a58f3be8ba902631cbc5155fecd3f672"
Jul 28 20:14:02.539496 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:02.538201    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7357f14a79ddedbd50e02bf91fe8da13a58f3be8ba902631cbc5155fecd3f672"} err="failed to get container status \"7357f14a79ddedbd50e02bf91fe8da13a58f3be8ba902631cbc5155fecd3f672\": rpc error: code = NotFound desc = could not find container \"7357f14a79ddedbd50e02bf91fe8da13a58f3be8ba902631cbc5155fecd3f672\": container with ID starting with 7357f14a79ddedbd50e02bf91fe8da13a58f3be8ba902631cbc5155fecd3f672 not found: ID does not exist"
Jul 28 20:14:02.539496 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:02.538221    2570 scope.go:117] "RemoveContainer" containerID="654283ab33a02e8cdb2a68df2fcfabb40b057f623243fb3a8c0783b4449d694c"
Jul 28 20:14:02.547468 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:02.547449    2570 scope.go:117] "RemoveContainer" containerID="654283ab33a02e8cdb2a68df2fcfabb40b057f623243fb3a8c0783b4449d694c"
Jul 28 20:14:02.547737 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:14:02.547717    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"654283ab33a02e8cdb2a68df2fcfabb40b057f623243fb3a8c0783b4449d694c\": container with ID starting with 654283ab33a02e8cdb2a68df2fcfabb40b057f623243fb3a8c0783b4449d694c not found: ID does not exist" containerID="654283ab33a02e8cdb2a68df2fcfabb40b057f623243fb3a8c0783b4449d694c"
Jul 28 20:14:02.547803 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:02.547748    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"654283ab33a02e8cdb2a68df2fcfabb40b057f623243fb3a8c0783b4449d694c"} err="failed to get container status \"654283ab33a02e8cdb2a68df2fcfabb40b057f623243fb3a8c0783b4449d694c\": rpc error: code = NotFound desc = could not find container \"654283ab33a02e8cdb2a68df2fcfabb40b057f623243fb3a8c0783b4449d694c\": container with ID starting with 654283ab33a02e8cdb2a68df2fcfabb40b057f623243fb3a8c0783b4449d694c not found: ID does not exist"
Jul 28 20:14:02.554110 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:02.554088    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-e98043-84fb6bcffb-7bwrm"]
Jul 28 20:14:02.557614 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:02.557589    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-e98043-84fb6bcffb-7bwrm"]
Jul 28 20:14:02.568576 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:02.568550    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-e98043-7f4d859bc8-fz7lm"]
Jul 28 20:14:02.572523 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:02.572500    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-e98043-7f4d859bc8-fz7lm"]
Jul 28 20:14:03.573023 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:03.572987    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e8bcdd7-1771-4503-a172-f53dc33857f5" path="/var/lib/kubelet/pods/3e8bcdd7-1771-4503-a172-f53dc33857f5/volumes"
Jul 28 20:14:03.573400 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:03.573348    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9163fed7-4384-446e-afc7-9dd141375611" path="/var/lib/kubelet/pods/9163fed7-4384-446e-afc7-9dd141375611/volumes"
Jul 28 20:14:08.573203 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:08.573075    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"]
Jul 28 20:14:08.573697 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:08.573296    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8" podUID="26b45581-edb6-43f0-9090-a409e545dce6" containerName="istio-proxy" containerID="cri-o://cf6a1ce88eab63b48731ec96247629abab1f4b82fd1ed6fd3df179238fdad474" gracePeriod=30
Jul 28 20:14:09.440180 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.440111    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"]
Jul 28 20:14:09.440680 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.440642    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7ec3b30-8d86-47ab-9c37-d3de4c1e7ddd" containerName="payload-pre-processing"
Jul 28 20:14:09.440680 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.440662    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7ec3b30-8d86-47ab-9c37-d3de4c1e7ddd" containerName="payload-pre-processing"
Jul 28 20:14:09.440680 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.440676    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="746e9260-a76e-4f8d-991d-1977860c3790" containerName="istio-proxy"
Jul 28 20:14:09.440830 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.440687    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="746e9260-a76e-4f8d-991d-1977860c3790" containerName="istio-proxy"
Jul 28 20:14:09.440830 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.440699    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="204f145f-c7fe-43f4-8e21-e2bcc947bb2f" containerName="payload-processing"
Jul 28 20:14:09.440830 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.440709    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="204f145f-c7fe-43f4-8e21-e2bcc947bb2f" containerName="payload-processing"
Jul 28 20:14:09.440830 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.440719    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e8bcdd7-1771-4503-a172-f53dc33857f5" containerName="payload-pre-processing"
Jul 28 20:14:09.440830 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.440727    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e8bcdd7-1771-4503-a172-f53dc33857f5" containerName="payload-pre-processing"
Jul 28 20:14:09.440830 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.440747    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="746e9260-a76e-4f8d-991d-1977860c3790" containerName="istio-proxy"
Jul 28 20:14:09.440830 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.440755    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="746e9260-a76e-4f8d-991d-1977860c3790" containerName="istio-proxy"
Jul 28 20:14:09.440830 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.440778    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9163fed7-4384-446e-afc7-9dd141375611" containerName="payload-processing"
Jul 28 20:14:09.440830 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.440786    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9163fed7-4384-446e-afc7-9dd141375611" containerName="payload-processing"
Jul 28 20:14:09.441243 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.440883    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="746e9260-a76e-4f8d-991d-1977860c3790" containerName="istio-proxy"
Jul 28 20:14:09.441243 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.440895    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="204f145f-c7fe-43f4-8e21-e2bcc947bb2f" containerName="payload-processing"
Jul 28 20:14:09.441243 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.440908    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9163fed7-4384-446e-afc7-9dd141375611" containerName="payload-processing"
Jul 28 20:14:09.441243 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.440918    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7ec3b30-8d86-47ab-9c37-d3de4c1e7ddd" containerName="payload-pre-processing"
Jul 28 20:14:09.441243 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.440928    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e8bcdd7-1771-4503-a172-f53dc33857f5" containerName="payload-pre-processing"
Jul 28 20:14:09.444232 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.444214    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:14:09.446637 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.446615    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-0180d1-openshift-default-dockercfg-9xfjt\""
Jul 28 20:14:09.454782 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.454762    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"]
Jul 28 20:14:09.541154 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.541121    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d25cb68-3cd5-47c3-9105-577fcb76881b-istio-token\") pod \"e2e-api-a-0180d1-openshift-default-99df4544d-sfplq\" (UID: \"7d25cb68-3cd5-47c3-9105-577fcb76881b\") " pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:14:09.541299 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.541167    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d25cb68-3cd5-47c3-9105-577fcb76881b-workload-certs\") pod \"e2e-api-a-0180d1-openshift-default-99df4544d-sfplq\" (UID: \"7d25cb68-3cd5-47c3-9105-577fcb76881b\") " pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:14:09.541299 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.541262    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d25cb68-3cd5-47c3-9105-577fcb76881b-istio-podinfo\") pod \"e2e-api-a-0180d1-openshift-default-99df4544d-sfplq\" (UID: \"7d25cb68-3cd5-47c3-9105-577fcb76881b\") " pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:14:09.541299 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.541290    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d25cb68-3cd5-47c3-9105-577fcb76881b-istiod-ca-cert\") pod \"e2e-api-a-0180d1-openshift-default-99df4544d-sfplq\" (UID: \"7d25cb68-3cd5-47c3-9105-577fcb76881b\") " pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:14:09.541418 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.541328    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d25cb68-3cd5-47c3-9105-577fcb76881b-credential-socket\") pod \"e2e-api-a-0180d1-openshift-default-99df4544d-sfplq\" (UID: \"7d25cb68-3cd5-47c3-9105-577fcb76881b\") " pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:14:09.541418 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.541348    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d25cb68-3cd5-47c3-9105-577fcb76881b-workload-socket\") pod \"e2e-api-a-0180d1-openshift-default-99df4544d-sfplq\" (UID: \"7d25cb68-3cd5-47c3-9105-577fcb76881b\") " pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:14:09.541418 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.541387    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzjlx\" (UniqueName: \"kubernetes.io/projected/7d25cb68-3cd5-47c3-9105-577fcb76881b-kube-api-access-jzjlx\") pod \"e2e-api-a-0180d1-openshift-default-99df4544d-sfplq\" (UID: \"7d25cb68-3cd5-47c3-9105-577fcb76881b\") " pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:14:09.541511 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.541441    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d25cb68-3cd5-47c3-9105-577fcb76881b-istio-envoy\") pod \"e2e-api-a-0180d1-openshift-default-99df4544d-sfplq\" (UID: \"7d25cb68-3cd5-47c3-9105-577fcb76881b\") " pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:14:09.541511 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.541467    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d25cb68-3cd5-47c3-9105-577fcb76881b-istio-data\") pod \"e2e-api-a-0180d1-openshift-default-99df4544d-sfplq\" (UID: \"7d25cb68-3cd5-47c3-9105-577fcb76881b\") " pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:14:09.642618 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.642578    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d25cb68-3cd5-47c3-9105-577fcb76881b-credential-socket\") pod \"e2e-api-a-0180d1-openshift-default-99df4544d-sfplq\" (UID: \"7d25cb68-3cd5-47c3-9105-577fcb76881b\") " pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:14:09.642618 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.642620    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d25cb68-3cd5-47c3-9105-577fcb76881b-workload-socket\") pod \"e2e-api-a-0180d1-openshift-default-99df4544d-sfplq\" (UID: \"7d25cb68-3cd5-47c3-9105-577fcb76881b\") " pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:14:09.643235 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.642642    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzjlx\" (UniqueName: \"kubernetes.io/projected/7d25cb68-3cd5-47c3-9105-577fcb76881b-kube-api-access-jzjlx\") pod \"e2e-api-a-0180d1-openshift-default-99df4544d-sfplq\" (UID: \"7d25cb68-3cd5-47c3-9105-577fcb76881b\") " pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:14:09.643235 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.642672    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d25cb68-3cd5-47c3-9105-577fcb76881b-istio-envoy\") pod \"e2e-api-a-0180d1-openshift-default-99df4544d-sfplq\" (UID: \"7d25cb68-3cd5-47c3-9105-577fcb76881b\") " pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:14:09.643235 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.642707    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d25cb68-3cd5-47c3-9105-577fcb76881b-istio-data\") pod \"e2e-api-a-0180d1-openshift-default-99df4544d-sfplq\" (UID: \"7d25cb68-3cd5-47c3-9105-577fcb76881b\") " pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:14:09.643235 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.642735    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d25cb68-3cd5-47c3-9105-577fcb76881b-istio-token\") pod \"e2e-api-a-0180d1-openshift-default-99df4544d-sfplq\" (UID: \"7d25cb68-3cd5-47c3-9105-577fcb76881b\") " pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:14:09.643235 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.642766    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d25cb68-3cd5-47c3-9105-577fcb76881b-workload-certs\") pod \"e2e-api-a-0180d1-openshift-default-99df4544d-sfplq\" (UID: \"7d25cb68-3cd5-47c3-9105-577fcb76881b\") " pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:14:09.643235 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.642811    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d25cb68-3cd5-47c3-9105-577fcb76881b-istio-podinfo\") pod \"e2e-api-a-0180d1-openshift-default-99df4544d-sfplq\" (UID: \"7d25cb68-3cd5-47c3-9105-577fcb76881b\") " pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:14:09.643235 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.642838    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d25cb68-3cd5-47c3-9105-577fcb76881b-istiod-ca-cert\") pod \"e2e-api-a-0180d1-openshift-default-99df4544d-sfplq\" (UID: \"7d25cb68-3cd5-47c3-9105-577fcb76881b\") " pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:14:09.643235 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.643094    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d25cb68-3cd5-47c3-9105-577fcb76881b-workload-socket\") pod \"e2e-api-a-0180d1-openshift-default-99df4544d-sfplq\" (UID: \"7d25cb68-3cd5-47c3-9105-577fcb76881b\") " pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:14:09.643235 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.643159    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d25cb68-3cd5-47c3-9105-577fcb76881b-credential-socket\") pod \"e2e-api-a-0180d1-openshift-default-99df4544d-sfplq\" (UID: \"7d25cb68-3cd5-47c3-9105-577fcb76881b\") " pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:14:09.643235 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.643181    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d25cb68-3cd5-47c3-9105-577fcb76881b-istio-data\") pod \"e2e-api-a-0180d1-openshift-default-99df4544d-sfplq\" (UID: \"7d25cb68-3cd5-47c3-9105-577fcb76881b\") " pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:14:09.643604 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.643254    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d25cb68-3cd5-47c3-9105-577fcb76881b-workload-certs\") pod \"e2e-api-a-0180d1-openshift-default-99df4544d-sfplq\" (UID: \"7d25cb68-3cd5-47c3-9105-577fcb76881b\") " pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:14:09.643792 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.643774    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d25cb68-3cd5-47c3-9105-577fcb76881b-istiod-ca-cert\") pod \"e2e-api-a-0180d1-openshift-default-99df4544d-sfplq\" (UID: \"7d25cb68-3cd5-47c3-9105-577fcb76881b\") " pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:14:09.645152 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.645127    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d25cb68-3cd5-47c3-9105-577fcb76881b-istio-envoy\") pod \"e2e-api-a-0180d1-openshift-default-99df4544d-sfplq\" (UID: \"7d25cb68-3cd5-47c3-9105-577fcb76881b\") " pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:14:09.645361 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.645343    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d25cb68-3cd5-47c3-9105-577fcb76881b-istio-podinfo\") pod \"e2e-api-a-0180d1-openshift-default-99df4544d-sfplq\" (UID: \"7d25cb68-3cd5-47c3-9105-577fcb76881b\") " pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:14:09.650829 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.650803    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d25cb68-3cd5-47c3-9105-577fcb76881b-istio-token\") pod \"e2e-api-a-0180d1-openshift-default-99df4544d-sfplq\" (UID: \"7d25cb68-3cd5-47c3-9105-577fcb76881b\") " pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:14:09.651068 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.651047    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzjlx\" (UniqueName: \"kubernetes.io/projected/7d25cb68-3cd5-47c3-9105-577fcb76881b-kube-api-access-jzjlx\") pod \"e2e-api-a-0180d1-openshift-default-99df4544d-sfplq\" (UID: \"7d25cb68-3cd5-47c3-9105-577fcb76881b\") " pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:14:09.755594 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.755503    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:14:09.896110 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.896085    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"]
Jul 28 20:14:09.898306 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:14:09.898278    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d25cb68_3cd5_47c3_9105_577fcb76881b.slice/crio-6ac423c94628362a02361552e979ea265c6aed264543d697ae440f8403f4199a WatchSource:0}: Error finding container 6ac423c94628362a02361552e979ea265c6aed264543d697ae440f8403f4199a: Status 404 returned error can't find the container with id 6ac423c94628362a02361552e979ea265c6aed264543d697ae440f8403f4199a
Jul 28 20:14:09.900581 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.900550    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:14:09.900688 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.900627    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:14:09.900688 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:09.900667    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:14:10.569518 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:10.569486    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq" event={"ID":"7d25cb68-3cd5-47c3-9105-577fcb76881b","Type":"ContainerStarted","Data":"07980d693ea104b54fbebffb67e01001ab3113f8f0167d54e94d74a16f64532b"}
Jul 28 20:14:10.569698 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:10.569535    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq" event={"ID":"7d25cb68-3cd5-47c3-9105-577fcb76881b","Type":"ContainerStarted","Data":"6ac423c94628362a02361552e979ea265c6aed264543d697ae440f8403f4199a"}
Jul 28 20:14:10.591832 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:10.591777    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq" podStartSLOduration=1.591760428 podStartE2EDuration="1.591760428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:14:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:14:10.590311961 +0000 UTC m=+2663.542344317" watchObservedRunningTime="2026-07-28 20:14:10.591760428 +0000 UTC m=+2663.543792758"
Jul 28 20:14:10.756519 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:10.756480    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:14:10.761632 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:10.761607    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:14:11.573330 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:11.573300    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:14:11.574327 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:11.574307    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:14:13.381547 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.381501    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-0180d1-78c66f9c9b-6fqbc"]
Jul 28 20:14:13.382059 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.381896    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="746e9260-a76e-4f8d-991d-1977860c3790" containerName="istio-proxy"
Jul 28 20:14:13.383906 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.383886    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0180d1-78c66f9c9b-6fqbc"
Jul 28 20:14:13.386327 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.386306    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-0180d1\""
Jul 28 20:14:13.386417 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.386312    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-0180d1-dockercfg-zngm5\""
Jul 28 20:14:13.394910 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.394889    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-0180d1-78c66f9c9b-6fqbc"]
Jul 28 20:14:13.420896 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.420863    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0180d1-798b67bd76-btdlv"]
Jul 28 20:14:13.423410 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.423387    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-0180d1-798b67bd76-btdlv"
Jul 28 20:14:13.435078 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.435045    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0180d1-798b67bd76-btdlv"]
Jul 28 20:14:13.482476 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.482432    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxsc5\" (UniqueName: \"kubernetes.io/projected/15ee5317-804b-4c24-881b-4cca0d61c599-kube-api-access-rxsc5\") pod \"payload-pre-processing-e2e-api-a-0180d1-78c66f9c9b-6fqbc\" (UID: \"15ee5317-804b-4c24-881b-4cca0d61c599\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-0180d1-78c66f9c9b-6fqbc"
Jul 28 20:14:13.482476 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.482475    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61a599ea-33a9-40bc-a15f-935adefb6806-plugins-config-volume\") pod \"payload-processing-e2e-api-a-0180d1-798b67bd76-btdlv\" (UID: \"61a599ea-33a9-40bc-a15f-935adefb6806\") " pod="openshift-ingress/payload-processing-e2e-api-a-0180d1-798b67bd76-btdlv"
Jul 28 20:14:13.482719 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.482510    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wztt\" (UniqueName: \"kubernetes.io/projected/61a599ea-33a9-40bc-a15f-935adefb6806-kube-api-access-5wztt\") pod \"payload-processing-e2e-api-a-0180d1-798b67bd76-btdlv\" (UID: \"61a599ea-33a9-40bc-a15f-935adefb6806\") " pod="openshift-ingress/payload-processing-e2e-api-a-0180d1-798b67bd76-btdlv"
Jul 28 20:14:13.482719 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.482565    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15ee5317-804b-4c24-881b-4cca0d61c599-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-0180d1-78c66f9c9b-6fqbc\" (UID: \"15ee5317-804b-4c24-881b-4cca0d61c599\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-0180d1-78c66f9c9b-6fqbc"
Jul 28 20:14:13.505507 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.505461    2570 patch_prober.go:28] interesting pod/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 20:14:13.505778 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.505741    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8" podUID="26b45581-edb6-43f0-9090-a409e545dce6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 20:14:13.583532 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.583494    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15ee5317-804b-4c24-881b-4cca0d61c599-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-0180d1-78c66f9c9b-6fqbc\" (UID: \"15ee5317-804b-4c24-881b-4cca0d61c599\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-0180d1-78c66f9c9b-6fqbc"
Jul 28 20:14:13.583726 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.583598    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxsc5\" (UniqueName: \"kubernetes.io/projected/15ee5317-804b-4c24-881b-4cca0d61c599-kube-api-access-rxsc5\") pod \"payload-pre-processing-e2e-api-a-0180d1-78c66f9c9b-6fqbc\" (UID: \"15ee5317-804b-4c24-881b-4cca0d61c599\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-0180d1-78c66f9c9b-6fqbc"
Jul 28 20:14:13.583726 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.583618    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61a599ea-33a9-40bc-a15f-935adefb6806-plugins-config-volume\") pod \"payload-processing-e2e-api-a-0180d1-798b67bd76-btdlv\" (UID: \"61a599ea-33a9-40bc-a15f-935adefb6806\") " pod="openshift-ingress/payload-processing-e2e-api-a-0180d1-798b67bd76-btdlv"
Jul 28 20:14:13.583726 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.583644    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wztt\" (UniqueName: \"kubernetes.io/projected/61a599ea-33a9-40bc-a15f-935adefb6806-kube-api-access-5wztt\") pod \"payload-processing-e2e-api-a-0180d1-798b67bd76-btdlv\" (UID: \"61a599ea-33a9-40bc-a15f-935adefb6806\") " pod="openshift-ingress/payload-processing-e2e-api-a-0180d1-798b67bd76-btdlv"
Jul 28 20:14:13.584248 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.584226    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15ee5317-804b-4c24-881b-4cca0d61c599-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-0180d1-78c66f9c9b-6fqbc\" (UID: \"15ee5317-804b-4c24-881b-4cca0d61c599\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-0180d1-78c66f9c9b-6fqbc"
Jul 28 20:14:13.584499 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.584478    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61a599ea-33a9-40bc-a15f-935adefb6806-plugins-config-volume\") pod \"payload-processing-e2e-api-a-0180d1-798b67bd76-btdlv\" (UID: \"61a599ea-33a9-40bc-a15f-935adefb6806\") " pod="openshift-ingress/payload-processing-e2e-api-a-0180d1-798b67bd76-btdlv"
Jul 28 20:14:13.591806 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.591771    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wztt\" (UniqueName: \"kubernetes.io/projected/61a599ea-33a9-40bc-a15f-935adefb6806-kube-api-access-5wztt\") pod \"payload-processing-e2e-api-a-0180d1-798b67bd76-btdlv\" (UID: \"61a599ea-33a9-40bc-a15f-935adefb6806\") " pod="openshift-ingress/payload-processing-e2e-api-a-0180d1-798b67bd76-btdlv"
Jul 28 20:14:13.591922 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.591771    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxsc5\" (UniqueName: \"kubernetes.io/projected/15ee5317-804b-4c24-881b-4cca0d61c599-kube-api-access-rxsc5\") pod \"payload-pre-processing-e2e-api-a-0180d1-78c66f9c9b-6fqbc\" (UID: \"15ee5317-804b-4c24-881b-4cca0d61c599\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-0180d1-78c66f9c9b-6fqbc"
Jul 28 20:14:13.695573 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.695532    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0180d1-78c66f9c9b-6fqbc"
Jul 28 20:14:13.733673 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.733642    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-0180d1-798b67bd76-btdlv"
Jul 28 20:14:13.844209 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.843865    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:14:13.884192 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.884161    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-0180d1-78c66f9c9b-6fqbc"]
Jul 28 20:14:13.886373 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:14:13.886344    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15ee5317_804b_4c24_881b_4cca0d61c599.slice/crio-ce43fae704dfd56560bb7dae8c7ea512178cd35d0b3364157540bf7441eb1ad7 WatchSource:0}: Error finding container ce43fae704dfd56560bb7dae8c7ea512178cd35d0b3364157540bf7441eb1ad7: Status 404 returned error can't find the container with id ce43fae704dfd56560bb7dae8c7ea512178cd35d0b3364157540bf7441eb1ad7
Jul 28 20:14:13.909322 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.909299    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0180d1-798b67bd76-btdlv"]
Jul 28 20:14:13.918094 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:14:13.918063    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61a599ea_33a9_40bc_a15f_935adefb6806.slice/crio-3fb7d4884275d780f3b47aff2f4ae8b3a84afeefb7c5e750c08e73aca3970475 WatchSource:0}: Error finding container 3fb7d4884275d780f3b47aff2f4ae8b3a84afeefb7c5e750c08e73aca3970475: Status 404 returned error can't find the container with id 3fb7d4884275d780f3b47aff2f4ae8b3a84afeefb7c5e750c08e73aca3970475
Jul 28 20:14:13.988453 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.988419    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26b45581-edb6-43f0-9090-a409e545dce6-istio-envoy\") pod \"26b45581-edb6-43f0-9090-a409e545dce6\" (UID: \"26b45581-edb6-43f0-9090-a409e545dce6\") "
Jul 28 20:14:13.988620 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.988483    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26b45581-edb6-43f0-9090-a409e545dce6-istio-data\") pod \"26b45581-edb6-43f0-9090-a409e545dce6\" (UID: \"26b45581-edb6-43f0-9090-a409e545dce6\") "
Jul 28 20:14:13.988620 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.988551    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26b45581-edb6-43f0-9090-a409e545dce6-workload-socket\") pod \"26b45581-edb6-43f0-9090-a409e545dce6\" (UID: \"26b45581-edb6-43f0-9090-a409e545dce6\") "
Jul 28 20:14:13.988620 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.988578    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26b45581-edb6-43f0-9090-a409e545dce6-istiod-ca-cert\") pod \"26b45581-edb6-43f0-9090-a409e545dce6\" (UID: \"26b45581-edb6-43f0-9090-a409e545dce6\") "
Jul 28 20:14:13.988620 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.988597    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26b45581-edb6-43f0-9090-a409e545dce6-istio-podinfo\") pod \"26b45581-edb6-43f0-9090-a409e545dce6\" (UID: \"26b45581-edb6-43f0-9090-a409e545dce6\") "
Jul 28 20:14:13.988847 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.988623    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rj4pg\" (UniqueName: \"kubernetes.io/projected/26b45581-edb6-43f0-9090-a409e545dce6-kube-api-access-rj4pg\") pod \"26b45581-edb6-43f0-9090-a409e545dce6\" (UID: \"26b45581-edb6-43f0-9090-a409e545dce6\") "
Jul 28 20:14:13.988847 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.988663    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26b45581-edb6-43f0-9090-a409e545dce6-workload-certs\") pod \"26b45581-edb6-43f0-9090-a409e545dce6\" (UID: \"26b45581-edb6-43f0-9090-a409e545dce6\") "
Jul 28 20:14:13.988847 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.988690    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26b45581-edb6-43f0-9090-a409e545dce6-istio-token\") pod \"26b45581-edb6-43f0-9090-a409e545dce6\" (UID: \"26b45581-edb6-43f0-9090-a409e545dce6\") "
Jul 28 20:14:13.988847 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.988711    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26b45581-edb6-43f0-9090-a409e545dce6-credential-socket\") pod \"26b45581-edb6-43f0-9090-a409e545dce6\" (UID: \"26b45581-edb6-43f0-9090-a409e545dce6\") "
Jul 28 20:14:13.989253 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.989133    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26b45581-edb6-43f0-9090-a409e545dce6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "26b45581-edb6-43f0-9090-a409e545dce6" (UID: "26b45581-edb6-43f0-9090-a409e545dce6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:14:13.989253 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.989138    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26b45581-edb6-43f0-9090-a409e545dce6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "26b45581-edb6-43f0-9090-a409e545dce6" (UID: "26b45581-edb6-43f0-9090-a409e545dce6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:14:13.989253 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.989174    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26b45581-edb6-43f0-9090-a409e545dce6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "26b45581-edb6-43f0-9090-a409e545dce6" (UID: "26b45581-edb6-43f0-9090-a409e545dce6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:14:13.989444 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.989277    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26b45581-edb6-43f0-9090-a409e545dce6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "26b45581-edb6-43f0-9090-a409e545dce6" (UID: "26b45581-edb6-43f0-9090-a409e545dce6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:14:13.989444 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.989362    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26b45581-edb6-43f0-9090-a409e545dce6-istio-data" (OuterVolumeSpecName: "istio-data") pod "26b45581-edb6-43f0-9090-a409e545dce6" (UID: "26b45581-edb6-43f0-9090-a409e545dce6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:14:13.991461 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.991434    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26b45581-edb6-43f0-9090-a409e545dce6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "26b45581-edb6-43f0-9090-a409e545dce6" (UID: "26b45581-edb6-43f0-9090-a409e545dce6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:14:13.991461 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.991442    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26b45581-edb6-43f0-9090-a409e545dce6-istio-token" (OuterVolumeSpecName: "istio-token") pod "26b45581-edb6-43f0-9090-a409e545dce6" (UID: "26b45581-edb6-43f0-9090-a409e545dce6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:14:13.991681 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.991489    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26b45581-edb6-43f0-9090-a409e545dce6-kube-api-access-rj4pg" (OuterVolumeSpecName: "kube-api-access-rj4pg") pod "26b45581-edb6-43f0-9090-a409e545dce6" (UID: "26b45581-edb6-43f0-9090-a409e545dce6"). InnerVolumeSpecName "kube-api-access-rj4pg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:14:13.991681 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:13.991658    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/26b45581-edb6-43f0-9090-a409e545dce6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "26b45581-edb6-43f0-9090-a409e545dce6" (UID: "26b45581-edb6-43f0-9090-a409e545dce6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:14:14.090388 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:14.090347    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rj4pg\" (UniqueName: \"kubernetes.io/projected/26b45581-edb6-43f0-9090-a409e545dce6-kube-api-access-rj4pg\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:14:14.090388 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:14.090387    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26b45581-edb6-43f0-9090-a409e545dce6-workload-certs\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:14:14.090598 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:14.090401    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26b45581-edb6-43f0-9090-a409e545dce6-istio-token\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:14:14.090598 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:14.090414    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26b45581-edb6-43f0-9090-a409e545dce6-credential-socket\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:14:14.090598 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:14.090427    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26b45581-edb6-43f0-9090-a409e545dce6-istio-envoy\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:14:14.090598 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:14.090441    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26b45581-edb6-43f0-9090-a409e545dce6-istio-data\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:14:14.090598 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:14.090454    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26b45581-edb6-43f0-9090-a409e545dce6-workload-socket\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:14:14.090598 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:14.090467    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26b45581-edb6-43f0-9090-a409e545dce6-istiod-ca-cert\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:14:14.090598 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:14.090480    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26b45581-edb6-43f0-9090-a409e545dce6-istio-podinfo\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:14:14.589914 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:14.589869    2570 generic.go:356] "Generic (PLEG): container finished" podID="26b45581-edb6-43f0-9090-a409e545dce6" containerID="cf6a1ce88eab63b48731ec96247629abab1f4b82fd1ed6fd3df179238fdad474" exitCode=0
Jul 28 20:14:14.590425 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:14.589996    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"
Jul 28 20:14:14.590425 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:14.590030    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8" event={"ID":"26b45581-edb6-43f0-9090-a409e545dce6","Type":"ContainerDied","Data":"cf6a1ce88eab63b48731ec96247629abab1f4b82fd1ed6fd3df179238fdad474"}
Jul 28 20:14:14.590425 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:14.590169    2570 scope.go:117] "RemoveContainer" containerID="cf6a1ce88eab63b48731ec96247629abab1f4b82fd1ed6fd3df179238fdad474"
Jul 28 20:14:14.590630 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:14.590132    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8" event={"ID":"26b45581-edb6-43f0-9090-a409e545dce6","Type":"ContainerDied","Data":"c653c8a6761d6ca4b2e1019dfbf02bc775e62696b1f6fba47f684062958c24c8"}
Jul 28 20:14:14.592586 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:14.592297    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0180d1-78c66f9c9b-6fqbc" event={"ID":"15ee5317-804b-4c24-881b-4cca0d61c599","Type":"ContainerStarted","Data":"3fff7de5fbc552013fffb072cfc9cf97a3d5a9d290d0c6d462e50870bf906518"}
Jul 28 20:14:14.592586 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:14.592344    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0180d1-78c66f9c9b-6fqbc" event={"ID":"15ee5317-804b-4c24-881b-4cca0d61c599","Type":"ContainerStarted","Data":"ce43fae704dfd56560bb7dae8c7ea512178cd35d0b3364157540bf7441eb1ad7"}
Jul 28 20:14:14.592586 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:14.592380    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0180d1-78c66f9c9b-6fqbc"
Jul 28 20:14:14.595331 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:14.594746    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-0180d1-798b67bd76-btdlv" event={"ID":"61a599ea-33a9-40bc-a15f-935adefb6806","Type":"ContainerStarted","Data":"bf729803c8ad5199fbd75ca6a9bfe7f7c5e426d8d71493da52062cdd0bed6241"}
Jul 28 20:14:14.595331 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:14.594789    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-0180d1-798b67bd76-btdlv" event={"ID":"61a599ea-33a9-40bc-a15f-935adefb6806","Type":"ContainerStarted","Data":"3fb7d4884275d780f3b47aff2f4ae8b3a84afeefb7c5e750c08e73aca3970475"}
Jul 28 20:14:14.595331 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:14.595255    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-0180d1-798b67bd76-btdlv"
Jul 28 20:14:14.610437 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:14.610386    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-0180d1-798b67bd76-btdlv" podStartSLOduration=1.610365894 podStartE2EDuration="1.610365894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:14:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:14:14.609579303 +0000 UTC m=+2667.561611655" watchObservedRunningTime="2026-07-28 20:14:14.610365894 +0000 UTC m=+2667.562398219"
Jul 28 20:14:14.611440 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:14.611416    2570 scope.go:117] "RemoveContainer" containerID="a0f2f9c2ef1c38eb24b466597d40f98db416c6ff1e966106e5cb4c15aa40aea4"
Jul 28 20:14:14.626814 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:14.626731    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0180d1-78c66f9c9b-6fqbc" podStartSLOduration=1.6267111380000001 podStartE2EDuration="1.626711138s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:14:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:14:14.626579092 +0000 UTC m=+2667.578611448" watchObservedRunningTime="2026-07-28 20:14:14.626711138 +0000 UTC m=+2667.578743469"
Jul 28 20:14:14.628250 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:14.628226    2570 scope.go:117] "RemoveContainer" containerID="cf6a1ce88eab63b48731ec96247629abab1f4b82fd1ed6fd3df179238fdad474"
Jul 28 20:14:14.628527 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:14:14.628510    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf6a1ce88eab63b48731ec96247629abab1f4b82fd1ed6fd3df179238fdad474\": container with ID starting with cf6a1ce88eab63b48731ec96247629abab1f4b82fd1ed6fd3df179238fdad474 not found: ID does not exist" containerID="cf6a1ce88eab63b48731ec96247629abab1f4b82fd1ed6fd3df179238fdad474"
Jul 28 20:14:14.628583 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:14.628533    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf6a1ce88eab63b48731ec96247629abab1f4b82fd1ed6fd3df179238fdad474"} err="failed to get container status \"cf6a1ce88eab63b48731ec96247629abab1f4b82fd1ed6fd3df179238fdad474\": rpc error: code = NotFound desc = could not find container \"cf6a1ce88eab63b48731ec96247629abab1f4b82fd1ed6fd3df179238fdad474\": container with ID starting with cf6a1ce88eab63b48731ec96247629abab1f4b82fd1ed6fd3df179238fdad474 not found: ID does not exist"
Jul 28 20:14:14.628583 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:14.628549    2570 scope.go:117] "RemoveContainer" containerID="a0f2f9c2ef1c38eb24b466597d40f98db416c6ff1e966106e5cb4c15aa40aea4"
Jul 28 20:14:14.628761 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:14:14.628744    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0f2f9c2ef1c38eb24b466597d40f98db416c6ff1e966106e5cb4c15aa40aea4\": container with ID starting with a0f2f9c2ef1c38eb24b466597d40f98db416c6ff1e966106e5cb4c15aa40aea4 not found: ID does not exist" containerID="a0f2f9c2ef1c38eb24b466597d40f98db416c6ff1e966106e5cb4c15aa40aea4"
Jul 28 20:14:14.628819 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:14.628764    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0f2f9c2ef1c38eb24b466597d40f98db416c6ff1e966106e5cb4c15aa40aea4"} err="failed to get container status \"a0f2f9c2ef1c38eb24b466597d40f98db416c6ff1e966106e5cb4c15aa40aea4\": rpc error: code = NotFound desc = could not find container \"a0f2f9c2ef1c38eb24b466597d40f98db416c6ff1e966106e5cb4c15aa40aea4\": container with ID starting with a0f2f9c2ef1c38eb24b466597d40f98db416c6ff1e966106e5cb4c15aa40aea4 not found: ID does not exist"
Jul 28 20:14:14.646751 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:14.646719    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"]
Jul 28 20:14:14.652886 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:14.652861    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-e98043-openshift-default-fb784d578-jp6s8"]
Jul 28 20:14:15.572575 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:15.572534    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26b45581-edb6-43f0-9090-a409e545dce6" path="/var/lib/kubelet/pods/26b45581-edb6-43f0-9090-a409e545dce6/volumes"
Jul 28 20:14:25.604675 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:25.604639    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0180d1-78c66f9c9b-6fqbc"
Jul 28 20:14:26.574704 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:26.574666    2570 patch_prober.go:28] interesting pod/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 28 20:14:26.574922 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:26.574739    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq" podUID="7d25cb68-3cd5-47c3-9105-577fcb76881b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 28 20:14:26.609585 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:26.609557    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-0180d1-798b67bd76-btdlv"
Jul 28 20:14:26.656348 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:26.656300    2570 generic.go:356] "Generic (PLEG): container finished" podID="7d25cb68-3cd5-47c3-9105-577fcb76881b" containerID="07980d693ea104b54fbebffb67e01001ab3113f8f0167d54e94d74a16f64532b" exitCode=0
Jul 28 20:14:26.656508 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:26.656374    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq" event={"ID":"7d25cb68-3cd5-47c3-9105-577fcb76881b","Type":"ContainerDied","Data":"07980d693ea104b54fbebffb67e01001ab3113f8f0167d54e94d74a16f64532b"}
Jul 28 20:14:26.656788 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:26.656774    2570 scope.go:117] "RemoveContainer" containerID="07980d693ea104b54fbebffb67e01001ab3113f8f0167d54e94d74a16f64532b"
Jul 28 20:14:26.657833 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:26.657769    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:14:26.657933 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:26.657889    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:14:26.658021 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:26.657937    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:14:27.662612 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:27.662572    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq" event={"ID":"7d25cb68-3cd5-47c3-9105-577fcb76881b","Type":"ContainerStarted","Data":"3b8693765b948ca8badc011dfbd361685d3db5b982ca4967f70b7db872cb30b6"}
Jul 28 20:14:27.756387 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:27.756348    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:14:27.756618 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:27.756595    2570 patch_prober.go:28] interesting pod/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 28 20:14:27.756676 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:27.756656    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq" podUID="7d25cb68-3cd5-47c3-9105-577fcb76881b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 28 20:14:28.755955 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:28.755917    2570 patch_prober.go:28] interesting pod/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 28 20:14:28.756379 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:28.756002    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq" podUID="7d25cb68-3cd5-47c3-9105-577fcb76881b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 28 20:14:29.756918 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:29.756879    2570 patch_prober.go:28] interesting pod/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 28 20:14:29.757346 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:29.756942    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq" podUID="7d25cb68-3cd5-47c3-9105-577fcb76881b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 28 20:14:30.756494 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:30.756458    2570 patch_prober.go:28] interesting pod/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 28 20:14:30.756671 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:30.756529    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq" podUID="7d25cb68-3cd5-47c3-9105-577fcb76881b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 28 20:14:31.760149 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:31.760120    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:14:31.760557 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:31.760384    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:14:31.761168 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:31.761145    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:14:38.266336 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.266304    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"]
Jul 28 20:14:38.266793 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.266652    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26b45581-edb6-43f0-9090-a409e545dce6" containerName="istio-proxy"
Jul 28 20:14:38.266793 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.266666    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="26b45581-edb6-43f0-9090-a409e545dce6" containerName="istio-proxy"
Jul 28 20:14:38.266793 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.266680    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26b45581-edb6-43f0-9090-a409e545dce6" containerName="istio-proxy"
Jul 28 20:14:38.266793 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.266689    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="26b45581-edb6-43f0-9090-a409e545dce6" containerName="istio-proxy"
Jul 28 20:14:38.266793 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.266747    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="26b45581-edb6-43f0-9090-a409e545dce6" containerName="istio-proxy"
Jul 28 20:14:38.269234 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.269215    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:14:38.272461 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.272437    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-86e5cf-openshift-default-dockercfg-b97n9\""
Jul 28 20:14:38.293326 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.293298    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"]
Jul 28 20:14:38.297666 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.297639    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bc27a13-c02b-4d96-92dc-8f160ca48d28-istio-envoy\") pod \"e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9\" (UID: \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\") " pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:14:38.297808 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.297677    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bc27a13-c02b-4d96-92dc-8f160ca48d28-istio-podinfo\") pod \"e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9\" (UID: \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\") " pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:14:38.297808 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.297693    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bc27a13-c02b-4d96-92dc-8f160ca48d28-istio-token\") pod \"e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9\" (UID: \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\") " pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:14:38.297808 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.297746    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdcs7\" (UniqueName: \"kubernetes.io/projected/6bc27a13-c02b-4d96-92dc-8f160ca48d28-kube-api-access-qdcs7\") pod \"e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9\" (UID: \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\") " pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:14:38.297808 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.297793    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bc27a13-c02b-4d96-92dc-8f160ca48d28-credential-socket\") pod \"e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9\" (UID: \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\") " pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:14:38.298058 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.297819    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bc27a13-c02b-4d96-92dc-8f160ca48d28-istiod-ca-cert\") pod \"e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9\" (UID: \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\") " pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:14:38.298058 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.297901    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bc27a13-c02b-4d96-92dc-8f160ca48d28-istio-data\") pod \"e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9\" (UID: \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\") " pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:14:38.298058 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.297931    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bc27a13-c02b-4d96-92dc-8f160ca48d28-workload-certs\") pod \"e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9\" (UID: \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\") " pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:14:38.298058 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.298002    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bc27a13-c02b-4d96-92dc-8f160ca48d28-workload-socket\") pod \"e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9\" (UID: \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\") " pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:14:38.398700 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.398662    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bc27a13-c02b-4d96-92dc-8f160ca48d28-istio-data\") pod \"e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9\" (UID: \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\") " pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:14:38.398905 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.398705    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bc27a13-c02b-4d96-92dc-8f160ca48d28-workload-certs\") pod \"e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9\" (UID: \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\") " pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:14:38.398905 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.398752    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bc27a13-c02b-4d96-92dc-8f160ca48d28-workload-socket\") pod \"e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9\" (UID: \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\") " pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:14:38.398905 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.398781    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bc27a13-c02b-4d96-92dc-8f160ca48d28-istio-envoy\") pod \"e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9\" (UID: \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\") " pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:14:38.399113 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.398919    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bc27a13-c02b-4d96-92dc-8f160ca48d28-istio-podinfo\") pod \"e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9\" (UID: \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\") " pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:14:38.399113 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.398958    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bc27a13-c02b-4d96-92dc-8f160ca48d28-istio-token\") pod \"e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9\" (UID: \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\") " pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:14:38.399113 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.399004    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdcs7\" (UniqueName: \"kubernetes.io/projected/6bc27a13-c02b-4d96-92dc-8f160ca48d28-kube-api-access-qdcs7\") pod \"e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9\" (UID: \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\") " pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:14:38.399113 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.399034    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bc27a13-c02b-4d96-92dc-8f160ca48d28-credential-socket\") pod \"e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9\" (UID: \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\") " pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:14:38.399113 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.399058    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bc27a13-c02b-4d96-92dc-8f160ca48d28-istiod-ca-cert\") pod \"e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9\" (UID: \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\") " pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:14:38.399385 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.399145    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bc27a13-c02b-4d96-92dc-8f160ca48d28-istio-data\") pod \"e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9\" (UID: \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\") " pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:14:38.399385 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.399164    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bc27a13-c02b-4d96-92dc-8f160ca48d28-workload-certs\") pod \"e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9\" (UID: \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\") " pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:14:38.399385 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.399243    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bc27a13-c02b-4d96-92dc-8f160ca48d28-workload-socket\") pod \"e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9\" (UID: \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\") " pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:14:38.399551 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.399415    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bc27a13-c02b-4d96-92dc-8f160ca48d28-credential-socket\") pod \"e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9\" (UID: \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\") " pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:14:38.399742 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.399719    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bc27a13-c02b-4d96-92dc-8f160ca48d28-istiod-ca-cert\") pod \"e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9\" (UID: \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\") " pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:14:38.401161 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.401131    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bc27a13-c02b-4d96-92dc-8f160ca48d28-istio-envoy\") pod \"e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9\" (UID: \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\") " pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:14:38.401390 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.401371    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bc27a13-c02b-4d96-92dc-8f160ca48d28-istio-podinfo\") pod \"e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9\" (UID: \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\") " pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:14:38.407866 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.407819    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bc27a13-c02b-4d96-92dc-8f160ca48d28-istio-token\") pod \"e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9\" (UID: \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\") " pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:14:38.408085 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.408068    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdcs7\" (UniqueName: \"kubernetes.io/projected/6bc27a13-c02b-4d96-92dc-8f160ca48d28-kube-api-access-qdcs7\") pod \"e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9\" (UID: \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\") " pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:14:38.580724 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.580603    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:14:38.714845 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.714812    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"]
Jul 28 20:14:38.718629 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:14:38.718599    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bc27a13_c02b_4d96_92dc_8f160ca48d28.slice/crio-e2326fbfaf425b060ca2a576d5ab9a70ba8b81dcee0763694baa269859e2b262 WatchSource:0}: Error finding container e2326fbfaf425b060ca2a576d5ab9a70ba8b81dcee0763694baa269859e2b262: Status 404 returned error can't find the container with id e2326fbfaf425b060ca2a576d5ab9a70ba8b81dcee0763694baa269859e2b262
Jul 28 20:14:38.720716 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.720682    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:14:38.720816 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.720763    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:14:38.720816 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:38.720809    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:14:39.722385 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:39.722295    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9" event={"ID":"6bc27a13-c02b-4d96-92dc-8f160ca48d28","Type":"ContainerStarted","Data":"893aa02f989f142cd89e22ecdc5e3f5264272c82e654883bab1ebeb8f3af649f"}
Jul 28 20:14:39.722385 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:39.722353    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9" event={"ID":"6bc27a13-c02b-4d96-92dc-8f160ca48d28","Type":"ContainerStarted","Data":"e2326fbfaf425b060ca2a576d5ab9a70ba8b81dcee0763694baa269859e2b262"}
Jul 28 20:14:39.744512 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:39.744459    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9" podStartSLOduration=1.74444201 podStartE2EDuration="1.74444201s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:14:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:14:39.74347664 +0000 UTC m=+2692.695508968" watchObservedRunningTime="2026-07-28 20:14:39.74444201 +0000 UTC m=+2692.696474340"
Jul 28 20:14:40.581031 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:40.580997    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:14:40.585904 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:40.585876    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:14:40.726901 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:40.726871    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:14:40.727806 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:40.727788    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:14:42.561794 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:42.561760    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-86e5cf-65d48d4d4-xsdbh"]
Jul 28 20:14:42.562206 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:42.562171    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="26b45581-edb6-43f0-9090-a409e545dce6" containerName="istio-proxy"
Jul 28 20:14:42.564675 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:42.564654    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-86e5cf-65d48d4d4-xsdbh"
Jul 28 20:14:42.568466 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:42.568440    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-86e5cf\""
Jul 28 20:14:42.568466 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:42.568440    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-86e5cf-dockercfg-vpvwt\""
Jul 28 20:14:42.577538 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:42.577515    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-86e5cf-65d48d4d4-xsdbh"]
Jul 28 20:14:42.600231 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:42.600198    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-86e5cf-669cc79668-prrtr"]
Jul 28 20:14:42.602704 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:42.602686    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-86e5cf-669cc79668-prrtr"
Jul 28 20:14:42.620579 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:42.620548    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-86e5cf-669cc79668-prrtr"]
Jul 28 20:14:42.632504 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:42.632477    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6805846-1101-46f8-920f-966a8202ae73-plugins-config-volume\") pod \"payload-processing-e2e-api-b-86e5cf-669cc79668-prrtr\" (UID: \"f6805846-1101-46f8-920f-966a8202ae73\") " pod="openshift-ingress/payload-processing-e2e-api-b-86e5cf-669cc79668-prrtr"
Jul 28 20:14:42.632699 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:42.632526    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmk9k\" (UniqueName: \"kubernetes.io/projected/f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1-kube-api-access-cmk9k\") pod \"payload-pre-processing-e2e-api-b-86e5cf-65d48d4d4-xsdbh\" (UID: \"f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-86e5cf-65d48d4d4-xsdbh"
Jul 28 20:14:42.632833 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:42.632808    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-86e5cf-65d48d4d4-xsdbh\" (UID: \"f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-86e5cf-65d48d4d4-xsdbh"
Jul 28 20:14:42.632903 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:42.632854    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g6hw\" (UniqueName: \"kubernetes.io/projected/f6805846-1101-46f8-920f-966a8202ae73-kube-api-access-9g6hw\") pod \"payload-processing-e2e-api-b-86e5cf-669cc79668-prrtr\" (UID: \"f6805846-1101-46f8-920f-966a8202ae73\") " pod="openshift-ingress/payload-processing-e2e-api-b-86e5cf-669cc79668-prrtr"
Jul 28 20:14:42.734063 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:42.734026    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6805846-1101-46f8-920f-966a8202ae73-plugins-config-volume\") pod \"payload-processing-e2e-api-b-86e5cf-669cc79668-prrtr\" (UID: \"f6805846-1101-46f8-920f-966a8202ae73\") " pod="openshift-ingress/payload-processing-e2e-api-b-86e5cf-669cc79668-prrtr"
Jul 28 20:14:42.734253 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:42.734088    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmk9k\" (UniqueName: \"kubernetes.io/projected/f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1-kube-api-access-cmk9k\") pod \"payload-pre-processing-e2e-api-b-86e5cf-65d48d4d4-xsdbh\" (UID: \"f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-86e5cf-65d48d4d4-xsdbh"
Jul 28 20:14:42.734253 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:42.734185    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-86e5cf-65d48d4d4-xsdbh\" (UID: \"f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-86e5cf-65d48d4d4-xsdbh"
Jul 28 20:14:42.734253 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:42.734209    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g6hw\" (UniqueName: \"kubernetes.io/projected/f6805846-1101-46f8-920f-966a8202ae73-kube-api-access-9g6hw\") pod \"payload-processing-e2e-api-b-86e5cf-669cc79668-prrtr\" (UID: \"f6805846-1101-46f8-920f-966a8202ae73\") " pod="openshift-ingress/payload-processing-e2e-api-b-86e5cf-669cc79668-prrtr"
Jul 28 20:14:42.734873 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:42.734850    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6805846-1101-46f8-920f-966a8202ae73-plugins-config-volume\") pod \"payload-processing-e2e-api-b-86e5cf-669cc79668-prrtr\" (UID: \"f6805846-1101-46f8-920f-966a8202ae73\") " pod="openshift-ingress/payload-processing-e2e-api-b-86e5cf-669cc79668-prrtr"
Jul 28 20:14:42.735038 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:42.734956    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-86e5cf-65d48d4d4-xsdbh\" (UID: \"f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-86e5cf-65d48d4d4-xsdbh"
Jul 28 20:14:42.742187 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:42.742168    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmk9k\" (UniqueName: \"kubernetes.io/projected/f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1-kube-api-access-cmk9k\") pod \"payload-pre-processing-e2e-api-b-86e5cf-65d48d4d4-xsdbh\" (UID: \"f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-86e5cf-65d48d4d4-xsdbh"
Jul 28 20:14:42.742349 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:42.742329    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g6hw\" (UniqueName: \"kubernetes.io/projected/f6805846-1101-46f8-920f-966a8202ae73-kube-api-access-9g6hw\") pod \"payload-processing-e2e-api-b-86e5cf-669cc79668-prrtr\" (UID: \"f6805846-1101-46f8-920f-966a8202ae73\") " pod="openshift-ingress/payload-processing-e2e-api-b-86e5cf-669cc79668-prrtr"
Jul 28 20:14:42.875399 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:42.875297    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-86e5cf-65d48d4d4-xsdbh"
Jul 28 20:14:42.912445 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:42.912406    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-86e5cf-669cc79668-prrtr"
Jul 28 20:14:43.064229 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:43.063864    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-86e5cf-669cc79668-prrtr"]
Jul 28 20:14:43.066278 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:14:43.066246    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6805846_1101_46f8_920f_966a8202ae73.slice/crio-0dc6aa636259257cd096f2e88d9e6b90851a56fbe3add9aa0676265cc1a088f1 WatchSource:0}: Error finding container 0dc6aa636259257cd096f2e88d9e6b90851a56fbe3add9aa0676265cc1a088f1: Status 404 returned error can't find the container with id 0dc6aa636259257cd096f2e88d9e6b90851a56fbe3add9aa0676265cc1a088f1
Jul 28 20:14:43.229194 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:43.229154    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-86e5cf-65d48d4d4-xsdbh"]
Jul 28 20:14:43.233045 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:14:43.233020    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0cd3e5b_4ad7_4db8_aa3f_d14aae4a2ce1.slice/crio-07af4c56385f865ccb09f7c13ada99039844304ad76a9bd05e52130f81f27e37 WatchSource:0}: Error finding container 07af4c56385f865ccb09f7c13ada99039844304ad76a9bd05e52130f81f27e37: Status 404 returned error can't find the container with id 07af4c56385f865ccb09f7c13ada99039844304ad76a9bd05e52130f81f27e37
Jul 28 20:14:43.741615 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:43.741572    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-86e5cf-669cc79668-prrtr" event={"ID":"f6805846-1101-46f8-920f-966a8202ae73","Type":"ContainerStarted","Data":"350d5542c454bbdffc69d70a799d77353f71a11a058ed17d243b3a49d7acd1b4"}
Jul 28 20:14:43.742097 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:43.741635    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-86e5cf-669cc79668-prrtr" event={"ID":"f6805846-1101-46f8-920f-966a8202ae73","Type":"ContainerStarted","Data":"0dc6aa636259257cd096f2e88d9e6b90851a56fbe3add9aa0676265cc1a088f1"}
Jul 28 20:14:43.742097 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:43.741694    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-86e5cf-669cc79668-prrtr"
Jul 28 20:14:43.743103 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:43.743074    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-86e5cf-65d48d4d4-xsdbh" event={"ID":"f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1","Type":"ContainerStarted","Data":"7b8ec05704d14a79283838088c71c0fe1090fa5d1c52d04aa4f0638dca22bdcc"}
Jul 28 20:14:43.743245 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:43.743121    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-86e5cf-65d48d4d4-xsdbh" event={"ID":"f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1","Type":"ContainerStarted","Data":"07af4c56385f865ccb09f7c13ada99039844304ad76a9bd05e52130f81f27e37"}
Jul 28 20:14:43.743245 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:43.743150    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-86e5cf-65d48d4d4-xsdbh"
Jul 28 20:14:43.768033 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:43.767952    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-86e5cf-669cc79668-prrtr" podStartSLOduration=1.767934845 podStartE2EDuration="1.767934845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:14:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:14:43.766084427 +0000 UTC m=+2696.718116776" watchObservedRunningTime="2026-07-28 20:14:43.767934845 +0000 UTC m=+2696.719967174"
Jul 28 20:14:43.796542 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:43.796494    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-86e5cf-65d48d4d4-xsdbh" podStartSLOduration=1.796476306 podStartE2EDuration="1.796476306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:14:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:14:43.794733072 +0000 UTC m=+2696.746765405" watchObservedRunningTime="2026-07-28 20:14:43.796476306 +0000 UTC m=+2696.748508665"
Jul 28 20:14:47.811884 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:47.811844    2570 scope.go:117] "RemoveContainer" containerID="e847c84c4253ba78c2f57d0c20eead05b36ec1190cb2b37b9f3729ceabf12de1"
Jul 28 20:14:54.749694 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:54.749641    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-api-b-86e5cf-65d48d4d4-xsdbh" podUID="f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.59:9004: connect: connection refused"
Jul 28 20:14:54.750222 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:54.750197    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-86e5cf-669cc79668-prrtr"
Jul 28 20:14:55.728154 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:55.728079    2570 patch_prober.go:28] interesting pod/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 28 20:14:55.728354 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:55.728146    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9" podUID="6bc27a13-c02b-4d96-92dc-8f160ca48d28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 28 20:14:55.803774 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:55.803744    2570 generic.go:356] "Generic (PLEG): container finished" podID="6bc27a13-c02b-4d96-92dc-8f160ca48d28" containerID="893aa02f989f142cd89e22ecdc5e3f5264272c82e654883bab1ebeb8f3af649f" exitCode=0
Jul 28 20:14:55.804167 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:55.803822    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9" event={"ID":"6bc27a13-c02b-4d96-92dc-8f160ca48d28","Type":"ContainerDied","Data":"893aa02f989f142cd89e22ecdc5e3f5264272c82e654883bab1ebeb8f3af649f"}
Jul 28 20:14:55.804256 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:55.804242    2570 scope.go:117] "RemoveContainer" containerID="893aa02f989f142cd89e22ecdc5e3f5264272c82e654883bab1ebeb8f3af649f"
Jul 28 20:14:55.805317 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:55.805285    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:14:55.805435 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:55.805353    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:14:55.805435 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:55.805384    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:14:56.814047 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:56.814011    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9" event={"ID":"6bc27a13-c02b-4d96-92dc-8f160ca48d28","Type":"ContainerStarted","Data":"241d7d448bc7bfe88b587a773708cb9b28886f0c1aca21ce6d8d300dcdd57be4"}
Jul 28 20:14:57.581037 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:57.581007    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:14:57.581272 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:57.581231    2570 patch_prober.go:28] interesting pod/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 28 20:14:57.581322 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:57.581291    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9" podUID="6bc27a13-c02b-4d96-92dc-8f160ca48d28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 28 20:14:58.581652 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:58.581613    2570 patch_prober.go:28] interesting pod/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 28 20:14:58.582115 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:58.581672    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9" podUID="6bc27a13-c02b-4d96-92dc-8f160ca48d28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 28 20:14:59.581136 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:59.581099    2570 patch_prober.go:28] interesting pod/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 28 20:14:59.581325 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:14:59.581153    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9" podUID="6bc27a13-c02b-4d96-92dc-8f160ca48d28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 28 20:15:00.595917 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:00.595882    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:15:00.596415 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:00.596301    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:15:00.596991 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:00.596959    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:15:04.748325 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:04.748292    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-86e5cf-65d48d4d4-xsdbh"
Jul 28 20:15:25.177771 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:25.177735    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0180d1-798b67bd76-btdlv"]
Jul 28 20:15:25.178463 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:25.178042    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-0180d1-798b67bd76-btdlv" podUID="61a599ea-33a9-40bc-a15f-935adefb6806" containerName="payload-processing" containerID="cri-o://bf729803c8ad5199fbd75ca6a9bfe7f7c5e426d8d71493da52062cdd0bed6241" gracePeriod=30
Jul 28 20:15:25.181144 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:25.181098    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-0180d1-78c66f9c9b-6fqbc"]
Jul 28 20:15:25.181562 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:25.181328    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0180d1-78c66f9c9b-6fqbc" podUID="15ee5317-804b-4c24-881b-4cca0d61c599" containerName="payload-pre-processing" containerID="cri-o://3fff7de5fbc552013fffb072cfc9cf97a3d5a9d290d0c6d462e50870bf906518" gracePeriod=30
Jul 28 20:15:25.453763 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:25.453737    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-0180d1-798b67bd76-btdlv"
Jul 28 20:15:25.489765 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:25.489740    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0180d1-78c66f9c9b-6fqbc"
Jul 28 20:15:25.545776 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:25.545739    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxsc5\" (UniqueName: \"kubernetes.io/projected/15ee5317-804b-4c24-881b-4cca0d61c599-kube-api-access-rxsc5\") pod \"15ee5317-804b-4c24-881b-4cca0d61c599\" (UID: \"15ee5317-804b-4c24-881b-4cca0d61c599\") "
Jul 28 20:15:25.545776 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:25.545773    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61a599ea-33a9-40bc-a15f-935adefb6806-plugins-config-volume\") pod \"61a599ea-33a9-40bc-a15f-935adefb6806\" (UID: \"61a599ea-33a9-40bc-a15f-935adefb6806\") "
Jul 28 20:15:25.546022 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:25.545795    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15ee5317-804b-4c24-881b-4cca0d61c599-plugins-config-volume\") pod \"15ee5317-804b-4c24-881b-4cca0d61c599\" (UID: \"15ee5317-804b-4c24-881b-4cca0d61c599\") "
Jul 28 20:15:25.546022 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:25.545856    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wztt\" (UniqueName: \"kubernetes.io/projected/61a599ea-33a9-40bc-a15f-935adefb6806-kube-api-access-5wztt\") pod \"61a599ea-33a9-40bc-a15f-935adefb6806\" (UID: \"61a599ea-33a9-40bc-a15f-935adefb6806\") "
Jul 28 20:15:25.546239 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:25.546214    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15ee5317-804b-4c24-881b-4cca0d61c599-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "15ee5317-804b-4c24-881b-4cca0d61c599" (UID: "15ee5317-804b-4c24-881b-4cca0d61c599"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:15:25.546331 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:25.546311    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61a599ea-33a9-40bc-a15f-935adefb6806-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "61a599ea-33a9-40bc-a15f-935adefb6806" (UID: "61a599ea-33a9-40bc-a15f-935adefb6806"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:15:25.548053 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:25.548026    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61a599ea-33a9-40bc-a15f-935adefb6806-kube-api-access-5wztt" (OuterVolumeSpecName: "kube-api-access-5wztt") pod "61a599ea-33a9-40bc-a15f-935adefb6806" (UID: "61a599ea-33a9-40bc-a15f-935adefb6806"). InnerVolumeSpecName "kube-api-access-5wztt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:15:25.548149 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:25.548120    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15ee5317-804b-4c24-881b-4cca0d61c599-kube-api-access-rxsc5" (OuterVolumeSpecName: "kube-api-access-rxsc5") pod "15ee5317-804b-4c24-881b-4cca0d61c599" (UID: "15ee5317-804b-4c24-881b-4cca0d61c599"). InnerVolumeSpecName "kube-api-access-rxsc5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:15:25.647470 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:25.647434    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxsc5\" (UniqueName: \"kubernetes.io/projected/15ee5317-804b-4c24-881b-4cca0d61c599-kube-api-access-rxsc5\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:15:25.647470 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:25.647462    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61a599ea-33a9-40bc-a15f-935adefb6806-plugins-config-volume\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:15:25.647470 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:25.647474    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15ee5317-804b-4c24-881b-4cca0d61c599-plugins-config-volume\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:15:25.647697 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:25.647482    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wztt\" (UniqueName: \"kubernetes.io/projected/61a599ea-33a9-40bc-a15f-935adefb6806-kube-api-access-5wztt\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:15:25.944650 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:25.944613    2570 generic.go:356] "Generic (PLEG): container finished" podID="15ee5317-804b-4c24-881b-4cca0d61c599" containerID="3fff7de5fbc552013fffb072cfc9cf97a3d5a9d290d0c6d462e50870bf906518" exitCode=0
Jul 28 20:15:25.944831 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:25.944657    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0180d1-78c66f9c9b-6fqbc"
Jul 28 20:15:25.944831 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:25.944703    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0180d1-78c66f9c9b-6fqbc" event={"ID":"15ee5317-804b-4c24-881b-4cca0d61c599","Type":"ContainerDied","Data":"3fff7de5fbc552013fffb072cfc9cf97a3d5a9d290d0c6d462e50870bf906518"}
Jul 28 20:15:25.944831 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:25.944750    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0180d1-78c66f9c9b-6fqbc" event={"ID":"15ee5317-804b-4c24-881b-4cca0d61c599","Type":"ContainerDied","Data":"ce43fae704dfd56560bb7dae8c7ea512178cd35d0b3364157540bf7441eb1ad7"}
Jul 28 20:15:25.944831 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:25.944772    2570 scope.go:117] "RemoveContainer" containerID="3fff7de5fbc552013fffb072cfc9cf97a3d5a9d290d0c6d462e50870bf906518"
Jul 28 20:15:25.946045 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:25.946019    2570 generic.go:356] "Generic (PLEG): container finished" podID="61a599ea-33a9-40bc-a15f-935adefb6806" containerID="bf729803c8ad5199fbd75ca6a9bfe7f7c5e426d8d71493da52062cdd0bed6241" exitCode=0
Jul 28 20:15:25.946155 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:25.946050    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-0180d1-798b67bd76-btdlv"
Jul 28 20:15:25.946155 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:25.946085    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-0180d1-798b67bd76-btdlv" event={"ID":"61a599ea-33a9-40bc-a15f-935adefb6806","Type":"ContainerDied","Data":"bf729803c8ad5199fbd75ca6a9bfe7f7c5e426d8d71493da52062cdd0bed6241"}
Jul 28 20:15:25.946155 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:25.946128    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-0180d1-798b67bd76-btdlv" event={"ID":"61a599ea-33a9-40bc-a15f-935adefb6806","Type":"ContainerDied","Data":"3fb7d4884275d780f3b47aff2f4ae8b3a84afeefb7c5e750c08e73aca3970475"}
Jul 28 20:15:25.953550 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:25.953530    2570 scope.go:117] "RemoveContainer" containerID="3fff7de5fbc552013fffb072cfc9cf97a3d5a9d290d0c6d462e50870bf906518"
Jul 28 20:15:25.953832 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:15:25.953814    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fff7de5fbc552013fffb072cfc9cf97a3d5a9d290d0c6d462e50870bf906518\": container with ID starting with 3fff7de5fbc552013fffb072cfc9cf97a3d5a9d290d0c6d462e50870bf906518 not found: ID does not exist" containerID="3fff7de5fbc552013fffb072cfc9cf97a3d5a9d290d0c6d462e50870bf906518"
Jul 28 20:15:25.953896 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:25.953840    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fff7de5fbc552013fffb072cfc9cf97a3d5a9d290d0c6d462e50870bf906518"} err="failed to get container status \"3fff7de5fbc552013fffb072cfc9cf97a3d5a9d290d0c6d462e50870bf906518\": rpc error: code = NotFound desc = could not find container \"3fff7de5fbc552013fffb072cfc9cf97a3d5a9d290d0c6d462e50870bf906518\": container with ID starting with 3fff7de5fbc552013fffb072cfc9cf97a3d5a9d290d0c6d462e50870bf906518 not found: ID does not exist"
Jul 28 20:15:25.953896 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:25.953856    2570 scope.go:117] "RemoveContainer" containerID="bf729803c8ad5199fbd75ca6a9bfe7f7c5e426d8d71493da52062cdd0bed6241"
Jul 28 20:15:25.961633 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:25.961612    2570 scope.go:117] "RemoveContainer" containerID="bf729803c8ad5199fbd75ca6a9bfe7f7c5e426d8d71493da52062cdd0bed6241"
Jul 28 20:15:25.962094 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:15:25.962065    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf729803c8ad5199fbd75ca6a9bfe7f7c5e426d8d71493da52062cdd0bed6241\": container with ID starting with bf729803c8ad5199fbd75ca6a9bfe7f7c5e426d8d71493da52062cdd0bed6241 not found: ID does not exist" containerID="bf729803c8ad5199fbd75ca6a9bfe7f7c5e426d8d71493da52062cdd0bed6241"
Jul 28 20:15:25.962189 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:25.962100    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf729803c8ad5199fbd75ca6a9bfe7f7c5e426d8d71493da52062cdd0bed6241"} err="failed to get container status \"bf729803c8ad5199fbd75ca6a9bfe7f7c5e426d8d71493da52062cdd0bed6241\": rpc error: code = NotFound desc = could not find container \"bf729803c8ad5199fbd75ca6a9bfe7f7c5e426d8d71493da52062cdd0bed6241\": container with ID starting with bf729803c8ad5199fbd75ca6a9bfe7f7c5e426d8d71493da52062cdd0bed6241 not found: ID does not exist"
Jul 28 20:15:25.963620 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:25.963601    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0180d1-798b67bd76-btdlv"]
Jul 28 20:15:25.967914 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:25.967889    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0180d1-798b67bd76-btdlv"]
Jul 28 20:15:25.978535 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:25.978508    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-0180d1-78c66f9c9b-6fqbc"]
Jul 28 20:15:25.982576 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:25.982553    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-0180d1-78c66f9c9b-6fqbc"]
Jul 28 20:15:27.572445 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:27.572408    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15ee5317-804b-4c24-881b-4cca0d61c599" path="/var/lib/kubelet/pods/15ee5317-804b-4c24-881b-4cca0d61c599/volumes"
Jul 28 20:15:27.572832 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:27.572741    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61a599ea-33a9-40bc-a15f-935adefb6806" path="/var/lib/kubelet/pods/61a599ea-33a9-40bc-a15f-935adefb6806/volumes"
Jul 28 20:15:31.762288 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:31.762250    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"]
Jul 28 20:15:31.762872 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:31.762497    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq" podUID="7d25cb68-3cd5-47c3-9105-577fcb76881b" containerName="istio-proxy" containerID="cri-o://3b8693765b948ca8badc011dfbd361685d3db5b982ca4967f70b7db872cb30b6" gracePeriod=30
Jul 28 20:15:36.999991 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:36.999934    2570 generic.go:356] "Generic (PLEG): container finished" podID="7d25cb68-3cd5-47c3-9105-577fcb76881b" containerID="3b8693765b948ca8badc011dfbd361685d3db5b982ca4967f70b7db872cb30b6" exitCode=0
Jul 28 20:15:37.000386 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:36.999998    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq" event={"ID":"7d25cb68-3cd5-47c3-9105-577fcb76881b","Type":"ContainerDied","Data":"3b8693765b948ca8badc011dfbd361685d3db5b982ca4967f70b7db872cb30b6"}
Jul 28 20:15:37.000386 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:37.000058    2570 scope.go:117] "RemoveContainer" containerID="07980d693ea104b54fbebffb67e01001ab3113f8f0167d54e94d74a16f64532b"
Jul 28 20:15:37.018311 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:15:37.018283    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07980d693ea104b54fbebffb67e01001ab3113f8f0167d54e94d74a16f64532b\": container with ID starting with 07980d693ea104b54fbebffb67e01001ab3113f8f0167d54e94d74a16f64532b not found: ID does not exist" containerID="07980d693ea104b54fbebffb67e01001ab3113f8f0167d54e94d74a16f64532b"
Jul 28 20:15:37.019799 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:37.019780    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:15:37.159763 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:37.159668    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d25cb68-3cd5-47c3-9105-577fcb76881b-workload-certs\") pod \"7d25cb68-3cd5-47c3-9105-577fcb76881b\" (UID: \"7d25cb68-3cd5-47c3-9105-577fcb76881b\") "
Jul 28 20:15:37.159763 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:37.159706    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d25cb68-3cd5-47c3-9105-577fcb76881b-credential-socket\") pod \"7d25cb68-3cd5-47c3-9105-577fcb76881b\" (UID: \"7d25cb68-3cd5-47c3-9105-577fcb76881b\") "
Jul 28 20:15:37.159763 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:37.159742    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d25cb68-3cd5-47c3-9105-577fcb76881b-istio-envoy\") pod \"7d25cb68-3cd5-47c3-9105-577fcb76881b\" (UID: \"7d25cb68-3cd5-47c3-9105-577fcb76881b\") "
Jul 28 20:15:37.159763 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:37.159757    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d25cb68-3cd5-47c3-9105-577fcb76881b-workload-socket\") pod \"7d25cb68-3cd5-47c3-9105-577fcb76881b\" (UID: \"7d25cb68-3cd5-47c3-9105-577fcb76881b\") "
Jul 28 20:15:37.160148 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:37.159775    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzjlx\" (UniqueName: \"kubernetes.io/projected/7d25cb68-3cd5-47c3-9105-577fcb76881b-kube-api-access-jzjlx\") pod \"7d25cb68-3cd5-47c3-9105-577fcb76881b\" (UID: \"7d25cb68-3cd5-47c3-9105-577fcb76881b\") "
Jul 28 20:15:37.160148 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:37.159822    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d25cb68-3cd5-47c3-9105-577fcb76881b-istio-token\") pod \"7d25cb68-3cd5-47c3-9105-577fcb76881b\" (UID: \"7d25cb68-3cd5-47c3-9105-577fcb76881b\") "
Jul 28 20:15:37.160148 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:37.159839    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d25cb68-3cd5-47c3-9105-577fcb76881b-istio-podinfo\") pod \"7d25cb68-3cd5-47c3-9105-577fcb76881b\" (UID: \"7d25cb68-3cd5-47c3-9105-577fcb76881b\") "
Jul 28 20:15:37.160148 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:37.159895    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d25cb68-3cd5-47c3-9105-577fcb76881b-istiod-ca-cert\") pod \"7d25cb68-3cd5-47c3-9105-577fcb76881b\" (UID: \"7d25cb68-3cd5-47c3-9105-577fcb76881b\") "
Jul 28 20:15:37.160148 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:37.159917    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d25cb68-3cd5-47c3-9105-577fcb76881b-istio-data\") pod \"7d25cb68-3cd5-47c3-9105-577fcb76881b\" (UID: \"7d25cb68-3cd5-47c3-9105-577fcb76881b\") "
Jul 28 20:15:37.160148 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:37.160053    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d25cb68-3cd5-47c3-9105-577fcb76881b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7d25cb68-3cd5-47c3-9105-577fcb76881b" (UID: "7d25cb68-3cd5-47c3-9105-577fcb76881b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:15:37.160148 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:37.160111    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d25cb68-3cd5-47c3-9105-577fcb76881b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7d25cb68-3cd5-47c3-9105-577fcb76881b" (UID: "7d25cb68-3cd5-47c3-9105-577fcb76881b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:15:37.160148 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:37.160124    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d25cb68-3cd5-47c3-9105-577fcb76881b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7d25cb68-3cd5-47c3-9105-577fcb76881b" (UID: "7d25cb68-3cd5-47c3-9105-577fcb76881b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:15:37.160534 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:37.160258    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d25cb68-3cd5-47c3-9105-577fcb76881b-workload-socket\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:15:37.160534 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:37.160272    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d25cb68-3cd5-47c3-9105-577fcb76881b-workload-certs\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:15:37.160534 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:37.160282    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d25cb68-3cd5-47c3-9105-577fcb76881b-credential-socket\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:15:37.160534 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:37.160424    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d25cb68-3cd5-47c3-9105-577fcb76881b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7d25cb68-3cd5-47c3-9105-577fcb76881b" (UID: "7d25cb68-3cd5-47c3-9105-577fcb76881b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:15:37.161159 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:37.161135    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d25cb68-3cd5-47c3-9105-577fcb76881b-istio-data" (OuterVolumeSpecName: "istio-data") pod "7d25cb68-3cd5-47c3-9105-577fcb76881b" (UID: "7d25cb68-3cd5-47c3-9105-577fcb76881b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:15:37.162223 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:37.162188    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d25cb68-3cd5-47c3-9105-577fcb76881b-istio-token" (OuterVolumeSpecName: "istio-token") pod "7d25cb68-3cd5-47c3-9105-577fcb76881b" (UID: "7d25cb68-3cd5-47c3-9105-577fcb76881b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:15:37.162332 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:37.162230    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d25cb68-3cd5-47c3-9105-577fcb76881b-kube-api-access-jzjlx" (OuterVolumeSpecName: "kube-api-access-jzjlx") pod "7d25cb68-3cd5-47c3-9105-577fcb76881b" (UID: "7d25cb68-3cd5-47c3-9105-577fcb76881b"). InnerVolumeSpecName "kube-api-access-jzjlx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:15:37.162479 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:37.162438    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d25cb68-3cd5-47c3-9105-577fcb76881b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7d25cb68-3cd5-47c3-9105-577fcb76881b" (UID: "7d25cb68-3cd5-47c3-9105-577fcb76881b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:15:37.162593 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:37.162502    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7d25cb68-3cd5-47c3-9105-577fcb76881b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7d25cb68-3cd5-47c3-9105-577fcb76881b" (UID: "7d25cb68-3cd5-47c3-9105-577fcb76881b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:15:37.261342 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:37.261308    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d25cb68-3cd5-47c3-9105-577fcb76881b-istio-token\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:15:37.261342 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:37.261338    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d25cb68-3cd5-47c3-9105-577fcb76881b-istio-podinfo\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:15:37.261342 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:37.261347    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d25cb68-3cd5-47c3-9105-577fcb76881b-istiod-ca-cert\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:15:37.261585 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:37.261356    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d25cb68-3cd5-47c3-9105-577fcb76881b-istio-data\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:15:37.261585 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:37.261364    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d25cb68-3cd5-47c3-9105-577fcb76881b-istio-envoy\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:15:37.261585 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:37.261384    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzjlx\" (UniqueName: \"kubernetes.io/projected/7d25cb68-3cd5-47c3-9105-577fcb76881b-kube-api-access-jzjlx\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:15:38.005593 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:38.005561    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"
Jul 28 20:15:38.005593 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:38.005576    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq" event={"ID":"7d25cb68-3cd5-47c3-9105-577fcb76881b","Type":"ContainerDied","Data":"6ac423c94628362a02361552e979ea265c6aed264543d697ae440f8403f4199a"}
Jul 28 20:15:38.006158 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:38.005635    2570 scope.go:117] "RemoveContainer" containerID="3b8693765b948ca8badc011dfbd361685d3db5b982ca4967f70b7db872cb30b6"
Jul 28 20:15:38.027194 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:38.027162    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"]
Jul 28 20:15:38.031161 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:38.031139    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-0180d1-openshift-default-99df4544d-sfplq"]
Jul 28 20:15:39.572222 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:39.572187    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d25cb68-3cd5-47c3-9105-577fcb76881b" path="/var/lib/kubelet/pods/7d25cb68-3cd5-47c3-9105-577fcb76881b/volumes"
Jul 28 20:15:47.664896 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:47.664860    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-86e5cf-669cc79668-prrtr"]
Jul 28 20:15:47.665445 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:47.665161    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-86e5cf-669cc79668-prrtr" podUID="f6805846-1101-46f8-920f-966a8202ae73" containerName="payload-processing" containerID="cri-o://350d5542c454bbdffc69d70a799d77353f71a11a058ed17d243b3a49d7acd1b4" gracePeriod=30
Jul 28 20:15:47.673261 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:47.672958    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-86e5cf-65d48d4d4-xsdbh"]
Jul 28 20:15:47.673524 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:47.673485    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-86e5cf-65d48d4d4-xsdbh" podUID="f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1" containerName="payload-pre-processing" containerID="cri-o://7b8ec05704d14a79283838088c71c0fe1090fa5d1c52d04aa4f0638dca22bdcc" gracePeriod=30
Jul 28 20:15:47.970077 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:47.970056    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-86e5cf-669cc79668-prrtr"
Jul 28 20:15:47.979876 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:47.979854    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-86e5cf-65d48d4d4-xsdbh"
Jul 28 20:15:48.051611 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:48.051577    2570 generic.go:356] "Generic (PLEG): container finished" podID="f6805846-1101-46f8-920f-966a8202ae73" containerID="350d5542c454bbdffc69d70a799d77353f71a11a058ed17d243b3a49d7acd1b4" exitCode=0
Jul 28 20:15:48.051802 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:48.051619    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-86e5cf-669cc79668-prrtr"
Jul 28 20:15:48.051802 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:48.051657    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-86e5cf-669cc79668-prrtr" event={"ID":"f6805846-1101-46f8-920f-966a8202ae73","Type":"ContainerDied","Data":"350d5542c454bbdffc69d70a799d77353f71a11a058ed17d243b3a49d7acd1b4"}
Jul 28 20:15:48.051802 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:48.051709    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-86e5cf-669cc79668-prrtr" event={"ID":"f6805846-1101-46f8-920f-966a8202ae73","Type":"ContainerDied","Data":"0dc6aa636259257cd096f2e88d9e6b90851a56fbe3add9aa0676265cc1a088f1"}
Jul 28 20:15:48.051802 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:48.051740    2570 scope.go:117] "RemoveContainer" containerID="350d5542c454bbdffc69d70a799d77353f71a11a058ed17d243b3a49d7acd1b4"
Jul 28 20:15:48.052936 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:48.052914    2570 generic.go:356] "Generic (PLEG): container finished" podID="f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1" containerID="7b8ec05704d14a79283838088c71c0fe1090fa5d1c52d04aa4f0638dca22bdcc" exitCode=0
Jul 28 20:15:48.053065 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:48.053004    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-86e5cf-65d48d4d4-xsdbh"
Jul 28 20:15:48.053065 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:48.053009    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-86e5cf-65d48d4d4-xsdbh" event={"ID":"f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1","Type":"ContainerDied","Data":"7b8ec05704d14a79283838088c71c0fe1090fa5d1c52d04aa4f0638dca22bdcc"}
Jul 28 20:15:48.053065 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:48.053055    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-86e5cf-65d48d4d4-xsdbh" event={"ID":"f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1","Type":"ContainerDied","Data":"07af4c56385f865ccb09f7c13ada99039844304ad76a9bd05e52130f81f27e37"}
Jul 28 20:15:48.059817 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:48.059801    2570 scope.go:117] "RemoveContainer" containerID="350d5542c454bbdffc69d70a799d77353f71a11a058ed17d243b3a49d7acd1b4"
Jul 28 20:15:48.060100 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:15:48.060068    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"350d5542c454bbdffc69d70a799d77353f71a11a058ed17d243b3a49d7acd1b4\": container with ID starting with 350d5542c454bbdffc69d70a799d77353f71a11a058ed17d243b3a49d7acd1b4 not found: ID does not exist" containerID="350d5542c454bbdffc69d70a799d77353f71a11a058ed17d243b3a49d7acd1b4"
Jul 28 20:15:48.060167 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:48.060112    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"350d5542c454bbdffc69d70a799d77353f71a11a058ed17d243b3a49d7acd1b4"} err="failed to get container status \"350d5542c454bbdffc69d70a799d77353f71a11a058ed17d243b3a49d7acd1b4\": rpc error: code = NotFound desc = could not find container \"350d5542c454bbdffc69d70a799d77353f71a11a058ed17d243b3a49d7acd1b4\": container with ID starting with 350d5542c454bbdffc69d70a799d77353f71a11a058ed17d243b3a49d7acd1b4 not found: ID does not exist"
Jul 28 20:15:48.060167 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:48.060137    2570 scope.go:117] "RemoveContainer" containerID="7b8ec05704d14a79283838088c71c0fe1090fa5d1c52d04aa4f0638dca22bdcc"
Jul 28 20:15:48.062232 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:48.062211    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6805846-1101-46f8-920f-966a8202ae73-plugins-config-volume\") pod \"f6805846-1101-46f8-920f-966a8202ae73\" (UID: \"f6805846-1101-46f8-920f-966a8202ae73\") "
Jul 28 20:15:48.062346 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:48.062267    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9g6hw\" (UniqueName: \"kubernetes.io/projected/f6805846-1101-46f8-920f-966a8202ae73-kube-api-access-9g6hw\") pod \"f6805846-1101-46f8-920f-966a8202ae73\" (UID: \"f6805846-1101-46f8-920f-966a8202ae73\") "
Jul 28 20:15:48.062575 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:48.062549    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6805846-1101-46f8-920f-966a8202ae73-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f6805846-1101-46f8-920f-966a8202ae73" (UID: "f6805846-1101-46f8-920f-966a8202ae73"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:15:48.064219 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:48.064192    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6805846-1101-46f8-920f-966a8202ae73-kube-api-access-9g6hw" (OuterVolumeSpecName: "kube-api-access-9g6hw") pod "f6805846-1101-46f8-920f-966a8202ae73" (UID: "f6805846-1101-46f8-920f-966a8202ae73"). InnerVolumeSpecName "kube-api-access-9g6hw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:15:48.068013 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:48.067994    2570 scope.go:117] "RemoveContainer" containerID="7b8ec05704d14a79283838088c71c0fe1090fa5d1c52d04aa4f0638dca22bdcc"
Jul 28 20:15:48.068274 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:15:48.068258    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b8ec05704d14a79283838088c71c0fe1090fa5d1c52d04aa4f0638dca22bdcc\": container with ID starting with 7b8ec05704d14a79283838088c71c0fe1090fa5d1c52d04aa4f0638dca22bdcc not found: ID does not exist" containerID="7b8ec05704d14a79283838088c71c0fe1090fa5d1c52d04aa4f0638dca22bdcc"
Jul 28 20:15:48.068336 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:48.068281    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b8ec05704d14a79283838088c71c0fe1090fa5d1c52d04aa4f0638dca22bdcc"} err="failed to get container status \"7b8ec05704d14a79283838088c71c0fe1090fa5d1c52d04aa4f0638dca22bdcc\": rpc error: code = NotFound desc = could not find container \"7b8ec05704d14a79283838088c71c0fe1090fa5d1c52d04aa4f0638dca22bdcc\": container with ID starting with 7b8ec05704d14a79283838088c71c0fe1090fa5d1c52d04aa4f0638dca22bdcc not found: ID does not exist"
Jul 28 20:15:48.163791 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:48.163760    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmk9k\" (UniqueName: \"kubernetes.io/projected/f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1-kube-api-access-cmk9k\") pod \"f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1\" (UID: \"f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1\") "
Jul 28 20:15:48.163962 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:48.163812    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1-plugins-config-volume\") pod \"f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1\" (UID: \"f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1\") "
Jul 28 20:15:48.164036 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:48.164000    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6805846-1101-46f8-920f-966a8202ae73-plugins-config-volume\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:15:48.164036 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:48.164012    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9g6hw\" (UniqueName: \"kubernetes.io/projected/f6805846-1101-46f8-920f-966a8202ae73-kube-api-access-9g6hw\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:15:48.164247 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:48.164225    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1" (UID: "f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:15:48.165853 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:48.165833    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1-kube-api-access-cmk9k" (OuterVolumeSpecName: "kube-api-access-cmk9k") pod "f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1" (UID: "f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1"). InnerVolumeSpecName "kube-api-access-cmk9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:15:48.265451 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:48.265360    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1-plugins-config-volume\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:15:48.265451 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:48.265393    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmk9k\" (UniqueName: \"kubernetes.io/projected/f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1-kube-api-access-cmk9k\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:15:48.376769 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:48.376739    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-86e5cf-65d48d4d4-xsdbh"]
Jul 28 20:15:48.380199 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:48.380172    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-86e5cf-65d48d4d4-xsdbh"]
Jul 28 20:15:48.390325 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:48.390298    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-86e5cf-669cc79668-prrtr"]
Jul 28 20:15:48.393666 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:48.393642    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-86e5cf-669cc79668-prrtr"]
Jul 28 20:15:49.573064 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:49.573036    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1" path="/var/lib/kubelet/pods/f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1/volumes"
Jul 28 20:15:49.573446 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:49.573380    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6805846-1101-46f8-920f-966a8202ae73" path="/var/lib/kubelet/pods/f6805846-1101-46f8-920f-966a8202ae73/volumes"
Jul 28 20:15:54.175246 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:54.175209    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"]
Jul 28 20:15:54.175667 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:54.175473    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9" podUID="6bc27a13-c02b-4d96-92dc-8f160ca48d28" containerName="istio-proxy" containerID="cri-o://241d7d448bc7bfe88b587a773708cb9b28886f0c1aca21ce6d8d300dcdd57be4" gracePeriod=30
Jul 28 20:15:55.041467 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.041430    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"]
Jul 28 20:15:55.042059 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.042036    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6805846-1101-46f8-920f-966a8202ae73" containerName="payload-processing"
Jul 28 20:15:55.042059 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.042059    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6805846-1101-46f8-920f-966a8202ae73" containerName="payload-processing"
Jul 28 20:15:55.042247 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.042072    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1" containerName="payload-pre-processing"
Jul 28 20:15:55.042247 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.042081    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1" containerName="payload-pre-processing"
Jul 28 20:15:55.042247 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.042092    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15ee5317-804b-4c24-881b-4cca0d61c599" containerName="payload-pre-processing"
Jul 28 20:15:55.042247 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.042100    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="15ee5317-804b-4c24-881b-4cca0d61c599" containerName="payload-pre-processing"
Jul 28 20:15:55.042247 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.042122    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61a599ea-33a9-40bc-a15f-935adefb6806" containerName="payload-processing"
Jul 28 20:15:55.042247 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.042129    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="61a599ea-33a9-40bc-a15f-935adefb6806" containerName="payload-processing"
Jul 28 20:15:55.042247 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.042139    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d25cb68-3cd5-47c3-9105-577fcb76881b" containerName="istio-proxy"
Jul 28 20:15:55.042247 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.042147    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d25cb68-3cd5-47c3-9105-577fcb76881b" containerName="istio-proxy"
Jul 28 20:15:55.042247 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.042159    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d25cb68-3cd5-47c3-9105-577fcb76881b" containerName="istio-proxy"
Jul 28 20:15:55.042247 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.042167    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d25cb68-3cd5-47c3-9105-577fcb76881b" containerName="istio-proxy"
Jul 28 20:15:55.042742 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.042255    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="61a599ea-33a9-40bc-a15f-935adefb6806" containerName="payload-processing"
Jul 28 20:15:55.042742 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.042271    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0cd3e5b-4ad7-4db8-aa3f-d14aae4a2ce1" containerName="payload-pre-processing"
Jul 28 20:15:55.042742 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.042285    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d25cb68-3cd5-47c3-9105-577fcb76881b" containerName="istio-proxy"
Jul 28 20:15:55.042742 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.042294    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d25cb68-3cd5-47c3-9105-577fcb76881b" containerName="istio-proxy"
Jul 28 20:15:55.042742 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.042304    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="15ee5317-804b-4c24-881b-4cca0d61c599" containerName="payload-pre-processing"
Jul 28 20:15:55.042742 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.042314    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6805846-1101-46f8-920f-966a8202ae73" containerName="payload-processing"
Jul 28 20:15:55.045899 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.045871    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:15:55.048688 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.048668    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-c38c57-openshift-default-dockercfg-kz5ts\""
Jul 28 20:15:55.064064 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.064039    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"]
Jul 28 20:15:55.125199 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.125161    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b27b3710-1720-4ab8-a0a7-26bea05c6972-workload-certs\") pod \"e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7\" (UID: \"b27b3710-1720-4ab8-a0a7-26bea05c6972\") " pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:15:55.125199 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.125195    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b27b3710-1720-4ab8-a0a7-26bea05c6972-istio-data\") pod \"e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7\" (UID: \"b27b3710-1720-4ab8-a0a7-26bea05c6972\") " pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:15:55.125443 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.125259    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b27b3710-1720-4ab8-a0a7-26bea05c6972-istio-token\") pod \"e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7\" (UID: \"b27b3710-1720-4ab8-a0a7-26bea05c6972\") " pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:15:55.125443 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.125306    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b27b3710-1720-4ab8-a0a7-26bea05c6972-istio-podinfo\") pod \"e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7\" (UID: \"b27b3710-1720-4ab8-a0a7-26bea05c6972\") " pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:15:55.125443 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.125337    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prhzp\" (UniqueName: \"kubernetes.io/projected/b27b3710-1720-4ab8-a0a7-26bea05c6972-kube-api-access-prhzp\") pod \"e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7\" (UID: \"b27b3710-1720-4ab8-a0a7-26bea05c6972\") " pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:15:55.125443 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.125420    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b27b3710-1720-4ab8-a0a7-26bea05c6972-istio-envoy\") pod \"e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7\" (UID: \"b27b3710-1720-4ab8-a0a7-26bea05c6972\") " pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:15:55.125579 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.125450    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b27b3710-1720-4ab8-a0a7-26bea05c6972-istiod-ca-cert\") pod \"e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7\" (UID: \"b27b3710-1720-4ab8-a0a7-26bea05c6972\") " pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:15:55.125579 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.125497    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b27b3710-1720-4ab8-a0a7-26bea05c6972-credential-socket\") pod \"e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7\" (UID: \"b27b3710-1720-4ab8-a0a7-26bea05c6972\") " pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:15:55.125579 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.125525    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b27b3710-1720-4ab8-a0a7-26bea05c6972-workload-socket\") pod \"e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7\" (UID: \"b27b3710-1720-4ab8-a0a7-26bea05c6972\") " pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:15:55.226357 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.226321    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b27b3710-1720-4ab8-a0a7-26bea05c6972-credential-socket\") pod \"e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7\" (UID: \"b27b3710-1720-4ab8-a0a7-26bea05c6972\") " pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:15:55.226866 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.226368    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b27b3710-1720-4ab8-a0a7-26bea05c6972-workload-socket\") pod \"e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7\" (UID: \"b27b3710-1720-4ab8-a0a7-26bea05c6972\") " pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:15:55.226866 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.226394    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b27b3710-1720-4ab8-a0a7-26bea05c6972-workload-certs\") pod \"e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7\" (UID: \"b27b3710-1720-4ab8-a0a7-26bea05c6972\") " pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:15:55.226866 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.226411    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b27b3710-1720-4ab8-a0a7-26bea05c6972-istio-data\") pod \"e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7\" (UID: \"b27b3710-1720-4ab8-a0a7-26bea05c6972\") " pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:15:55.226866 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.226444    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b27b3710-1720-4ab8-a0a7-26bea05c6972-istio-token\") pod \"e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7\" (UID: \"b27b3710-1720-4ab8-a0a7-26bea05c6972\") " pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:15:55.226866 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.226466    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b27b3710-1720-4ab8-a0a7-26bea05c6972-istio-podinfo\") pod \"e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7\" (UID: \"b27b3710-1720-4ab8-a0a7-26bea05c6972\") " pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:15:55.226866 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.226493    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prhzp\" (UniqueName: \"kubernetes.io/projected/b27b3710-1720-4ab8-a0a7-26bea05c6972-kube-api-access-prhzp\") pod \"e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7\" (UID: \"b27b3710-1720-4ab8-a0a7-26bea05c6972\") " pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:15:55.226866 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.226537    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b27b3710-1720-4ab8-a0a7-26bea05c6972-istio-envoy\") pod \"e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7\" (UID: \"b27b3710-1720-4ab8-a0a7-26bea05c6972\") " pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:15:55.226866 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.226563    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b27b3710-1720-4ab8-a0a7-26bea05c6972-istiod-ca-cert\") pod \"e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7\" (UID: \"b27b3710-1720-4ab8-a0a7-26bea05c6972\") " pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:15:55.226866 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.226760    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b27b3710-1720-4ab8-a0a7-26bea05c6972-credential-socket\") pod \"e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7\" (UID: \"b27b3710-1720-4ab8-a0a7-26bea05c6972\") " pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:15:55.227302 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.226920    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b27b3710-1720-4ab8-a0a7-26bea05c6972-istio-data\") pod \"e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7\" (UID: \"b27b3710-1720-4ab8-a0a7-26bea05c6972\") " pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:15:55.227302 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.226951    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b27b3710-1720-4ab8-a0a7-26bea05c6972-workload-certs\") pod \"e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7\" (UID: \"b27b3710-1720-4ab8-a0a7-26bea05c6972\") " pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:15:55.227302 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.227043    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b27b3710-1720-4ab8-a0a7-26bea05c6972-workload-socket\") pod \"e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7\" (UID: \"b27b3710-1720-4ab8-a0a7-26bea05c6972\") " pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:15:55.227302 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.227257    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b27b3710-1720-4ab8-a0a7-26bea05c6972-istiod-ca-cert\") pod \"e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7\" (UID: \"b27b3710-1720-4ab8-a0a7-26bea05c6972\") " pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:15:55.228814 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.228784    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b27b3710-1720-4ab8-a0a7-26bea05c6972-istio-envoy\") pod \"e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7\" (UID: \"b27b3710-1720-4ab8-a0a7-26bea05c6972\") " pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:15:55.229114 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.229094    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b27b3710-1720-4ab8-a0a7-26bea05c6972-istio-podinfo\") pod \"e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7\" (UID: \"b27b3710-1720-4ab8-a0a7-26bea05c6972\") " pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:15:55.236081 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.236056    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b27b3710-1720-4ab8-a0a7-26bea05c6972-istio-token\") pod \"e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7\" (UID: \"b27b3710-1720-4ab8-a0a7-26bea05c6972\") " pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:15:55.236259 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.236236    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prhzp\" (UniqueName: \"kubernetes.io/projected/b27b3710-1720-4ab8-a0a7-26bea05c6972-kube-api-access-prhzp\") pod \"e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7\" (UID: \"b27b3710-1720-4ab8-a0a7-26bea05c6972\") " pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:15:55.357075 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.356961    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:15:55.493707 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.493681    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"]
Jul 28 20:15:55.496200 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:15:55.496175    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb27b3710_1720_4ab8_a0a7_26bea05c6972.slice/crio-4ae769a1b47b94e0d1fde91af31022944fd1a4a0b1e9a1caf2d5ad125e2a2ea6 WatchSource:0}: Error finding container 4ae769a1b47b94e0d1fde91af31022944fd1a4a0b1e9a1caf2d5ad125e2a2ea6: Status 404 returned error can't find the container with id 4ae769a1b47b94e0d1fde91af31022944fd1a4a0b1e9a1caf2d5ad125e2a2ea6
Jul 28 20:15:55.498753 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.498724    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:15:55.498819 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.498788    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:15:55.498819 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:55.498813    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:15:56.092859 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:56.092816    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7" event={"ID":"b27b3710-1720-4ab8-a0a7-26bea05c6972","Type":"ContainerStarted","Data":"d3313f2eb27323034b5d8234a8c14fabe2325c4c315e78ae7cf8460ec83cb917"}
Jul 28 20:15:56.093056 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:56.092901    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7" event={"ID":"b27b3710-1720-4ab8-a0a7-26bea05c6972","Type":"ContainerStarted","Data":"4ae769a1b47b94e0d1fde91af31022944fd1a4a0b1e9a1caf2d5ad125e2a2ea6"}
Jul 28 20:15:56.113561 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:56.113508    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7" podStartSLOduration=1.113491967 podStartE2EDuration="1.113491967s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:15:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:15:56.111702388 +0000 UTC m=+2769.063734717" watchObservedRunningTime="2026-07-28 20:15:56.113491967 +0000 UTC m=+2769.065524297"
Jul 28 20:15:56.357881 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:56.357791    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:15:56.362836 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:56.362814    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:15:57.097612 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:57.097579    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:15:57.098727 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:57.098702    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:15:58.684766 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:58.684731    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-c38c57-54f4b5977b-kzjkx"]
Jul 28 20:15:58.687176 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:58.687158    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-c38c57-54f4b5977b-kzjkx"
Jul 28 20:15:58.691809 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:58.691786    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-c38c57-dockercfg-sprr9\""
Jul 28 20:15:58.692069 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:58.692055    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-c38c57\""
Jul 28 20:15:58.702583 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:58.702561    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-c38c57-54f4b5977b-kzjkx"]
Jul 28 20:15:58.704817 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:58.704790    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-c38c57-75dcc74898-mplzc"]
Jul 28 20:15:58.707101 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:58.707084    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-c38c57-75dcc74898-mplzc"
Jul 28 20:15:58.720452 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:58.720429    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-c38c57-75dcc74898-mplzc"]
Jul 28 20:15:58.759469 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:58.759436    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44nxn\" (UniqueName: \"kubernetes.io/projected/750356bc-f340-4133-b423-9d37eaa18e68-kube-api-access-44nxn\") pod \"payload-pre-processing-e2e-shared-a-c38c57-54f4b5977b-kzjkx\" (UID: \"750356bc-f340-4133-b423-9d37eaa18e68\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-c38c57-54f4b5977b-kzjkx"
Jul 28 20:15:58.759616 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:58.759494    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg862\" (UniqueName: \"kubernetes.io/projected/80108b11-28c4-4c47-b13e-79cb732806ad-kube-api-access-tg862\") pod \"payload-processing-e2e-shared-a-c38c57-75dcc74898-mplzc\" (UID: \"80108b11-28c4-4c47-b13e-79cb732806ad\") " pod="openshift-ingress/payload-processing-e2e-shared-a-c38c57-75dcc74898-mplzc"
Jul 28 20:15:58.759616 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:58.759521    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80108b11-28c4-4c47-b13e-79cb732806ad-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-c38c57-75dcc74898-mplzc\" (UID: \"80108b11-28c4-4c47-b13e-79cb732806ad\") " pod="openshift-ingress/payload-processing-e2e-shared-a-c38c57-75dcc74898-mplzc"
Jul 28 20:15:58.759616 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:58.759546    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/750356bc-f340-4133-b423-9d37eaa18e68-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-c38c57-54f4b5977b-kzjkx\" (UID: \"750356bc-f340-4133-b423-9d37eaa18e68\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-c38c57-54f4b5977b-kzjkx"
Jul 28 20:15:58.860661 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:58.860622    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44nxn\" (UniqueName: \"kubernetes.io/projected/750356bc-f340-4133-b423-9d37eaa18e68-kube-api-access-44nxn\") pod \"payload-pre-processing-e2e-shared-a-c38c57-54f4b5977b-kzjkx\" (UID: \"750356bc-f340-4133-b423-9d37eaa18e68\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-c38c57-54f4b5977b-kzjkx"
Jul 28 20:15:58.860874 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:58.860705    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg862\" (UniqueName: \"kubernetes.io/projected/80108b11-28c4-4c47-b13e-79cb732806ad-kube-api-access-tg862\") pod \"payload-processing-e2e-shared-a-c38c57-75dcc74898-mplzc\" (UID: \"80108b11-28c4-4c47-b13e-79cb732806ad\") " pod="openshift-ingress/payload-processing-e2e-shared-a-c38c57-75dcc74898-mplzc"
Jul 28 20:15:58.860874 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:58.860736    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80108b11-28c4-4c47-b13e-79cb732806ad-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-c38c57-75dcc74898-mplzc\" (UID: \"80108b11-28c4-4c47-b13e-79cb732806ad\") " pod="openshift-ingress/payload-processing-e2e-shared-a-c38c57-75dcc74898-mplzc"
Jul 28 20:15:58.860874 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:58.860772    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/750356bc-f340-4133-b423-9d37eaa18e68-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-c38c57-54f4b5977b-kzjkx\" (UID: \"750356bc-f340-4133-b423-9d37eaa18e68\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-c38c57-54f4b5977b-kzjkx"
Jul 28 20:15:58.861551 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:58.861525    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/750356bc-f340-4133-b423-9d37eaa18e68-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-c38c57-54f4b5977b-kzjkx\" (UID: \"750356bc-f340-4133-b423-9d37eaa18e68\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-c38c57-54f4b5977b-kzjkx"
Jul 28 20:15:58.861643 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:58.861528    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80108b11-28c4-4c47-b13e-79cb732806ad-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-c38c57-75dcc74898-mplzc\" (UID: \"80108b11-28c4-4c47-b13e-79cb732806ad\") " pod="openshift-ingress/payload-processing-e2e-shared-a-c38c57-75dcc74898-mplzc"
Jul 28 20:15:58.869213 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:58.869189    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg862\" (UniqueName: \"kubernetes.io/projected/80108b11-28c4-4c47-b13e-79cb732806ad-kube-api-access-tg862\") pod \"payload-processing-e2e-shared-a-c38c57-75dcc74898-mplzc\" (UID: \"80108b11-28c4-4c47-b13e-79cb732806ad\") " pod="openshift-ingress/payload-processing-e2e-shared-a-c38c57-75dcc74898-mplzc"
Jul 28 20:15:58.869299 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:58.869253    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44nxn\" (UniqueName: \"kubernetes.io/projected/750356bc-f340-4133-b423-9d37eaa18e68-kube-api-access-44nxn\") pod \"payload-pre-processing-e2e-shared-a-c38c57-54f4b5977b-kzjkx\" (UID: \"750356bc-f340-4133-b423-9d37eaa18e68\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-c38c57-54f4b5977b-kzjkx"
Jul 28 20:15:58.998002 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:58.997895    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-c38c57-54f4b5977b-kzjkx"
Jul 28 20:15:59.016374 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:59.016341    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-c38c57-75dcc74898-mplzc"
Jul 28 20:15:59.144939 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:59.144909    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-c38c57-54f4b5977b-kzjkx"]
Jul 28 20:15:59.148364 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:15:59.148337    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod750356bc_f340_4133_b423_9d37eaa18e68.slice/crio-106aa60c42a9820c057b71c1d5d963c7b588b546753999479a18320595bee95c WatchSource:0}: Error finding container 106aa60c42a9820c057b71c1d5d963c7b588b546753999479a18320595bee95c: Status 404 returned error can't find the container with id 106aa60c42a9820c057b71c1d5d963c7b588b546753999479a18320595bee95c
Jul 28 20:15:59.167887 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:59.167866    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-c38c57-75dcc74898-mplzc"]
Jul 28 20:15:59.183212 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:15:59.183186    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80108b11_28c4_4c47_b13e_79cb732806ad.slice/crio-b2fec0e890c2aa1479356b34146429662aca44dfe87961224757eab329a8f1e3 WatchSource:0}: Error finding container b2fec0e890c2aa1479356b34146429662aca44dfe87961224757eab329a8f1e3: Status 404 returned error can't find the container with id b2fec0e890c2aa1479356b34146429662aca44dfe87961224757eab329a8f1e3
Jul 28 20:15:59.423188 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:59.423163    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:15:59.464693 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:59.464651    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bc27a13-c02b-4d96-92dc-8f160ca48d28-istio-data\") pod \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\" (UID: \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\") "
Jul 28 20:15:59.464693 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:59.464689    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bc27a13-c02b-4d96-92dc-8f160ca48d28-workload-socket\") pod \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\" (UID: \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\") "
Jul 28 20:15:59.464960 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:59.464743    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bc27a13-c02b-4d96-92dc-8f160ca48d28-credential-socket\") pod \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\" (UID: \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\") "
Jul 28 20:15:59.464960 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:59.464760    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bc27a13-c02b-4d96-92dc-8f160ca48d28-istiod-ca-cert\") pod \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\" (UID: \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\") "
Jul 28 20:15:59.464960 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:59.464774    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bc27a13-c02b-4d96-92dc-8f160ca48d28-workload-certs\") pod \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\" (UID: \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\") "
Jul 28 20:15:59.464960 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:59.464799    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bc27a13-c02b-4d96-92dc-8f160ca48d28-istio-token\") pod \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\" (UID: \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\") "
Jul 28 20:15:59.464960 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:59.464823    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bc27a13-c02b-4d96-92dc-8f160ca48d28-istio-podinfo\") pod \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\" (UID: \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\") "
Jul 28 20:15:59.464960 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:59.464903    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdcs7\" (UniqueName: \"kubernetes.io/projected/6bc27a13-c02b-4d96-92dc-8f160ca48d28-kube-api-access-qdcs7\") pod \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\" (UID: \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\") "
Jul 28 20:15:59.464960 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:59.464951    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bc27a13-c02b-4d96-92dc-8f160ca48d28-istio-envoy\") pod \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\" (UID: \"6bc27a13-c02b-4d96-92dc-8f160ca48d28\") "
Jul 28 20:15:59.465384 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:59.465096    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bc27a13-c02b-4d96-92dc-8f160ca48d28-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6bc27a13-c02b-4d96-92dc-8f160ca48d28" (UID: "6bc27a13-c02b-4d96-92dc-8f160ca48d28"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:15:59.465384 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:59.465292    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bc27a13-c02b-4d96-92dc-8f160ca48d28-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6bc27a13-c02b-4d96-92dc-8f160ca48d28" (UID: "6bc27a13-c02b-4d96-92dc-8f160ca48d28"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:15:59.465384 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:59.465317    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bc27a13-c02b-4d96-92dc-8f160ca48d28-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6bc27a13-c02b-4d96-92dc-8f160ca48d28" (UID: "6bc27a13-c02b-4d96-92dc-8f160ca48d28"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:15:59.466004 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:59.465708    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bc27a13-c02b-4d96-92dc-8f160ca48d28-istio-data" (OuterVolumeSpecName: "istio-data") pod "6bc27a13-c02b-4d96-92dc-8f160ca48d28" (UID: "6bc27a13-c02b-4d96-92dc-8f160ca48d28"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:15:59.466004 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:59.465306    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bc27a13-c02b-4d96-92dc-8f160ca48d28-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6bc27a13-c02b-4d96-92dc-8f160ca48d28" (UID: "6bc27a13-c02b-4d96-92dc-8f160ca48d28"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:15:59.466203 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:59.466071    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bc27a13-c02b-4d96-92dc-8f160ca48d28-credential-socket\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:15:59.469800 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:59.469466    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6bc27a13-c02b-4d96-92dc-8f160ca48d28-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6bc27a13-c02b-4d96-92dc-8f160ca48d28" (UID: "6bc27a13-c02b-4d96-92dc-8f160ca48d28"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:15:59.471021 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:59.470021    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bc27a13-c02b-4d96-92dc-8f160ca48d28-kube-api-access-qdcs7" (OuterVolumeSpecName: "kube-api-access-qdcs7") pod "6bc27a13-c02b-4d96-92dc-8f160ca48d28" (UID: "6bc27a13-c02b-4d96-92dc-8f160ca48d28"). InnerVolumeSpecName "kube-api-access-qdcs7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:15:59.473270 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:59.473241    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bc27a13-c02b-4d96-92dc-8f160ca48d28-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6bc27a13-c02b-4d96-92dc-8f160ca48d28" (UID: "6bc27a13-c02b-4d96-92dc-8f160ca48d28"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:15:59.473823 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:59.473804    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bc27a13-c02b-4d96-92dc-8f160ca48d28-istio-token" (OuterVolumeSpecName: "istio-token") pod "6bc27a13-c02b-4d96-92dc-8f160ca48d28" (UID: "6bc27a13-c02b-4d96-92dc-8f160ca48d28"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:15:59.567400 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:59.567286    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bc27a13-c02b-4d96-92dc-8f160ca48d28-istio-data\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:15:59.567400 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:59.567334    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bc27a13-c02b-4d96-92dc-8f160ca48d28-workload-socket\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:15:59.567400 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:59.567350    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bc27a13-c02b-4d96-92dc-8f160ca48d28-istiod-ca-cert\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:15:59.567400 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:59.567363    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bc27a13-c02b-4d96-92dc-8f160ca48d28-workload-certs\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:15:59.567400 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:59.567374    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bc27a13-c02b-4d96-92dc-8f160ca48d28-istio-token\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:15:59.567400 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:59.567385    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bc27a13-c02b-4d96-92dc-8f160ca48d28-istio-podinfo\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:15:59.567400 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:59.567399    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdcs7\" (UniqueName: \"kubernetes.io/projected/6bc27a13-c02b-4d96-92dc-8f160ca48d28-kube-api-access-qdcs7\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:15:59.567906 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:15:59.567413    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bc27a13-c02b-4d96-92dc-8f160ca48d28-istio-envoy\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:16:00.113464 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:00.113431    2570 generic.go:356] "Generic (PLEG): container finished" podID="6bc27a13-c02b-4d96-92dc-8f160ca48d28" containerID="241d7d448bc7bfe88b587a773708cb9b28886f0c1aca21ce6d8d300dcdd57be4" exitCode=0
Jul 28 20:16:00.113959 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:00.113490    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"
Jul 28 20:16:00.113959 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:00.113519    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9" event={"ID":"6bc27a13-c02b-4d96-92dc-8f160ca48d28","Type":"ContainerDied","Data":"241d7d448bc7bfe88b587a773708cb9b28886f0c1aca21ce6d8d300dcdd57be4"}
Jul 28 20:16:00.113959 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:00.113597    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9" event={"ID":"6bc27a13-c02b-4d96-92dc-8f160ca48d28","Type":"ContainerDied","Data":"e2326fbfaf425b060ca2a576d5ab9a70ba8b81dcee0763694baa269859e2b262"}
Jul 28 20:16:00.113959 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:00.113617    2570 scope.go:117] "RemoveContainer" containerID="241d7d448bc7bfe88b587a773708cb9b28886f0c1aca21ce6d8d300dcdd57be4"
Jul 28 20:16:00.115365 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:00.115341    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-c38c57-75dcc74898-mplzc" event={"ID":"80108b11-28c4-4c47-b13e-79cb732806ad","Type":"ContainerStarted","Data":"c500a707518c069dcf523da5049de43fec2aadc635f108ec8e174b8c899b4274"}
Jul 28 20:16:00.115458 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:00.115394    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-c38c57-75dcc74898-mplzc"
Jul 28 20:16:00.115458 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:00.115421    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-c38c57-75dcc74898-mplzc" event={"ID":"80108b11-28c4-4c47-b13e-79cb732806ad","Type":"ContainerStarted","Data":"b2fec0e890c2aa1479356b34146429662aca44dfe87961224757eab329a8f1e3"}
Jul 28 20:16:00.117019 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:00.116969    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-c38c57-54f4b5977b-kzjkx" event={"ID":"750356bc-f340-4133-b423-9d37eaa18e68","Type":"ContainerStarted","Data":"c1bc97ed9f63df59990e3d07a0d10aeaf52fb524f6890d6eda1676efca73e2cd"}
Jul 28 20:16:00.117122 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:00.117043    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-c38c57-54f4b5977b-kzjkx" event={"ID":"750356bc-f340-4133-b423-9d37eaa18e68","Type":"ContainerStarted","Data":"106aa60c42a9820c057b71c1d5d963c7b588b546753999479a18320595bee95c"}
Jul 28 20:16:00.117122 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:00.117093    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-c38c57-54f4b5977b-kzjkx"
Jul 28 20:16:00.122939 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:00.122924    2570 scope.go:117] "RemoveContainer" containerID="893aa02f989f142cd89e22ecdc5e3f5264272c82e654883bab1ebeb8f3af649f"
Jul 28 20:16:00.130753 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:00.130737    2570 scope.go:117] "RemoveContainer" containerID="241d7d448bc7bfe88b587a773708cb9b28886f0c1aca21ce6d8d300dcdd57be4"
Jul 28 20:16:00.131013 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:16:00.130994    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"241d7d448bc7bfe88b587a773708cb9b28886f0c1aca21ce6d8d300dcdd57be4\": container with ID starting with 241d7d448bc7bfe88b587a773708cb9b28886f0c1aca21ce6d8d300dcdd57be4 not found: ID does not exist" containerID="241d7d448bc7bfe88b587a773708cb9b28886f0c1aca21ce6d8d300dcdd57be4"
Jul 28 20:16:00.131092 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:00.131021    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"241d7d448bc7bfe88b587a773708cb9b28886f0c1aca21ce6d8d300dcdd57be4"} err="failed to get container status \"241d7d448bc7bfe88b587a773708cb9b28886f0c1aca21ce6d8d300dcdd57be4\": rpc error: code = NotFound desc = could not find container \"241d7d448bc7bfe88b587a773708cb9b28886f0c1aca21ce6d8d300dcdd57be4\": container with ID starting with 241d7d448bc7bfe88b587a773708cb9b28886f0c1aca21ce6d8d300dcdd57be4 not found: ID does not exist"
Jul 28 20:16:00.131092 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:00.131039    2570 scope.go:117] "RemoveContainer" containerID="893aa02f989f142cd89e22ecdc5e3f5264272c82e654883bab1ebeb8f3af649f"
Jul 28 20:16:00.131284 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:16:00.131268    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"893aa02f989f142cd89e22ecdc5e3f5264272c82e654883bab1ebeb8f3af649f\": container with ID starting with 893aa02f989f142cd89e22ecdc5e3f5264272c82e654883bab1ebeb8f3af649f not found: ID does not exist" containerID="893aa02f989f142cd89e22ecdc5e3f5264272c82e654883bab1ebeb8f3af649f"
Jul 28 20:16:00.131346 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:00.131294    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"893aa02f989f142cd89e22ecdc5e3f5264272c82e654883bab1ebeb8f3af649f"} err="failed to get container status \"893aa02f989f142cd89e22ecdc5e3f5264272c82e654883bab1ebeb8f3af649f\": rpc error: code = NotFound desc = could not find container \"893aa02f989f142cd89e22ecdc5e3f5264272c82e654883bab1ebeb8f3af649f\": container with ID starting with 893aa02f989f142cd89e22ecdc5e3f5264272c82e654883bab1ebeb8f3af649f not found: ID does not exist"
Jul 28 20:16:00.134077 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:00.134041    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-c38c57-54f4b5977b-kzjkx" podStartSLOduration=2.134029398 podStartE2EDuration="2.134029398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:15:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:16:00.131849789 +0000 UTC m=+2773.083882118" watchObservedRunningTime="2026-07-28 20:16:00.134029398 +0000 UTC m=+2773.086061727"
Jul 28 20:16:00.148165 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:00.148129    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-c38c57-75dcc74898-mplzc" podStartSLOduration=2.1481166050000002 podStartE2EDuration="2.148116605s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:15:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:16:00.146713726 +0000 UTC m=+2773.098746078" watchObservedRunningTime="2026-07-28 20:16:00.148116605 +0000 UTC m=+2773.100148935"
Jul 28 20:16:00.159968 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:00.159944    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"]
Jul 28 20:16:00.163800 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:00.163781    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-86e5cf-openshift-default-75bf8fff68-pfgs9"]
Jul 28 20:16:01.573181 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:01.573141    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bc27a13-c02b-4d96-92dc-8f160ca48d28" path="/var/lib/kubelet/pods/6bc27a13-c02b-4d96-92dc-8f160ca48d28/volumes"
Jul 28 20:16:11.126160 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:11.126126    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-c38c57-54f4b5977b-kzjkx"
Jul 28 20:16:11.126570 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:11.126425    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-c38c57-75dcc74898-mplzc"
Jul 28 20:16:12.099310 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:12.099274    2570 patch_prober.go:28] interesting pod/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 28 20:16:12.099569 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:12.099341    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7" podUID="b27b3710-1720-4ab8-a0a7-26bea05c6972" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 28 20:16:12.174809 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:12.174773    2570 generic.go:356] "Generic (PLEG): container finished" podID="b27b3710-1720-4ab8-a0a7-26bea05c6972" containerID="d3313f2eb27323034b5d8234a8c14fabe2325c4c315e78ae7cf8460ec83cb917" exitCode=0
Jul 28 20:16:12.175192 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:12.174819    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7" event={"ID":"b27b3710-1720-4ab8-a0a7-26bea05c6972","Type":"ContainerDied","Data":"d3313f2eb27323034b5d8234a8c14fabe2325c4c315e78ae7cf8460ec83cb917"}
Jul 28 20:16:12.175328 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:12.175300    2570 scope.go:117] "RemoveContainer" containerID="d3313f2eb27323034b5d8234a8c14fabe2325c4c315e78ae7cf8460ec83cb917"
Jul 28 20:16:12.176489 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:12.176448    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:16:12.176617 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:12.176538    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:16:12.176617 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:12.176574    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:16:13.181815 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:13.181777    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7" event={"ID":"b27b3710-1720-4ab8-a0a7-26bea05c6972","Type":"ContainerStarted","Data":"36422f725c1420972e700728be6dd746a08c2dc8d8d1a563888d57367b7ff17d"}
Jul 28 20:16:13.357162 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:13.357128    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:16:13.357380 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:13.357357    2570 patch_prober.go:28] interesting pod/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 28 20:16:13.357471 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:13.357412    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7" podUID="b27b3710-1720-4ab8-a0a7-26bea05c6972" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 28 20:16:14.357724 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:14.357687    2570 patch_prober.go:28] interesting pod/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 28 20:16:14.358136 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:14.357746    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7" podUID="b27b3710-1720-4ab8-a0a7-26bea05c6972" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 28 20:16:15.357699 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:15.357644    2570 patch_prober.go:28] interesting pod/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 28 20:16:15.357888 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:15.357714    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7" podUID="b27b3710-1720-4ab8-a0a7-26bea05c6972" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 28 20:16:16.357559 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:16.357526    2570 patch_prober.go:28] interesting pod/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 28 20:16:16.357737 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:16.357580    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7" podUID="b27b3710-1720-4ab8-a0a7-26bea05c6972" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 28 20:16:17.357612 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:17.357576    2570 patch_prober.go:28] interesting pod/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 28 20:16:17.358055 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:17.357632    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7" podUID="b27b3710-1720-4ab8-a0a7-26bea05c6972" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 28 20:16:18.361352 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:18.361318    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:16:18.361847 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:18.361585    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:16:18.362165 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:18.362149    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:16:23.573313 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.573266    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"]
Jul 28 20:16:23.573738 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.573590    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bc27a13-c02b-4d96-92dc-8f160ca48d28" containerName="istio-proxy"
Jul 28 20:16:23.573738 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.573601    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bc27a13-c02b-4d96-92dc-8f160ca48d28" containerName="istio-proxy"
Jul 28 20:16:23.573738 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.573610    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bc27a13-c02b-4d96-92dc-8f160ca48d28" containerName="istio-proxy"
Jul 28 20:16:23.573738 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.573616    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bc27a13-c02b-4d96-92dc-8f160ca48d28" containerName="istio-proxy"
Jul 28 20:16:23.573738 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.573669    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bc27a13-c02b-4d96-92dc-8f160ca48d28" containerName="istio-proxy"
Jul 28 20:16:23.573738 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.573678    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bc27a13-c02b-4d96-92dc-8f160ca48d28" containerName="istio-proxy"
Jul 28 20:16:23.576931 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.576911    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:16:23.579420 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.579396    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-d170bd-openshift-default-dockercfg-7cxs5\""
Jul 28 20:16:23.584401 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.584377    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"]
Jul 28 20:16:23.690199 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.690163    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bafdd96-d434-4862-95b5-4de5ee060250-workload-socket\") pod \"e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8\" (UID: \"6bafdd96-d434-4862-95b5-4de5ee060250\") " pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:16:23.690199 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.690203    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bafdd96-d434-4862-95b5-4de5ee060250-credential-socket\") pod \"e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8\" (UID: \"6bafdd96-d434-4862-95b5-4de5ee060250\") " pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:16:23.690415 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.690223    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bafdd96-d434-4862-95b5-4de5ee060250-istio-token\") pod \"e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8\" (UID: \"6bafdd96-d434-4862-95b5-4de5ee060250\") " pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:16:23.690415 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.690306    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bafdd96-d434-4862-95b5-4de5ee060250-istiod-ca-cert\") pod \"e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8\" (UID: \"6bafdd96-d434-4862-95b5-4de5ee060250\") " pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:16:23.690415 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.690346    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bafdd96-d434-4862-95b5-4de5ee060250-istio-envoy\") pod \"e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8\" (UID: \"6bafdd96-d434-4862-95b5-4de5ee060250\") " pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:16:23.690415 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.690389    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78vlf\" (UniqueName: \"kubernetes.io/projected/6bafdd96-d434-4862-95b5-4de5ee060250-kube-api-access-78vlf\") pod \"e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8\" (UID: \"6bafdd96-d434-4862-95b5-4de5ee060250\") " pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:16:23.690634 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.690479    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bafdd96-d434-4862-95b5-4de5ee060250-istio-podinfo\") pod \"e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8\" (UID: \"6bafdd96-d434-4862-95b5-4de5ee060250\") " pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:16:23.690634 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.690534    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bafdd96-d434-4862-95b5-4de5ee060250-workload-certs\") pod \"e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8\" (UID: \"6bafdd96-d434-4862-95b5-4de5ee060250\") " pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:16:23.690634 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.690580    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bafdd96-d434-4862-95b5-4de5ee060250-istio-data\") pod \"e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8\" (UID: \"6bafdd96-d434-4862-95b5-4de5ee060250\") " pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:16:23.791817 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.791781    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bafdd96-d434-4862-95b5-4de5ee060250-credential-socket\") pod \"e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8\" (UID: \"6bafdd96-d434-4862-95b5-4de5ee060250\") " pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:16:23.791817 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.791818    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bafdd96-d434-4862-95b5-4de5ee060250-istio-token\") pod \"e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8\" (UID: \"6bafdd96-d434-4862-95b5-4de5ee060250\") " pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:16:23.792110 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.791841    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bafdd96-d434-4862-95b5-4de5ee060250-istiod-ca-cert\") pod \"e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8\" (UID: \"6bafdd96-d434-4862-95b5-4de5ee060250\") " pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:16:23.792110 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.792000    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bafdd96-d434-4862-95b5-4de5ee060250-istio-envoy\") pod \"e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8\" (UID: \"6bafdd96-d434-4862-95b5-4de5ee060250\") " pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:16:23.792110 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.792070    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78vlf\" (UniqueName: \"kubernetes.io/projected/6bafdd96-d434-4862-95b5-4de5ee060250-kube-api-access-78vlf\") pod \"e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8\" (UID: \"6bafdd96-d434-4862-95b5-4de5ee060250\") " pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:16:23.792285 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.792135    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bafdd96-d434-4862-95b5-4de5ee060250-istio-podinfo\") pod \"e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8\" (UID: \"6bafdd96-d434-4862-95b5-4de5ee060250\") " pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:16:23.792285 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.792186    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bafdd96-d434-4862-95b5-4de5ee060250-workload-certs\") pod \"e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8\" (UID: \"6bafdd96-d434-4862-95b5-4de5ee060250\") " pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:16:23.792285 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.792212    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bafdd96-d434-4862-95b5-4de5ee060250-istio-data\") pod \"e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8\" (UID: \"6bafdd96-d434-4862-95b5-4de5ee060250\") " pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:16:23.792285 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.792272    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bafdd96-d434-4862-95b5-4de5ee060250-credential-socket\") pod \"e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8\" (UID: \"6bafdd96-d434-4862-95b5-4de5ee060250\") " pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:16:23.792495 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.792445    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bafdd96-d434-4862-95b5-4de5ee060250-workload-socket\") pod \"e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8\" (UID: \"6bafdd96-d434-4862-95b5-4de5ee060250\") " pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:16:23.792495 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.792464    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bafdd96-d434-4862-95b5-4de5ee060250-istio-data\") pod \"e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8\" (UID: \"6bafdd96-d434-4862-95b5-4de5ee060250\") " pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:16:23.792616 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.792591    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bafdd96-d434-4862-95b5-4de5ee060250-istiod-ca-cert\") pod \"e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8\" (UID: \"6bafdd96-d434-4862-95b5-4de5ee060250\") " pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:16:23.792682 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.792662    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bafdd96-d434-4862-95b5-4de5ee060250-workload-certs\") pod \"e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8\" (UID: \"6bafdd96-d434-4862-95b5-4de5ee060250\") " pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:16:23.792781 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.792763    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bafdd96-d434-4862-95b5-4de5ee060250-workload-socket\") pod \"e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8\" (UID: \"6bafdd96-d434-4862-95b5-4de5ee060250\") " pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:16:23.794255 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.794233    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bafdd96-d434-4862-95b5-4de5ee060250-istio-envoy\") pod \"e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8\" (UID: \"6bafdd96-d434-4862-95b5-4de5ee060250\") " pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:16:23.794763 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.794747    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bafdd96-d434-4862-95b5-4de5ee060250-istio-podinfo\") pod \"e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8\" (UID: \"6bafdd96-d434-4862-95b5-4de5ee060250\") " pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:16:23.799746 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.799724    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bafdd96-d434-4862-95b5-4de5ee060250-istio-token\") pod \"e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8\" (UID: \"6bafdd96-d434-4862-95b5-4de5ee060250\") " pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:16:23.800088 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.800069    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78vlf\" (UniqueName: \"kubernetes.io/projected/6bafdd96-d434-4862-95b5-4de5ee060250-kube-api-access-78vlf\") pod \"e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8\" (UID: \"6bafdd96-d434-4862-95b5-4de5ee060250\") " pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:16:23.888467 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:23.888383    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:16:24.023130 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:24.023097    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"]
Jul 28 20:16:24.026558 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:16:24.026527    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bafdd96_d434_4862_95b5_4de5ee060250.slice/crio-094adde98759a35c7682589e8866bd5a8bc63dd65ab814c52dbc44abd010c381 WatchSource:0}: Error finding container 094adde98759a35c7682589e8866bd5a8bc63dd65ab814c52dbc44abd010c381: Status 404 returned error can't find the container with id 094adde98759a35c7682589e8866bd5a8bc63dd65ab814c52dbc44abd010c381
Jul 28 20:16:24.029191 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:24.029160    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:16:24.029274 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:24.029229    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:16:24.029274 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:24.029258    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:16:24.237558 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:24.237518    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8" event={"ID":"6bafdd96-d434-4862-95b5-4de5ee060250","Type":"ContainerStarted","Data":"6ffad74111bf59eb7b23839ca74f97b58ce883dd19e6e53075b2dd04a6c7a071"}
Jul 28 20:16:24.237733 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:24.237585    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8" event={"ID":"6bafdd96-d434-4862-95b5-4de5ee060250","Type":"ContainerStarted","Data":"094adde98759a35c7682589e8866bd5a8bc63dd65ab814c52dbc44abd010c381"}
Jul 28 20:16:24.256693 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:24.256632    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8" podStartSLOduration=1.25661449 podStartE2EDuration="1.25661449s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:16:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:16:24.255054814 +0000 UTC m=+2797.207087171" watchObservedRunningTime="2026-07-28 20:16:24.25661449 +0000 UTC m=+2797.208646820"
Jul 28 20:16:24.888712 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:24.888665    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:16:25.894186 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:25.894157    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:16:26.247665 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:26.247631    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:16:26.248692 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:26.248669    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:16:26.987734 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:26.987699    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-d170bd-5f89899758-v79qd"]
Jul 28 20:16:26.991107 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:26.991089    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-d170bd-5f89899758-v79qd"
Jul 28 20:16:26.998295 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:26.998271    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-d170bd-dockercfg-92sfd\""
Jul 28 20:16:26.998466 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:26.998443    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-d170bd\""
Jul 28 20:16:27.002784 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:27.002762    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-d170bd-5f89899758-v79qd"]
Jul 28 20:16:27.034408 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:27.034365    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-d170bd-76c6cd8f5b-q8rp6"]
Jul 28 20:16:27.037608 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:27.037588    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-d170bd-76c6cd8f5b-q8rp6"
Jul 28 20:16:27.047223 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:27.047198    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-d170bd-76c6cd8f5b-q8rp6"]
Jul 28 20:16:27.120441 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:27.120405    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5dd0f0dc-783f-494b-9143-56b17a5473a6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-d170bd-76c6cd8f5b-q8rp6\" (UID: \"5dd0f0dc-783f-494b-9143-56b17a5473a6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-d170bd-76c6cd8f5b-q8rp6"
Jul 28 20:16:27.120612 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:27.120461    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fcc1e83d-f409-453c-a3d3-066da307b431-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-d170bd-5f89899758-v79qd\" (UID: \"fcc1e83d-f409-453c-a3d3-066da307b431\") " pod="openshift-ingress/payload-processing-e2e-shared-b-d170bd-5f89899758-v79qd"
Jul 28 20:16:27.120612 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:27.120483    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-769lp\" (UniqueName: \"kubernetes.io/projected/fcc1e83d-f409-453c-a3d3-066da307b431-kube-api-access-769lp\") pod \"payload-processing-e2e-shared-b-d170bd-5f89899758-v79qd\" (UID: \"fcc1e83d-f409-453c-a3d3-066da307b431\") " pod="openshift-ingress/payload-processing-e2e-shared-b-d170bd-5f89899758-v79qd"
Jul 28 20:16:27.120612 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:27.120532    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92cpv\" (UniqueName: \"kubernetes.io/projected/5dd0f0dc-783f-494b-9143-56b17a5473a6-kube-api-access-92cpv\") pod \"payload-pre-processing-e2e-shared-b-d170bd-76c6cd8f5b-q8rp6\" (UID: \"5dd0f0dc-783f-494b-9143-56b17a5473a6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-d170bd-76c6cd8f5b-q8rp6"
Jul 28 20:16:27.221689 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:27.221659    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5dd0f0dc-783f-494b-9143-56b17a5473a6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-d170bd-76c6cd8f5b-q8rp6\" (UID: \"5dd0f0dc-783f-494b-9143-56b17a5473a6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-d170bd-76c6cd8f5b-q8rp6"
Jul 28 20:16:27.221884 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:27.221725    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fcc1e83d-f409-453c-a3d3-066da307b431-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-d170bd-5f89899758-v79qd\" (UID: \"fcc1e83d-f409-453c-a3d3-066da307b431\") " pod="openshift-ingress/payload-processing-e2e-shared-b-d170bd-5f89899758-v79qd"
Jul 28 20:16:27.221884 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:27.221751    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-769lp\" (UniqueName: \"kubernetes.io/projected/fcc1e83d-f409-453c-a3d3-066da307b431-kube-api-access-769lp\") pod \"payload-processing-e2e-shared-b-d170bd-5f89899758-v79qd\" (UID: \"fcc1e83d-f409-453c-a3d3-066da307b431\") " pod="openshift-ingress/payload-processing-e2e-shared-b-d170bd-5f89899758-v79qd"
Jul 28 20:16:27.221884 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:27.221781    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92cpv\" (UniqueName: \"kubernetes.io/projected/5dd0f0dc-783f-494b-9143-56b17a5473a6-kube-api-access-92cpv\") pod \"payload-pre-processing-e2e-shared-b-d170bd-76c6cd8f5b-q8rp6\" (UID: \"5dd0f0dc-783f-494b-9143-56b17a5473a6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-d170bd-76c6cd8f5b-q8rp6"
Jul 28 20:16:27.222516 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:27.222478    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5dd0f0dc-783f-494b-9143-56b17a5473a6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-d170bd-76c6cd8f5b-q8rp6\" (UID: \"5dd0f0dc-783f-494b-9143-56b17a5473a6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-d170bd-76c6cd8f5b-q8rp6"
Jul 28 20:16:27.222641 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:27.222550    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fcc1e83d-f409-453c-a3d3-066da307b431-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-d170bd-5f89899758-v79qd\" (UID: \"fcc1e83d-f409-453c-a3d3-066da307b431\") " pod="openshift-ingress/payload-processing-e2e-shared-b-d170bd-5f89899758-v79qd"
Jul 28 20:16:27.229535 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:27.229507    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92cpv\" (UniqueName: \"kubernetes.io/projected/5dd0f0dc-783f-494b-9143-56b17a5473a6-kube-api-access-92cpv\") pod \"payload-pre-processing-e2e-shared-b-d170bd-76c6cd8f5b-q8rp6\" (UID: \"5dd0f0dc-783f-494b-9143-56b17a5473a6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-d170bd-76c6cd8f5b-q8rp6"
Jul 28 20:16:27.229535 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:27.229527    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-769lp\" (UniqueName: \"kubernetes.io/projected/fcc1e83d-f409-453c-a3d3-066da307b431-kube-api-access-769lp\") pod \"payload-processing-e2e-shared-b-d170bd-5f89899758-v79qd\" (UID: \"fcc1e83d-f409-453c-a3d3-066da307b431\") " pod="openshift-ingress/payload-processing-e2e-shared-b-d170bd-5f89899758-v79qd"
Jul 28 20:16:27.301287 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:27.301197    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-d170bd-5f89899758-v79qd"
Jul 28 20:16:27.349841 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:27.349810    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-d170bd-76c6cd8f5b-q8rp6"
Jul 28 20:16:27.453707 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:27.453677    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-d170bd-5f89899758-v79qd"]
Jul 28 20:16:27.456180 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:16:27.456147    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcc1e83d_f409_453c_a3d3_066da307b431.slice/crio-1487f688f8738d61d85c8005d48d168d26965de205ff52b1fd61c2f7e03275db WatchSource:0}: Error finding container 1487f688f8738d61d85c8005d48d168d26965de205ff52b1fd61c2f7e03275db: Status 404 returned error can't find the container with id 1487f688f8738d61d85c8005d48d168d26965de205ff52b1fd61c2f7e03275db
Jul 28 20:16:27.702544 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:27.702520    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-d170bd-76c6cd8f5b-q8rp6"]
Jul 28 20:16:27.705118 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:16:27.705092    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dd0f0dc_783f_494b_9143_56b17a5473a6.slice/crio-34d523687c2ef956776e6a1ff869981b111af4a633df9f3520b69cfcd0150033 WatchSource:0}: Error finding container 34d523687c2ef956776e6a1ff869981b111af4a633df9f3520b69cfcd0150033: Status 404 returned error can't find the container with id 34d523687c2ef956776e6a1ff869981b111af4a633df9f3520b69cfcd0150033
Jul 28 20:16:28.257336 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:28.257298    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-d170bd-76c6cd8f5b-q8rp6" event={"ID":"5dd0f0dc-783f-494b-9143-56b17a5473a6","Type":"ContainerStarted","Data":"0e5ff322a8e74da6035a91b2db46cb17addef7d9c4ec19c6cae02c19137c4412"}
Jul 28 20:16:28.257723 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:28.257365    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-d170bd-76c6cd8f5b-q8rp6"
Jul 28 20:16:28.257723 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:28.257393    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-d170bd-76c6cd8f5b-q8rp6" event={"ID":"5dd0f0dc-783f-494b-9143-56b17a5473a6","Type":"ContainerStarted","Data":"34d523687c2ef956776e6a1ff869981b111af4a633df9f3520b69cfcd0150033"}
Jul 28 20:16:28.258828 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:28.258804    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-d170bd-5f89899758-v79qd" event={"ID":"fcc1e83d-f409-453c-a3d3-066da307b431","Type":"ContainerStarted","Data":"1f3f77b26fc36190bb136d59256b0a0c71e6053b72da21d6993c8cb6413a823c"}
Jul 28 20:16:28.258951 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:28.258853    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-d170bd-5f89899758-v79qd" event={"ID":"fcc1e83d-f409-453c-a3d3-066da307b431","Type":"ContainerStarted","Data":"1487f688f8738d61d85c8005d48d168d26965de205ff52b1fd61c2f7e03275db"}
Jul 28 20:16:28.275213 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:28.275171    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-d170bd-76c6cd8f5b-q8rp6" podStartSLOduration=1.275157117 podStartE2EDuration="1.275157117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:16:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:16:28.273461161 +0000 UTC m=+2801.225493492" watchObservedRunningTime="2026-07-28 20:16:28.275157117 +0000 UTC m=+2801.227189454"
Jul 28 20:16:28.291201 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:28.291147    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-d170bd-5f89899758-v79qd" podStartSLOduration=2.291128763 podStartE2EDuration="2.291128763s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:16:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:16:28.290774376 +0000 UTC m=+2801.242806733" watchObservedRunningTime="2026-07-28 20:16:28.291128763 +0000 UTC m=+2801.243161093"
Jul 28 20:16:29.263127 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:29.263087    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-d170bd-5f89899758-v79qd"
Jul 28 20:16:39.265696 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:39.265650    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-d170bd-76c6cd8f5b-q8rp6"
Jul 28 20:16:40.270103 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:40.270072    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-d170bd-5f89899758-v79qd"
Jul 28 20:16:41.321118 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:41.320529    2570 patch_prober.go:28] interesting pod/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": read tcp 10.134.0.2:32836->10.134.0.64:15021: read: connection reset by peer" start-of-body=
Jul 28 20:16:41.321118 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:41.320592    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8" podUID="6bafdd96-d434-4862-95b5-4de5ee060250" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": read tcp 10.134.0.2:32836->10.134.0.64:15021: read: connection reset by peer"
Jul 28 20:16:42.340137 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:42.340105    2570 generic.go:356] "Generic (PLEG): container finished" podID="6bafdd96-d434-4862-95b5-4de5ee060250" containerID="6ffad74111bf59eb7b23839ca74f97b58ce883dd19e6e53075b2dd04a6c7a071" exitCode=0
Jul 28 20:16:42.340522 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:42.340182    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8" event={"ID":"6bafdd96-d434-4862-95b5-4de5ee060250","Type":"ContainerDied","Data":"6ffad74111bf59eb7b23839ca74f97b58ce883dd19e6e53075b2dd04a6c7a071"}
Jul 28 20:16:42.340600 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:42.340586    2570 scope.go:117] "RemoveContainer" containerID="6ffad74111bf59eb7b23839ca74f97b58ce883dd19e6e53075b2dd04a6c7a071"
Jul 28 20:16:42.341611 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:42.341587    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:16:42.341677 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:42.341648    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:16:42.341713 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:42.341680    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 28 20:16:43.346901 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:43.346856    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8" event={"ID":"6bafdd96-d434-4862-95b5-4de5ee060250","Type":"ContainerStarted","Data":"6e3a7375716338fb661c188634aff763b8b65ad820e708261d9fabcd90aa45bb"}
Jul 28 20:16:43.888672 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:43.888635    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:16:43.888882 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:43.888860    2570 patch_prober.go:28] interesting pod/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 28 20:16:43.888935 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:43.888907    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8" podUID="6bafdd96-d434-4862-95b5-4de5ee060250" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 28 20:16:44.889161 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:44.889105    2570 patch_prober.go:28] interesting pod/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 28 20:16:44.889656 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:44.889192    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8" podUID="6bafdd96-d434-4862-95b5-4de5ee060250" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 28 20:16:45.889600 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:45.889563    2570 patch_prober.go:28] interesting pod/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 28 20:16:45.890171 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:45.890139    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8" podUID="6bafdd96-d434-4862-95b5-4de5ee060250" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 28 20:16:46.889452 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:46.889409    2570 patch_prober.go:28] interesting pod/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 28 20:16:46.889655 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:46.889479    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8" podUID="6bafdd96-d434-4862-95b5-4de5ee060250" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 28 20:16:47.892163 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:47.892140    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:16:47.892469 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:47.892399    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:16:47.893172 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:16:47.893157    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:26:48.034364 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:26:48.034331    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-06df9a-c799676fb-85p9f"]
Jul 28 20:26:48.037795 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:26:48.037778    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-06df9a-c799676fb-85p9f"
Jul 28 20:26:48.040094 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:26:48.040076    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-06df9a\""
Jul 28 20:26:48.040417 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:26:48.040397    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-06df9a-dockercfg-vf7b4\""
Jul 28 20:26:48.046732 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:26:48.046708    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-06df9a-c799676fb-85p9f"]
Jul 28 20:26:48.059224 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:26:48.059200    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-06df9a-6599768986-6px7b"]
Jul 28 20:26:48.063399 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:26:48.063379    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-06df9a-6599768986-6px7b"
Jul 28 20:26:48.074411 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:26:48.074386    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-06df9a-6599768986-6px7b"]
Jul 28 20:26:48.211300 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:26:48.211259    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a88a3092-8ef9-4134-afa7-6590d62ad5b8-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-06df9a-6599768986-6px7b\" (UID: \"a88a3092-8ef9-4134-afa7-6590d62ad5b8\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-06df9a-6599768986-6px7b"
Jul 28 20:26:48.211460 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:26:48.211325    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a199a2b-339d-4429-8dac-80f027882b09-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-06df9a-c799676fb-85p9f\" (UID: \"8a199a2b-339d-4429-8dac-80f027882b09\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-06df9a-c799676fb-85p9f"
Jul 28 20:26:48.211460 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:26:48.211347    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7ppr\" (UniqueName: \"kubernetes.io/projected/8a199a2b-339d-4429-8dac-80f027882b09-kube-api-access-p7ppr\") pod \"payload-pre-processing-e2e-ipp-a-06df9a-c799676fb-85p9f\" (UID: \"8a199a2b-339d-4429-8dac-80f027882b09\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-06df9a-c799676fb-85p9f"
Jul 28 20:26:48.211460 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:26:48.211425    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w8hv\" (UniqueName: \"kubernetes.io/projected/a88a3092-8ef9-4134-afa7-6590d62ad5b8-kube-api-access-5w8hv\") pod \"payload-processing-e2e-ipp-a-06df9a-6599768986-6px7b\" (UID: \"a88a3092-8ef9-4134-afa7-6590d62ad5b8\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-06df9a-6599768986-6px7b"
Jul 28 20:26:48.312395 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:26:48.312305    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a88a3092-8ef9-4134-afa7-6590d62ad5b8-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-06df9a-6599768986-6px7b\" (UID: \"a88a3092-8ef9-4134-afa7-6590d62ad5b8\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-06df9a-6599768986-6px7b"
Jul 28 20:26:48.312395 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:26:48.312349    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a199a2b-339d-4429-8dac-80f027882b09-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-06df9a-c799676fb-85p9f\" (UID: \"8a199a2b-339d-4429-8dac-80f027882b09\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-06df9a-c799676fb-85p9f"
Jul 28 20:26:48.312395 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:26:48.312370    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7ppr\" (UniqueName: \"kubernetes.io/projected/8a199a2b-339d-4429-8dac-80f027882b09-kube-api-access-p7ppr\") pod \"payload-pre-processing-e2e-ipp-a-06df9a-c799676fb-85p9f\" (UID: \"8a199a2b-339d-4429-8dac-80f027882b09\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-06df9a-c799676fb-85p9f"
Jul 28 20:26:48.312618 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:26:48.312426    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w8hv\" (UniqueName: \"kubernetes.io/projected/a88a3092-8ef9-4134-afa7-6590d62ad5b8-kube-api-access-5w8hv\") pod \"payload-processing-e2e-ipp-a-06df9a-6599768986-6px7b\" (UID: \"a88a3092-8ef9-4134-afa7-6590d62ad5b8\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-06df9a-6599768986-6px7b"
Jul 28 20:26:48.313119 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:26:48.313097    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a88a3092-8ef9-4134-afa7-6590d62ad5b8-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-06df9a-6599768986-6px7b\" (UID: \"a88a3092-8ef9-4134-afa7-6590d62ad5b8\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-06df9a-6599768986-6px7b"
Jul 28 20:26:48.313173 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:26:48.313125    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a199a2b-339d-4429-8dac-80f027882b09-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-06df9a-c799676fb-85p9f\" (UID: \"8a199a2b-339d-4429-8dac-80f027882b09\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-06df9a-c799676fb-85p9f"
Jul 28 20:26:48.330912 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:26:48.330888    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w8hv\" (UniqueName: \"kubernetes.io/projected/a88a3092-8ef9-4134-afa7-6590d62ad5b8-kube-api-access-5w8hv\") pod \"payload-processing-e2e-ipp-a-06df9a-6599768986-6px7b\" (UID: \"a88a3092-8ef9-4134-afa7-6590d62ad5b8\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-06df9a-6599768986-6px7b"
Jul 28 20:26:48.342038 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:26:48.342014    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7ppr\" (UniqueName: \"kubernetes.io/projected/8a199a2b-339d-4429-8dac-80f027882b09-kube-api-access-p7ppr\") pod \"payload-pre-processing-e2e-ipp-a-06df9a-c799676fb-85p9f\" (UID: \"8a199a2b-339d-4429-8dac-80f027882b09\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-06df9a-c799676fb-85p9f"
Jul 28 20:26:48.349408 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:26:48.349384    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-06df9a-c799676fb-85p9f"
Jul 28 20:26:48.373824 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:26:48.373798    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-06df9a-6599768986-6px7b"
Jul 28 20:26:48.505111 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:26:48.505076    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-06df9a-c799676fb-85p9f"]
Jul 28 20:26:48.508592 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:26:48.508553    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a199a2b_339d_4429_8dac_80f027882b09.slice/crio-fa938ed0267b19de610583e0c5b07ca1045a26976024a36a7066b77750172aca WatchSource:0}: Error finding container fa938ed0267b19de610583e0c5b07ca1045a26976024a36a7066b77750172aca: Status 404 returned error can't find the container with id fa938ed0267b19de610583e0c5b07ca1045a26976024a36a7066b77750172aca
Jul 28 20:26:48.728325 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:26:48.728301    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-06df9a-6599768986-6px7b"]
Jul 28 20:26:48.730844 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:26:48.730814    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda88a3092_8ef9_4134_afa7_6590d62ad5b8.slice/crio-d2fd68c42360ab8bd23f86bf0759f96a9e6441895d44c547f83b083763b8b851 WatchSource:0}: Error finding container d2fd68c42360ab8bd23f86bf0759f96a9e6441895d44c547f83b083763b8b851: Status 404 returned error can't find the container with id d2fd68c42360ab8bd23f86bf0759f96a9e6441895d44c547f83b083763b8b851
Jul 28 20:26:49.100122 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:26:49.100088    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-06df9a-6599768986-6px7b" event={"ID":"a88a3092-8ef9-4134-afa7-6590d62ad5b8","Type":"ContainerStarted","Data":"29bd187357475073151dfaf9b2ea21463b5159a9b85db2d495481010b351b466"}
Jul 28 20:26:49.100619 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:26:49.100143    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-06df9a-6599768986-6px7b" event={"ID":"a88a3092-8ef9-4134-afa7-6590d62ad5b8","Type":"ContainerStarted","Data":"d2fd68c42360ab8bd23f86bf0759f96a9e6441895d44c547f83b083763b8b851"}
Jul 28 20:26:49.100619 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:26:49.100262    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-06df9a-6599768986-6px7b"
Jul 28 20:26:49.101870 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:26:49.101846    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-06df9a-c799676fb-85p9f" event={"ID":"8a199a2b-339d-4429-8dac-80f027882b09","Type":"ContainerStarted","Data":"0757aeb60f8ad6e4a5e968702d71cb333a0fbf311c4dddc9c6f835f51a714cd6"}
Jul 28 20:26:49.102024 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:26:49.101891    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-06df9a-c799676fb-85p9f"
Jul 28 20:26:49.102024 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:26:49.101907    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-06df9a-c799676fb-85p9f" event={"ID":"8a199a2b-339d-4429-8dac-80f027882b09","Type":"ContainerStarted","Data":"fa938ed0267b19de610583e0c5b07ca1045a26976024a36a7066b77750172aca"}
Jul 28 20:26:49.116348 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:26:49.116292    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-06df9a-6599768986-6px7b" podStartSLOduration=1.116273203 podStartE2EDuration="1.116273203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:26:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:26:49.115513602 +0000 UTC m=+3422.067545959" watchObservedRunningTime="2026-07-28 20:26:49.116273203 +0000 UTC m=+3422.068305548"
Jul 28 20:26:49.132708 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:26:49.132661    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-06df9a-c799676fb-85p9f" podStartSLOduration=1.132646827 podStartE2EDuration="1.132646827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:26:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:26:49.1313483 +0000 UTC m=+3422.083380631" watchObservedRunningTime="2026-07-28 20:26:49.132646827 +0000 UTC m=+3422.084679157"
Jul 28 20:27:00.108573 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:27:00.108537    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-06df9a-6599768986-6px7b"
Jul 28 20:27:00.109088 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:27:00.108794    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-06df9a-c799676fb-85p9f"
Jul 28 20:27:47.891565 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:27:47.891534    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-tvdt2_28205bd5-94b7-4dfc-8adb-adabf45f8e19/payload-processing/0.log"
Jul 28 20:28:42.964514 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:28:42.964482    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-06df9a-6599768986-6px7b_a88a3092-8ef9-4134-afa7-6590d62ad5b8/payload-processing/0.log"
Jul 28 20:28:43.089535 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:28:43.089500    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-tvdt2_28205bd5-94b7-4dfc-8adb-adabf45f8e19/payload-processing/0.log"
Jul 28 20:28:47.811480 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:28:47.811445    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0fc004-9f4d4c59b-smnjg"]
Jul 28 20:28:47.814720 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:28:47.814703    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0fc004-9f4d4c59b-smnjg"
Jul 28 20:28:47.817524 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:28:47.817500    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-0fc004\""
Jul 28 20:28:47.817670 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:28:47.817559    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-0fc004-dockercfg-dcbv7\""
Jul 28 20:28:47.822759 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:28:47.822733    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0fc004-9f4d4c59b-smnjg"]
Jul 28 20:28:47.899227 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:28:47.899193    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-0fc004-846c797d46-mdwzl"]
Jul 28 20:28:47.902569 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:28:47.902552    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0fc004-846c797d46-mdwzl"
Jul 28 20:28:47.904005 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:28:47.903967    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e19e4b6-069e-42fc-acbc-936abeded289-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-0fc004-9f4d4c59b-smnjg\" (UID: \"0e19e4b6-069e-42fc-acbc-936abeded289\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0fc004-9f4d4c59b-smnjg"
Jul 28 20:28:47.904093 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:28:47.904024    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk6fs\" (UniqueName: \"kubernetes.io/projected/0e19e4b6-069e-42fc-acbc-936abeded289-kube-api-access-gk6fs\") pod \"payload-pre-processing-e2e-ipp-cleanup-0fc004-9f4d4c59b-smnjg\" (UID: \"0e19e4b6-069e-42fc-acbc-936abeded289\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0fc004-9f4d4c59b-smnjg"
Jul 28 20:28:47.914694 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:28:47.914671    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-0fc004-846c797d46-mdwzl"]
Jul 28 20:28:48.004810 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:28:48.004775    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e19e4b6-069e-42fc-acbc-936abeded289-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-0fc004-9f4d4c59b-smnjg\" (UID: \"0e19e4b6-069e-42fc-acbc-936abeded289\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0fc004-9f4d4c59b-smnjg"
Jul 28 20:28:48.005037 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:28:48.004821    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk6fs\" (UniqueName: \"kubernetes.io/projected/0e19e4b6-069e-42fc-acbc-936abeded289-kube-api-access-gk6fs\") pod \"payload-pre-processing-e2e-ipp-cleanup-0fc004-9f4d4c59b-smnjg\" (UID: \"0e19e4b6-069e-42fc-acbc-936abeded289\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0fc004-9f4d4c59b-smnjg"
Jul 28 20:28:48.005037 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:28:48.004945    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddv77\" (UniqueName: \"kubernetes.io/projected/f0b954b2-c9e6-4554-86c7-137dd510d59c-kube-api-access-ddv77\") pod \"payload-processing-e2e-ipp-cleanup-0fc004-846c797d46-mdwzl\" (UID: \"f0b954b2-c9e6-4554-86c7-137dd510d59c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0fc004-846c797d46-mdwzl"
Jul 28 20:28:48.005037 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:28:48.005027    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0b954b2-c9e6-4554-86c7-137dd510d59c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-0fc004-846c797d46-mdwzl\" (UID: \"f0b954b2-c9e6-4554-86c7-137dd510d59c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0fc004-846c797d46-mdwzl"
Jul 28 20:28:48.005708 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:28:48.005684    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e19e4b6-069e-42fc-acbc-936abeded289-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-0fc004-9f4d4c59b-smnjg\" (UID: \"0e19e4b6-069e-42fc-acbc-936abeded289\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0fc004-9f4d4c59b-smnjg"
Jul 28 20:28:48.014410 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:28:48.014378    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk6fs\" (UniqueName: \"kubernetes.io/projected/0e19e4b6-069e-42fc-acbc-936abeded289-kube-api-access-gk6fs\") pod \"payload-pre-processing-e2e-ipp-cleanup-0fc004-9f4d4c59b-smnjg\" (UID: \"0e19e4b6-069e-42fc-acbc-936abeded289\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0fc004-9f4d4c59b-smnjg"
Jul 28 20:28:48.106372 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:28:48.106291    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddv77\" (UniqueName: \"kubernetes.io/projected/f0b954b2-c9e6-4554-86c7-137dd510d59c-kube-api-access-ddv77\") pod \"payload-processing-e2e-ipp-cleanup-0fc004-846c797d46-mdwzl\" (UID: \"f0b954b2-c9e6-4554-86c7-137dd510d59c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0fc004-846c797d46-mdwzl"
Jul 28 20:28:48.106372 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:28:48.106340    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0b954b2-c9e6-4554-86c7-137dd510d59c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-0fc004-846c797d46-mdwzl\" (UID: \"f0b954b2-c9e6-4554-86c7-137dd510d59c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0fc004-846c797d46-mdwzl"
Jul 28 20:28:48.107099 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:28:48.107079    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0b954b2-c9e6-4554-86c7-137dd510d59c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-0fc004-846c797d46-mdwzl\" (UID: \"f0b954b2-c9e6-4554-86c7-137dd510d59c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0fc004-846c797d46-mdwzl"
Jul 28 20:28:48.115143 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:28:48.115115    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddv77\" (UniqueName: \"kubernetes.io/projected/f0b954b2-c9e6-4554-86c7-137dd510d59c-kube-api-access-ddv77\") pod \"payload-processing-e2e-ipp-cleanup-0fc004-846c797d46-mdwzl\" (UID: \"f0b954b2-c9e6-4554-86c7-137dd510d59c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0fc004-846c797d46-mdwzl"
Jul 28 20:28:48.125934 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:28:48.125907    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0fc004-9f4d4c59b-smnjg"
Jul 28 20:28:48.216138 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:28:48.216107    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0fc004-846c797d46-mdwzl"
Jul 28 20:28:48.470821 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:28:48.470793    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0fc004-9f4d4c59b-smnjg"]
Jul 28 20:28:48.472678 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:28:48.472652    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e19e4b6_069e_42fc_acbc_936abeded289.slice/crio-7603d8cc7559cce7a4afc1b1462004c7ee8c9813dc01129030d4114d63618987 WatchSource:0}: Error finding container 7603d8cc7559cce7a4afc1b1462004c7ee8c9813dc01129030d4114d63618987: Status 404 returned error can't find the container with id 7603d8cc7559cce7a4afc1b1462004c7ee8c9813dc01129030d4114d63618987
Jul 28 20:28:48.563154 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:28:48.563125    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-0fc004-846c797d46-mdwzl"]
Jul 28 20:28:48.565182 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:28:48.565161    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0b954b2_c9e6_4554_86c7_137dd510d59c.slice/crio-a8589a3ed7b1c82828627b50edb955158976de07edc74646a5dfef4045614ce2 WatchSource:0}: Error finding container a8589a3ed7b1c82828627b50edb955158976de07edc74646a5dfef4045614ce2: Status 404 returned error can't find the container with id a8589a3ed7b1c82828627b50edb955158976de07edc74646a5dfef4045614ce2
Jul 28 20:28:48.657781 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:28:48.657748    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0fc004-9f4d4c59b-smnjg" event={"ID":"0e19e4b6-069e-42fc-acbc-936abeded289","Type":"ContainerStarted","Data":"7a814e5ae59a92f1425e97c0b38b3c9befd66e3a9fd71a409418220543c0a056"}
Jul 28 20:28:48.657960 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:28:48.657888    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0fc004-9f4d4c59b-smnjg"
Jul 28 20:28:48.657960 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:28:48.657934    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0fc004-9f4d4c59b-smnjg" event={"ID":"0e19e4b6-069e-42fc-acbc-936abeded289","Type":"ContainerStarted","Data":"7603d8cc7559cce7a4afc1b1462004c7ee8c9813dc01129030d4114d63618987"}
Jul 28 20:28:48.659286 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:28:48.659264    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0fc004-846c797d46-mdwzl" event={"ID":"f0b954b2-c9e6-4554-86c7-137dd510d59c","Type":"ContainerStarted","Data":"1c2a17015355d176e164adfb9f49137b986aa40374479a4132e208eee467db5d"}
Jul 28 20:28:48.659390 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:28:48.659308    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0fc004-846c797d46-mdwzl" event={"ID":"f0b954b2-c9e6-4554-86c7-137dd510d59c","Type":"ContainerStarted","Data":"a8589a3ed7b1c82828627b50edb955158976de07edc74646a5dfef4045614ce2"}
Jul 28 20:28:48.659390 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:28:48.659328    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0fc004-846c797d46-mdwzl"
Jul 28 20:28:48.680819 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:28:48.680768    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0fc004-9f4d4c59b-smnjg" podStartSLOduration=1.6807549499999999 podStartE2EDuration="1.68075495s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:28:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:28:48.678225586 +0000 UTC m=+3541.630257940" watchObservedRunningTime="2026-07-28 20:28:48.68075495 +0000 UTC m=+3541.632787287"
Jul 28 20:28:48.698584 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:28:48.698533    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0fc004-846c797d46-mdwzl" podStartSLOduration=1.6985165869999999 podStartE2EDuration="1.698516587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:28:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:28:48.696470338 +0000 UTC m=+3541.648502669" watchObservedRunningTime="2026-07-28 20:28:48.698516587 +0000 UTC m=+3541.650549308"
Jul 28 20:28:59.666322 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:28:59.666277    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0fc004-9f4d4c59b-smnjg" podUID="0e19e4b6-069e-42fc-acbc-936abeded289" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.69:9004: connect: connection refused"
Jul 28 20:28:59.666749 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:28:59.666557    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0fc004-846c797d46-mdwzl"
Jul 28 20:29:09.664771 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:09.664736    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0fc004-9f4d4c59b-smnjg"
Jul 28 20:29:12.450173 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:12.450140    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0fc004-w8l4p"]
Jul 28 20:29:12.453681 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:12.453662    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0fc004-w8l4p"
Jul 28 20:29:12.456743 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:12.456717    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z6zs4\""
Jul 28 20:29:12.479645 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:12.479620    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0fc004-w8l4p"]
Jul 28 20:29:12.521166 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:12.521134    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15d85487-0aa5-42cb-951f-db57c80a9a79-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-0fc004-w8l4p\" (UID: \"15d85487-0aa5-42cb-951f-db57c80a9a79\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0fc004-w8l4p"
Jul 28 20:29:12.621883 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:12.621845    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15d85487-0aa5-42cb-951f-db57c80a9a79-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-0fc004-w8l4p\" (UID: \"15d85487-0aa5-42cb-951f-db57c80a9a79\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0fc004-w8l4p"
Jul 28 20:29:12.622573 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:12.622551    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15d85487-0aa5-42cb-951f-db57c80a9a79-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-0fc004-w8l4p\" (UID: \"15d85487-0aa5-42cb-951f-db57c80a9a79\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0fc004-w8l4p"
Jul 28 20:29:12.763868 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:12.763781    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0fc004-w8l4p"
Jul 28 20:29:12.923617 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:12.923593    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0fc004-w8l4p"]
Jul 28 20:29:12.926125 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:29:12.926092    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15d85487_0aa5_42cb_951f_db57c80a9a79.slice/crio-30e5996ae01ffe9a25528d23fc0fd1f574034f9b10053b1c1d78a6fb1a115eda WatchSource:0}: Error finding container 30e5996ae01ffe9a25528d23fc0fd1f574034f9b10053b1c1d78a6fb1a115eda: Status 404 returned error can't find the container with id 30e5996ae01ffe9a25528d23fc0fd1f574034f9b10053b1c1d78a6fb1a115eda
Jul 28 20:29:13.781627 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:13.781590    2570 generic.go:356] "Generic (PLEG): container finished" podID="15d85487-0aa5-42cb-951f-db57c80a9a79" containerID="b6c7e2b7623b32c6d590ba45a42c9744d2faae0275d4c726308cae1ea9795c7a" exitCode=0
Jul 28 20:29:13.782034 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:13.781671    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0fc004-w8l4p" event={"ID":"15d85487-0aa5-42cb-951f-db57c80a9a79","Type":"ContainerDied","Data":"b6c7e2b7623b32c6d590ba45a42c9744d2faae0275d4c726308cae1ea9795c7a"}
Jul 28 20:29:13.782034 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:13.781720    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0fc004-w8l4p" event={"ID":"15d85487-0aa5-42cb-951f-db57c80a9a79","Type":"ContainerStarted","Data":"30e5996ae01ffe9a25528d23fc0fd1f574034f9b10053b1c1d78a6fb1a115eda"}
Jul 28 20:29:14.921378 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:14.921355    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0fc004-w8l4p"
Jul 28 20:29:15.048113 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:15.048029    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15d85487-0aa5-42cb-951f-db57c80a9a79-maas-api-service-ca\") pod \"15d85487-0aa5-42cb-951f-db57c80a9a79\" (UID: \"15d85487-0aa5-42cb-951f-db57c80a9a79\") "
Jul 28 20:29:15.048397 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:15.048375    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15d85487-0aa5-42cb-951f-db57c80a9a79-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "15d85487-0aa5-42cb-951f-db57c80a9a79" (UID: "15d85487-0aa5-42cb-951f-db57c80a9a79"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:29:15.149220 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:15.149183    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15d85487-0aa5-42cb-951f-db57c80a9a79-maas-api-service-ca\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:29:15.792254 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:15.792227    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0fc004-w8l4p"
Jul 28 20:29:15.792254 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:15.792239    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0fc004-w8l4p" event={"ID":"15d85487-0aa5-42cb-951f-db57c80a9a79","Type":"ContainerDied","Data":"30e5996ae01ffe9a25528d23fc0fd1f574034f9b10053b1c1d78a6fb1a115eda"}
Jul 28 20:29:15.792473 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:15.792288    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30e5996ae01ffe9a25528d23fc0fd1f574034f9b10053b1c1d78a6fb1a115eda"
Jul 28 20:29:17.663970 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:17.663926    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-0fc004-846c797d46-mdwzl"]
Jul 28 20:29:17.664438 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:17.664234    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0fc004-846c797d46-mdwzl" podUID="f0b954b2-c9e6-4554-86c7-137dd510d59c" containerName="payload-processing" containerID="cri-o://1c2a17015355d176e164adfb9f49137b986aa40374479a4132e208eee467db5d" gracePeriod=30
Jul 28 20:29:17.672798 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:17.672762    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0fc004-9f4d4c59b-smnjg"]
Jul 28 20:29:17.673347 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:17.673002    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0fc004-9f4d4c59b-smnjg" podUID="0e19e4b6-069e-42fc-acbc-936abeded289" containerName="payload-pre-processing" containerID="cri-o://7a814e5ae59a92f1425e97c0b38b3c9befd66e3a9fd71a409418220543c0a056" gracePeriod=30
Jul 28 20:29:17.805104 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:17.805068    2570 generic.go:356] "Generic (PLEG): container finished" podID="0e19e4b6-069e-42fc-acbc-936abeded289" containerID="7a814e5ae59a92f1425e97c0b38b3c9befd66e3a9fd71a409418220543c0a056" exitCode=0
Jul 28 20:29:17.805346 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:17.805149    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0fc004-9f4d4c59b-smnjg" event={"ID":"0e19e4b6-069e-42fc-acbc-936abeded289","Type":"ContainerDied","Data":"7a814e5ae59a92f1425e97c0b38b3c9befd66e3a9fd71a409418220543c0a056"}
Jul 28 20:29:17.806859 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:17.806831    2570 generic.go:356] "Generic (PLEG): container finished" podID="f0b954b2-c9e6-4554-86c7-137dd510d59c" containerID="1c2a17015355d176e164adfb9f49137b986aa40374479a4132e208eee467db5d" exitCode=0
Jul 28 20:29:17.806996 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:17.806884    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0fc004-846c797d46-mdwzl" event={"ID":"f0b954b2-c9e6-4554-86c7-137dd510d59c","Type":"ContainerDied","Data":"1c2a17015355d176e164adfb9f49137b986aa40374479a4132e208eee467db5d"}
Jul 28 20:29:17.829164 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:17.828557    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0fc004-w8l4p"]
Jul 28 20:29:17.830706 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:17.830681    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0fc004-w8l4p"]
Jul 28 20:29:17.932255 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:17.932231    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0fc004-846c797d46-mdwzl"
Jul 28 20:29:17.960731 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:17.960700    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0fc004-9f4d4c59b-smnjg"
Jul 28 20:29:17.978264 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:17.978239    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0b954b2-c9e6-4554-86c7-137dd510d59c-plugins-config-volume\") pod \"f0b954b2-c9e6-4554-86c7-137dd510d59c\" (UID: \"f0b954b2-c9e6-4554-86c7-137dd510d59c\") "
Jul 28 20:29:17.978448 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:17.978291    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddv77\" (UniqueName: \"kubernetes.io/projected/f0b954b2-c9e6-4554-86c7-137dd510d59c-kube-api-access-ddv77\") pod \"f0b954b2-c9e6-4554-86c7-137dd510d59c\" (UID: \"f0b954b2-c9e6-4554-86c7-137dd510d59c\") "
Jul 28 20:29:17.978712 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:17.978667    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0b954b2-c9e6-4554-86c7-137dd510d59c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f0b954b2-c9e6-4554-86c7-137dd510d59c" (UID: "f0b954b2-c9e6-4554-86c7-137dd510d59c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:29:17.980696 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:17.980671    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0b954b2-c9e6-4554-86c7-137dd510d59c-kube-api-access-ddv77" (OuterVolumeSpecName: "kube-api-access-ddv77") pod "f0b954b2-c9e6-4554-86c7-137dd510d59c" (UID: "f0b954b2-c9e6-4554-86c7-137dd510d59c"). InnerVolumeSpecName "kube-api-access-ddv77". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:29:18.079864 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:18.079829    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gk6fs\" (UniqueName: \"kubernetes.io/projected/0e19e4b6-069e-42fc-acbc-936abeded289-kube-api-access-gk6fs\") pod \"0e19e4b6-069e-42fc-acbc-936abeded289\" (UID: \"0e19e4b6-069e-42fc-acbc-936abeded289\") "
Jul 28 20:29:18.080085 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:18.079871    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e19e4b6-069e-42fc-acbc-936abeded289-plugins-config-volume\") pod \"0e19e4b6-069e-42fc-acbc-936abeded289\" (UID: \"0e19e4b6-069e-42fc-acbc-936abeded289\") "
Jul 28 20:29:18.080239 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:18.080221    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0b954b2-c9e6-4554-86c7-137dd510d59c-plugins-config-volume\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:29:18.080311 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:18.080243    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddv77\" (UniqueName: \"kubernetes.io/projected/f0b954b2-c9e6-4554-86c7-137dd510d59c-kube-api-access-ddv77\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:29:18.080311 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:18.080261    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e19e4b6-069e-42fc-acbc-936abeded289-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0e19e4b6-069e-42fc-acbc-936abeded289" (UID: "0e19e4b6-069e-42fc-acbc-936abeded289"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:29:18.082009 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:18.081984    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e19e4b6-069e-42fc-acbc-936abeded289-kube-api-access-gk6fs" (OuterVolumeSpecName: "kube-api-access-gk6fs") pod "0e19e4b6-069e-42fc-acbc-936abeded289" (UID: "0e19e4b6-069e-42fc-acbc-936abeded289"). InnerVolumeSpecName "kube-api-access-gk6fs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:29:18.181243 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:18.181160    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gk6fs\" (UniqueName: \"kubernetes.io/projected/0e19e4b6-069e-42fc-acbc-936abeded289-kube-api-access-gk6fs\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:29:18.181243 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:18.181189    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e19e4b6-069e-42fc-acbc-936abeded289-plugins-config-volume\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:29:18.812610 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:18.812547    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0fc004-9f4d4c59b-smnjg"
Jul 28 20:29:18.813313 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:18.812553    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0fc004-9f4d4c59b-smnjg" event={"ID":"0e19e4b6-069e-42fc-acbc-936abeded289","Type":"ContainerDied","Data":"7603d8cc7559cce7a4afc1b1462004c7ee8c9813dc01129030d4114d63618987"}
Jul 28 20:29:18.813313 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:18.812677    2570 scope.go:117] "RemoveContainer" containerID="7a814e5ae59a92f1425e97c0b38b3c9befd66e3a9fd71a409418220543c0a056"
Jul 28 20:29:18.814364 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:18.814025    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0fc004-846c797d46-mdwzl" event={"ID":"f0b954b2-c9e6-4554-86c7-137dd510d59c","Type":"ContainerDied","Data":"a8589a3ed7b1c82828627b50edb955158976de07edc74646a5dfef4045614ce2"}
Jul 28 20:29:18.814364 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:18.814066    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0fc004-846c797d46-mdwzl"
Jul 28 20:29:18.822458 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:18.822436    2570 scope.go:117] "RemoveContainer" containerID="1c2a17015355d176e164adfb9f49137b986aa40374479a4132e208eee467db5d"
Jul 28 20:29:18.835104 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:18.835082    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0fc004-9f4d4c59b-smnjg"]
Jul 28 20:29:18.838764 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:18.838740    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0fc004-9f4d4c59b-smnjg"]
Jul 28 20:29:18.853328 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:18.853298    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-0fc004-846c797d46-mdwzl"]
Jul 28 20:29:18.858859 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:18.858827    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-0fc004-846c797d46-mdwzl"]
Jul 28 20:29:19.572797 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:19.572761    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e19e4b6-069e-42fc-acbc-936abeded289" path="/var/lib/kubelet/pods/0e19e4b6-069e-42fc-acbc-936abeded289/volumes"
Jul 28 20:29:19.573123 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:19.573109    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15d85487-0aa5-42cb-951f-db57c80a9a79" path="/var/lib/kubelet/pods/15d85487-0aa5-42cb-951f-db57c80a9a79/volumes"
Jul 28 20:29:19.573430 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:19.573418    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0b954b2-c9e6-4554-86c7-137dd510d59c" path="/var/lib/kubelet/pods/f0b954b2-c9e6-4554-86c7-137dd510d59c/volumes"
Jul 28 20:29:43.703243 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:43.703206    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-06df9a-6599768986-6px7b"]
Jul 28 20:29:43.704161 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:43.704123    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-06df9a-6599768986-6px7b" podUID="a88a3092-8ef9-4134-afa7-6590d62ad5b8" containerName="payload-processing" containerID="cri-o://29bd187357475073151dfaf9b2ea21463b5159a9b85db2d495481010b351b466" gracePeriod=30
Jul 28 20:29:43.712108 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:43.712074    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-06df9a-c799676fb-85p9f"]
Jul 28 20:29:43.712380 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:43.712322    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-06df9a-c799676fb-85p9f" podUID="8a199a2b-339d-4429-8dac-80f027882b09" containerName="payload-pre-processing" containerID="cri-o://0757aeb60f8ad6e4a5e968702d71cb333a0fbf311c4dddc9c6f835f51a714cd6" gracePeriod=30
Jul 28 20:29:43.935024 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:43.934967    2570 generic.go:356] "Generic (PLEG): container finished" podID="a88a3092-8ef9-4134-afa7-6590d62ad5b8" containerID="29bd187357475073151dfaf9b2ea21463b5159a9b85db2d495481010b351b466" exitCode=0
Jul 28 20:29:43.935151 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:43.935019    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-06df9a-6599768986-6px7b" event={"ID":"a88a3092-8ef9-4134-afa7-6590d62ad5b8","Type":"ContainerDied","Data":"29bd187357475073151dfaf9b2ea21463b5159a9b85db2d495481010b351b466"}
Jul 28 20:29:43.936936 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:43.936898    2570 generic.go:356] "Generic (PLEG): container finished" podID="8a199a2b-339d-4429-8dac-80f027882b09" containerID="0757aeb60f8ad6e4a5e968702d71cb333a0fbf311c4dddc9c6f835f51a714cd6" exitCode=0
Jul 28 20:29:43.937106 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:43.936945    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-06df9a-c799676fb-85p9f" event={"ID":"8a199a2b-339d-4429-8dac-80f027882b09","Type":"ContainerDied","Data":"0757aeb60f8ad6e4a5e968702d71cb333a0fbf311c4dddc9c6f835f51a714cd6"}
Jul 28 20:29:43.977668 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:43.977642    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-06df9a-6599768986-6px7b"
Jul 28 20:29:44.002050 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:44.002018    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-06df9a-c799676fb-85p9f"
Jul 28 20:29:44.020137 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:44.020111    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a199a2b-339d-4429-8dac-80f027882b09-plugins-config-volume\") pod \"8a199a2b-339d-4429-8dac-80f027882b09\" (UID: \"8a199a2b-339d-4429-8dac-80f027882b09\") "
Jul 28 20:29:44.020137 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:44.020148    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a88a3092-8ef9-4134-afa7-6590d62ad5b8-plugins-config-volume\") pod \"a88a3092-8ef9-4134-afa7-6590d62ad5b8\" (UID: \"a88a3092-8ef9-4134-afa7-6590d62ad5b8\") "
Jul 28 20:29:44.020463 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:44.020215    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7ppr\" (UniqueName: \"kubernetes.io/projected/8a199a2b-339d-4429-8dac-80f027882b09-kube-api-access-p7ppr\") pod \"8a199a2b-339d-4429-8dac-80f027882b09\" (UID: \"8a199a2b-339d-4429-8dac-80f027882b09\") "
Jul 28 20:29:44.020633 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:44.020578    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a199a2b-339d-4429-8dac-80f027882b09-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8a199a2b-339d-4429-8dac-80f027882b09" (UID: "8a199a2b-339d-4429-8dac-80f027882b09"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:29:44.020814 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:44.020792    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a88a3092-8ef9-4134-afa7-6590d62ad5b8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a88a3092-8ef9-4134-afa7-6590d62ad5b8" (UID: "a88a3092-8ef9-4134-afa7-6590d62ad5b8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:29:44.022756 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:44.022731    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a199a2b-339d-4429-8dac-80f027882b09-kube-api-access-p7ppr" (OuterVolumeSpecName: "kube-api-access-p7ppr") pod "8a199a2b-339d-4429-8dac-80f027882b09" (UID: "8a199a2b-339d-4429-8dac-80f027882b09"). InnerVolumeSpecName "kube-api-access-p7ppr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:29:44.121040 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:44.121002    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5w8hv\" (UniqueName: \"kubernetes.io/projected/a88a3092-8ef9-4134-afa7-6590d62ad5b8-kube-api-access-5w8hv\") pod \"a88a3092-8ef9-4134-afa7-6590d62ad5b8\" (UID: \"a88a3092-8ef9-4134-afa7-6590d62ad5b8\") "
Jul 28 20:29:44.121234 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:44.121213    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a88a3092-8ef9-4134-afa7-6590d62ad5b8-plugins-config-volume\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:29:44.121234 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:44.121225    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7ppr\" (UniqueName: \"kubernetes.io/projected/8a199a2b-339d-4429-8dac-80f027882b09-kube-api-access-p7ppr\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:29:44.121234 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:44.121236    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a199a2b-339d-4429-8dac-80f027882b09-plugins-config-volume\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:29:44.123101 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:44.123075    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a88a3092-8ef9-4134-afa7-6590d62ad5b8-kube-api-access-5w8hv" (OuterVolumeSpecName: "kube-api-access-5w8hv") pod "a88a3092-8ef9-4134-afa7-6590d62ad5b8" (UID: "a88a3092-8ef9-4134-afa7-6590d62ad5b8"). InnerVolumeSpecName "kube-api-access-5w8hv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:29:44.222218 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:44.222134    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5w8hv\" (UniqueName: \"kubernetes.io/projected/a88a3092-8ef9-4134-afa7-6590d62ad5b8-kube-api-access-5w8hv\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:29:44.943108 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:44.943080    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-06df9a-c799676fb-85p9f"
Jul 28 20:29:44.943578 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:44.943116    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-06df9a-c799676fb-85p9f" event={"ID":"8a199a2b-339d-4429-8dac-80f027882b09","Type":"ContainerDied","Data":"fa938ed0267b19de610583e0c5b07ca1045a26976024a36a7066b77750172aca"}
Jul 28 20:29:44.943578 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:44.943180    2570 scope.go:117] "RemoveContainer" containerID="0757aeb60f8ad6e4a5e968702d71cb333a0fbf311c4dddc9c6f835f51a714cd6"
Jul 28 20:29:44.944553 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:44.944477    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-06df9a-6599768986-6px7b" event={"ID":"a88a3092-8ef9-4134-afa7-6590d62ad5b8","Type":"ContainerDied","Data":"d2fd68c42360ab8bd23f86bf0759f96a9e6441895d44c547f83b083763b8b851"}
Jul 28 20:29:44.944553 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:44.944494    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-06df9a-6599768986-6px7b"
Jul 28 20:29:44.953172 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:44.953135    2570 scope.go:117] "RemoveContainer" containerID="29bd187357475073151dfaf9b2ea21463b5159a9b85db2d495481010b351b466"
Jul 28 20:29:44.968760 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:44.968736    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-06df9a-c799676fb-85p9f"]
Jul 28 20:29:44.973071 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:44.973011    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-06df9a-c799676fb-85p9f"]
Jul 28 20:29:44.982944 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:44.982922    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-06df9a-6599768986-6px7b"]
Jul 28 20:29:44.986725 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:44.986704    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-06df9a-6599768986-6px7b"]
Jul 28 20:29:45.573131 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:45.573052    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a199a2b-339d-4429-8dac-80f027882b09" path="/var/lib/kubelet/pods/8a199a2b-339d-4429-8dac-80f027882b09/volumes"
Jul 28 20:29:45.573432 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:29:45.573419    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a88a3092-8ef9-4134-afa7-6590d62ad5b8" path="/var/lib/kubelet/pods/a88a3092-8ef9-4134-afa7-6590d62ad5b8/volumes"
Jul 28 20:30:00.139991 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:00.139950    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754510-25c29"]
Jul 28 20:30:00.140489 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:00.140313    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a88a3092-8ef9-4134-afa7-6590d62ad5b8" containerName="payload-processing"
Jul 28 20:30:00.140489 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:00.140366    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a88a3092-8ef9-4134-afa7-6590d62ad5b8" containerName="payload-processing"
Jul 28 20:30:00.140489 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:00.140390    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15d85487-0aa5-42cb-951f-db57c80a9a79" containerName="revoke-keys"
Jul 28 20:30:00.140489 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:00.140400    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="15d85487-0aa5-42cb-951f-db57c80a9a79" containerName="revoke-keys"
Jul 28 20:30:00.140489 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:00.140447    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e19e4b6-069e-42fc-acbc-936abeded289" containerName="payload-pre-processing"
Jul 28 20:30:00.140489 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:00.140458    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e19e4b6-069e-42fc-acbc-936abeded289" containerName="payload-pre-processing"
Jul 28 20:30:00.140489 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:00.140467    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0b954b2-c9e6-4554-86c7-137dd510d59c" containerName="payload-processing"
Jul 28 20:30:00.140489 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:00.140476    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0b954b2-c9e6-4554-86c7-137dd510d59c" containerName="payload-processing"
Jul 28 20:30:00.140489 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:00.140491    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a199a2b-339d-4429-8dac-80f027882b09" containerName="payload-pre-processing"
Jul 28 20:30:00.140948 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:00.140501    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a199a2b-339d-4429-8dac-80f027882b09" containerName="payload-pre-processing"
Jul 28 20:30:00.140948 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:00.140620    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="15d85487-0aa5-42cb-951f-db57c80a9a79" containerName="revoke-keys"
Jul 28 20:30:00.140948 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:00.140632    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a199a2b-339d-4429-8dac-80f027882b09" containerName="payload-pre-processing"
Jul 28 20:30:00.140948 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:00.140641    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a88a3092-8ef9-4134-afa7-6590d62ad5b8" containerName="payload-processing"
Jul 28 20:30:00.140948 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:00.140654    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e19e4b6-069e-42fc-acbc-936abeded289" containerName="payload-pre-processing"
Jul 28 20:30:00.140948 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:00.140664    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0b954b2-c9e6-4554-86c7-137dd510d59c" containerName="payload-processing"
Jul 28 20:30:00.145448 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:00.145427    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c38c57-29754510-rk745"]
Jul 28 20:30:00.145590 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:00.145538    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754510-25c29"
Jul 28 20:30:00.148093 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:00.148072    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z6zs4\""
Jul 28 20:30:00.148917 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:00.148893    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d170bd-29754510-xms9q"]
Jul 28 20:30:00.149889 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:00.149864    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c38c57-29754510-rk745"
Jul 28 20:30:00.152827 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:00.152809    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-426065-29754510-j7dgw"]
Jul 28 20:30:00.154627 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:00.153024    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d170bd-29754510-xms9q"
Jul 28 20:30:00.156766 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:00.156741    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754510-25c29"]
Jul 28 20:30:00.156868 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:00.156787    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c38c57-29754510-rk745"]
Jul 28 20:30:00.156938 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:00.156877    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-426065-29754510-j7dgw"
Jul 28 20:30:00.157484 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:00.157461    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d170bd-29754510-xms9q"]
Jul 28 20:30:00.160020 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:00.160002    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754510-25c29"
Jul 28 20:30:00.175680 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:00.175654    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c38c57-29754510-rk745"
Jul 28 20:30:00.176968 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:00.176944    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-426065-29754510-j7dgw"]
Jul 28 20:30:00.214199 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:00.214175    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d170bd-29754510-xms9q"
Jul 28 20:30:00.221024 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:00.220999    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-426065-29754510-j7dgw"
Jul 28 20:30:00.345272 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:00.344559    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754510-25c29"]
Jul 28 20:30:00.348911 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:30:00.348873    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18912c3d_6e0a_459e_9659_ecaf08da454b.slice/crio-ed3e8334263ea70a38e053013ec0883baccca03b72185c3c57c17bf10456230a WatchSource:0}: Error finding container ed3e8334263ea70a38e053013ec0883baccca03b72185c3c57c17bf10456230a: Status 404 returned error can't find the container with id ed3e8334263ea70a38e053013ec0883baccca03b72185c3c57c17bf10456230a
Jul 28 20:30:00.418236 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:00.418204    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-426065-29754510-j7dgw"]
Jul 28 20:30:00.421409 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:30:00.421383    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f7c2a87_acb5_4316_8bc7_9ad42fb442d4.slice/crio-84d04562702a2071be316a56f9ffe107fac637d3d105568ef4e08c6b3856ae42 WatchSource:0}: Error finding container 84d04562702a2071be316a56f9ffe107fac637d3d105568ef4e08c6b3856ae42: Status 404 returned error can't find the container with id 84d04562702a2071be316a56f9ffe107fac637d3d105568ef4e08c6b3856ae42
Jul 28 20:30:00.578733 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:00.578699    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c38c57-29754510-rk745"]
Jul 28 20:30:00.581541 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:30:00.581511    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc979daa8_7149_4267_a9e0_737e5197f0b1.slice/crio-643fe12042cd15f0b0a6eaf484206329c487dd1ef8629d20f9da4014af706470 WatchSource:0}: Error finding container 643fe12042cd15f0b0a6eaf484206329c487dd1ef8629d20f9da4014af706470: Status 404 returned error can't find the container with id 643fe12042cd15f0b0a6eaf484206329c487dd1ef8629d20f9da4014af706470
Jul 28 20:30:00.604550 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:00.604526    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d170bd-29754510-xms9q"]
Jul 28 20:30:00.606480 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:30:00.606446    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86297d19_d2e6_41f5_9199_1c0ad9ced636.slice/crio-74c7135652838046e2b9489f7045338b921d26ebc93df088337976cf1204b480 WatchSource:0}: Error finding container 74c7135652838046e2b9489f7045338b921d26ebc93df088337976cf1204b480: Status 404 returned error can't find the container with id 74c7135652838046e2b9489f7045338b921d26ebc93df088337976cf1204b480
Jul 28 20:30:01.020993 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:01.020879    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c38c57-29754510-rk745" event={"ID":"c979daa8-7149-4267-a9e0-737e5197f0b1","Type":"ContainerStarted","Data":"b5830182991bfe87b413374bf87ecb5f6b34ecbbcc726399c034122f87ede81a"}
Jul 28 20:30:01.020993 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:01.020946    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c38c57-29754510-rk745" event={"ID":"c979daa8-7149-4267-a9e0-737e5197f0b1","Type":"ContainerStarted","Data":"643fe12042cd15f0b0a6eaf484206329c487dd1ef8629d20f9da4014af706470"}
Jul 28 20:30:01.022439 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:01.022408    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d170bd-29754510-xms9q" event={"ID":"86297d19-d2e6-41f5-9199-1c0ad9ced636","Type":"ContainerStarted","Data":"12e883e5e9613bcca766bf0ce1c57f714ad284ab2327a01471546b3f3881d5cb"}
Jul 28 20:30:01.022568 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:01.022458    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d170bd-29754510-xms9q" event={"ID":"86297d19-d2e6-41f5-9199-1c0ad9ced636","Type":"ContainerStarted","Data":"74c7135652838046e2b9489f7045338b921d26ebc93df088337976cf1204b480"}
Jul 28 20:30:01.023754 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:01.023730    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-426065-29754510-j7dgw" event={"ID":"1f7c2a87-acb5-4316-8bc7-9ad42fb442d4","Type":"ContainerStarted","Data":"8b00d93e2211c23d2a00d25c93c0a5c5528575e62fb916e8844d65c58fed3265"}
Jul 28 20:30:01.023864 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:01.023774    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-426065-29754510-j7dgw" event={"ID":"1f7c2a87-acb5-4316-8bc7-9ad42fb442d4","Type":"ContainerStarted","Data":"84d04562702a2071be316a56f9ffe107fac637d3d105568ef4e08c6b3856ae42"}
Jul 28 20:30:01.025035 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:01.025014    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754510-25c29" event={"ID":"18912c3d-6e0a-459e-9659-ecaf08da454b","Type":"ContainerStarted","Data":"9f389a6e1bd0debd34eb03493732bc422c530af753d87ae87dcdc3e6f3a9affc"}
Jul 28 20:30:01.025108 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:01.025051    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754510-25c29" event={"ID":"18912c3d-6e0a-459e-9659-ecaf08da454b","Type":"ContainerStarted","Data":"ed3e8334263ea70a38e053013ec0883baccca03b72185c3c57c17bf10456230a"}
Jul 28 20:30:01.051771 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:01.051725    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c38c57-29754510-rk745" podStartSLOduration=1.051712062 podStartE2EDuration="1.051712062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:30:01.049811017 +0000 UTC m=+3614.001843350" watchObservedRunningTime="2026-07-28 20:30:01.051712062 +0000 UTC m=+3614.003744389"
Jul 28 20:30:01.076551 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:01.076510    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d170bd-29754510-xms9q" podStartSLOduration=1.076497088 podStartE2EDuration="1.076497088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:30:01.076330594 +0000 UTC m=+3614.028362924" watchObservedRunningTime="2026-07-28 20:30:01.076497088 +0000 UTC m=+3614.028529418"
Jul 28 20:30:01.136231 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:01.136177    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754510-25c29" podStartSLOduration=1.136157978 podStartE2EDuration="1.136157978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:30:01.104082726 +0000 UTC m=+3614.056115058" watchObservedRunningTime="2026-07-28 20:30:01.136157978 +0000 UTC m=+3614.088190349"
Jul 28 20:30:01.136402 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:01.136288    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-426065-29754510-j7dgw" podStartSLOduration=1.136284691 podStartE2EDuration="1.136284691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:30:01.134264592 +0000 UTC m=+3614.086296922" watchObservedRunningTime="2026-07-28 20:30:01.136284691 +0000 UTC m=+3614.088317060"
Jul 28 20:30:02.030606 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:02.030521    2570 generic.go:356] "Generic (PLEG): container finished" podID="c979daa8-7149-4267-a9e0-737e5197f0b1" containerID="b5830182991bfe87b413374bf87ecb5f6b34ecbbcc726399c034122f87ede81a" exitCode=0
Jul 28 20:30:02.031042 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:02.030612    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c38c57-29754510-rk745" event={"ID":"c979daa8-7149-4267-a9e0-737e5197f0b1","Type":"ContainerDied","Data":"b5830182991bfe87b413374bf87ecb5f6b34ecbbcc726399c034122f87ede81a"}
Jul 28 20:30:02.032026 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:02.032005    2570 generic.go:356] "Generic (PLEG): container finished" podID="86297d19-d2e6-41f5-9199-1c0ad9ced636" containerID="12e883e5e9613bcca766bf0ce1c57f714ad284ab2327a01471546b3f3881d5cb" exitCode=0
Jul 28 20:30:02.032119 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:02.032081    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d170bd-29754510-xms9q" event={"ID":"86297d19-d2e6-41f5-9199-1c0ad9ced636","Type":"ContainerDied","Data":"12e883e5e9613bcca766bf0ce1c57f714ad284ab2327a01471546b3f3881d5cb"}
Jul 28 20:30:02.039231 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:02.039208    2570 generic.go:356] "Generic (PLEG): container finished" podID="1f7c2a87-acb5-4316-8bc7-9ad42fb442d4" containerID="8b00d93e2211c23d2a00d25c93c0a5c5528575e62fb916e8844d65c58fed3265" exitCode=0
Jul 28 20:30:02.039373 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:02.039283    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-426065-29754510-j7dgw" event={"ID":"1f7c2a87-acb5-4316-8bc7-9ad42fb442d4","Type":"ContainerDied","Data":"8b00d93e2211c23d2a00d25c93c0a5c5528575e62fb916e8844d65c58fed3265"}
Jul 28 20:30:02.040611 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:02.040591    2570 generic.go:356] "Generic (PLEG): container finished" podID="18912c3d-6e0a-459e-9659-ecaf08da454b" containerID="9f389a6e1bd0debd34eb03493732bc422c530af753d87ae87dcdc3e6f3a9affc" exitCode=0
Jul 28 20:30:02.040714 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:02.040618    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754510-25c29" event={"ID":"18912c3d-6e0a-459e-9659-ecaf08da454b","Type":"ContainerDied","Data":"9f389a6e1bd0debd34eb03493732bc422c530af753d87ae87dcdc3e6f3a9affc"}
Jul 28 20:30:03.226768 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:03.226734    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c38c57-29754510-rk745"
Jul 28 20:30:03.230887 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:03.230861    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d170bd-29754510-xms9q"
Jul 28 20:30:03.285999 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:03.285951    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-426065-29754510-j7dgw"
Jul 28 20:30:03.289039 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:03.289005    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754510-25c29"
Jul 28 20:30:04.055455 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:04.055426    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d170bd-29754510-xms9q"
Jul 28 20:30:04.055651 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:04.055456    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d170bd-29754510-xms9q" event={"ID":"86297d19-d2e6-41f5-9199-1c0ad9ced636","Type":"ContainerDied","Data":"74c7135652838046e2b9489f7045338b921d26ebc93df088337976cf1204b480"}
Jul 28 20:30:04.055651 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:04.055511    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="74c7135652838046e2b9489f7045338b921d26ebc93df088337976cf1204b480"
Jul 28 20:30:04.056811 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:04.056790    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-426065-29754510-j7dgw"
Jul 28 20:30:04.056954 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:04.056830    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-426065-29754510-j7dgw" event={"ID":"1f7c2a87-acb5-4316-8bc7-9ad42fb442d4","Type":"ContainerDied","Data":"84d04562702a2071be316a56f9ffe107fac637d3d105568ef4e08c6b3856ae42"}
Jul 28 20:30:04.056954 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:04.056864    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="84d04562702a2071be316a56f9ffe107fac637d3d105568ef4e08c6b3856ae42"
Jul 28 20:30:04.058379 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:04.058361    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754510-25c29"
Jul 28 20:30:04.058525 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:04.058361    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754510-25c29" event={"ID":"18912c3d-6e0a-459e-9659-ecaf08da454b","Type":"ContainerDied","Data":"ed3e8334263ea70a38e053013ec0883baccca03b72185c3c57c17bf10456230a"}
Jul 28 20:30:04.058525 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:04.058474    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed3e8334263ea70a38e053013ec0883baccca03b72185c3c57c17bf10456230a"
Jul 28 20:30:04.059816 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:04.059791    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c38c57-29754510-rk745" event={"ID":"c979daa8-7149-4267-a9e0-737e5197f0b1","Type":"ContainerDied","Data":"643fe12042cd15f0b0a6eaf484206329c487dd1ef8629d20f9da4014af706470"}
Jul 28 20:30:04.059816 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:04.059810    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c38c57-29754510-rk745"
Jul 28 20:30:04.059952 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:04.059840    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="643fe12042cd15f0b0a6eaf484206329c487dd1ef8629d20f9da4014af706470"
Jul 28 20:30:04.364084 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:04.364000    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754465-z8h6d"]
Jul 28 20:30:04.367712 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:04.367686    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754465-z8h6d"]
Jul 28 20:30:05.573511 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:05.573477    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86dcda99-9c03-48b2-8ed3-0f5b9a36fd02" path="/var/lib/kubelet/pods/86dcda99-9c03-48b2-8ed3-0f5b9a36fd02/volumes"
Jul 28 20:30:32.647421 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:32.647381    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-426065-7gpw7"]
Jul 28 20:30:32.647915 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:32.647718    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f7c2a87-acb5-4316-8bc7-9ad42fb442d4" containerName="cleanup"
Jul 28 20:30:32.647915 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:32.647729    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f7c2a87-acb5-4316-8bc7-9ad42fb442d4" containerName="cleanup"
Jul 28 20:30:32.647915 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:32.647744    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c979daa8-7149-4267-a9e0-737e5197f0b1" containerName="cleanup"
Jul 28 20:30:32.647915 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:32.647750    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c979daa8-7149-4267-a9e0-737e5197f0b1" containerName="cleanup"
Jul 28 20:30:32.647915 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:32.647759    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86297d19-d2e6-41f5-9199-1c0ad9ced636" containerName="cleanup"
Jul 28 20:30:32.647915 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:32.647764    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="86297d19-d2e6-41f5-9199-1c0ad9ced636" containerName="cleanup"
Jul 28 20:30:32.647915 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:32.647778    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18912c3d-6e0a-459e-9659-ecaf08da454b" containerName="cleanup"
Jul 28 20:30:32.647915 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:32.647783    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="18912c3d-6e0a-459e-9659-ecaf08da454b" containerName="cleanup"
Jul 28 20:30:32.647915 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:32.647831    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="18912c3d-6e0a-459e-9659-ecaf08da454b" containerName="cleanup"
Jul 28 20:30:32.647915 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:32.647840    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f7c2a87-acb5-4316-8bc7-9ad42fb442d4" containerName="cleanup"
Jul 28 20:30:32.647915 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:32.647846    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c979daa8-7149-4267-a9e0-737e5197f0b1" containerName="cleanup"
Jul 28 20:30:32.647915 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:32.647854    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="86297d19-d2e6-41f5-9199-1c0ad9ced636" containerName="cleanup"
Jul 28 20:30:32.650940 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:32.650922    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-426065-7gpw7"
Jul 28 20:30:32.653813 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:32.653788    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z6zs4\""
Jul 28 20:30:32.664456 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:32.664427    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f27894a-de6e-4510-bc97-30b63731c24d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-426065-7gpw7\" (UID: \"2f27894a-de6e-4510-bc97-30b63731c24d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-426065-7gpw7"
Jul 28 20:30:32.667634 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:32.667608    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-426065-7gpw7"]
Jul 28 20:30:32.765667 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:32.765621    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f27894a-de6e-4510-bc97-30b63731c24d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-426065-7gpw7\" (UID: \"2f27894a-de6e-4510-bc97-30b63731c24d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-426065-7gpw7"
Jul 28 20:30:32.766283 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:32.766262    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f27894a-de6e-4510-bc97-30b63731c24d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-426065-7gpw7\" (UID: \"2f27894a-de6e-4510-bc97-30b63731c24d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-426065-7gpw7"
Jul 28 20:30:32.966062 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:32.966023    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-426065-7gpw7"
Jul 28 20:30:33.112647 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:33.112621    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-426065-7gpw7"]
Jul 28 20:30:33.114859 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:30:33.114830    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f27894a_de6e_4510_bc97_30b63731c24d.slice/crio-24533c3f9ea8bdbce0b6219e2266a24868df8b428abdc5273c142bbc356e8334 WatchSource:0}: Error finding container 24533c3f9ea8bdbce0b6219e2266a24868df8b428abdc5273c142bbc356e8334: Status 404 returned error can't find the container with id 24533c3f9ea8bdbce0b6219e2266a24868df8b428abdc5273c142bbc356e8334
Jul 28 20:30:33.205251 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:33.205215    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-426065-7gpw7" event={"ID":"2f27894a-de6e-4510-bc97-30b63731c24d","Type":"ContainerStarted","Data":"24533c3f9ea8bdbce0b6219e2266a24868df8b428abdc5273c142bbc356e8334"}
Jul 28 20:30:34.212789 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:34.212753    2570 generic.go:356] "Generic (PLEG): container finished" podID="2f27894a-de6e-4510-bc97-30b63731c24d" containerID="c21775ea7130ef1c93944e72c7327a3addb1883b4b18729ceb0c7fc637c21774" exitCode=0
Jul 28 20:30:34.213250 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:34.212846    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-426065-7gpw7" event={"ID":"2f27894a-de6e-4510-bc97-30b63731c24d","Type":"ContainerDied","Data":"c21775ea7130ef1c93944e72c7327a3addb1883b4b18729ceb0c7fc637c21774"}
Jul 28 20:30:35.354937 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:35.354910    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-426065-7gpw7"
Jul 28 20:30:35.394282 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:35.394252    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f27894a-de6e-4510-bc97-30b63731c24d-maas-api-service-ca\") pod \"2f27894a-de6e-4510-bc97-30b63731c24d\" (UID: \"2f27894a-de6e-4510-bc97-30b63731c24d\") "
Jul 28 20:30:35.394618 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:35.394595    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f27894a-de6e-4510-bc97-30b63731c24d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2f27894a-de6e-4510-bc97-30b63731c24d" (UID: "2f27894a-de6e-4510-bc97-30b63731c24d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:30:35.495881 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:35.495798    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f27894a-de6e-4510-bc97-30b63731c24d-maas-api-service-ca\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:30:36.231439 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:36.231402    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-426065-7gpw7"
Jul 28 20:30:36.231614 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:36.231404    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-426065-7gpw7" event={"ID":"2f27894a-de6e-4510-bc97-30b63731c24d","Type":"ContainerDied","Data":"24533c3f9ea8bdbce0b6219e2266a24868df8b428abdc5273c142bbc356e8334"}
Jul 28 20:30:36.231614 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:36.231520    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="24533c3f9ea8bdbce0b6219e2266a24868df8b428abdc5273c142bbc356e8334"
Jul 28 20:30:43.177456 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:43.177421    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-426065-29754510-j7dgw"]
Jul 28 20:30:43.185767 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:43.185738    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-426065-29754510-j7dgw"]
Jul 28 20:30:43.370635 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:43.370602    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-426065-7gpw7"]
Jul 28 20:30:43.372264 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:43.372240    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-426065-7gpw7"]
Jul 28 20:30:43.572896 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:43.572818    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f7c2a87-acb5-4316-8bc7-9ad42fb442d4" path="/var/lib/kubelet/pods/1f7c2a87-acb5-4316-8bc7-9ad42fb442d4/volumes"
Jul 28 20:30:43.573152 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:43.573138    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f27894a-de6e-4510-bc97-30b63731c24d" path="/var/lib/kubelet/pods/2f27894a-de6e-4510-bc97-30b63731c24d/volumes"
Jul 28 20:30:48.000178 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:30:48.000149    2570 scope.go:117] "RemoveContainer" containerID="df1d128eb7f23f27b33d57a6ed2ec5ed2421253b9e02f5b90b505d4ce3bfe447"
Jul 28 20:31:00.846313 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:00.846272    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c38c57-29754510-rk745"]
Jul 28 20:31:00.849142 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:00.849116    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c38c57-29754510-rk745"]
Jul 28 20:31:00.886532 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:00.886502    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-c38c57-75dcc74898-mplzc"]
Jul 28 20:31:00.886762 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:00.886717    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-c38c57-75dcc74898-mplzc" podUID="80108b11-28c4-4c47-b13e-79cb732806ad" containerName="payload-processing" containerID="cri-o://c500a707518c069dcf523da5049de43fec2aadc635f108ec8e174b8c899b4274" gracePeriod=30
Jul 28 20:31:00.903416 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:00.903388    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-c38c57-54f4b5977b-kzjkx"]
Jul 28 20:31:00.903616 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:00.903595    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-c38c57-54f4b5977b-kzjkx" podUID="750356bc-f340-4133-b423-9d37eaa18e68" containerName="payload-pre-processing" containerID="cri-o://c1bc97ed9f63df59990e3d07a0d10aeaf52fb524f6890d6eda1676efca73e2cd" gracePeriod=30
Jul 28 20:31:01.163948 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:01.163919    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-c38c57-75dcc74898-mplzc"
Jul 28 20:31:01.200164 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:01.200139    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-c38c57-54f4b5977b-kzjkx"
Jul 28 20:31:01.336267 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:01.336223    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44nxn\" (UniqueName: \"kubernetes.io/projected/750356bc-f340-4133-b423-9d37eaa18e68-kube-api-access-44nxn\") pod \"750356bc-f340-4133-b423-9d37eaa18e68\" (UID: \"750356bc-f340-4133-b423-9d37eaa18e68\") "
Jul 28 20:31:01.336267 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:01.336265    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/750356bc-f340-4133-b423-9d37eaa18e68-plugins-config-volume\") pod \"750356bc-f340-4133-b423-9d37eaa18e68\" (UID: \"750356bc-f340-4133-b423-9d37eaa18e68\") "
Jul 28 20:31:01.336546 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:01.336310    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tg862\" (UniqueName: \"kubernetes.io/projected/80108b11-28c4-4c47-b13e-79cb732806ad-kube-api-access-tg862\") pod \"80108b11-28c4-4c47-b13e-79cb732806ad\" (UID: \"80108b11-28c4-4c47-b13e-79cb732806ad\") "
Jul 28 20:31:01.336546 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:01.336326    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80108b11-28c4-4c47-b13e-79cb732806ad-plugins-config-volume\") pod \"80108b11-28c4-4c47-b13e-79cb732806ad\" (UID: \"80108b11-28c4-4c47-b13e-79cb732806ad\") "
Jul 28 20:31:01.336691 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:01.336664    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/750356bc-f340-4133-b423-9d37eaa18e68-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "750356bc-f340-4133-b423-9d37eaa18e68" (UID: "750356bc-f340-4133-b423-9d37eaa18e68"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:31:01.336777 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:01.336757    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80108b11-28c4-4c47-b13e-79cb732806ad-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "80108b11-28c4-4c47-b13e-79cb732806ad" (UID: "80108b11-28c4-4c47-b13e-79cb732806ad"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:31:01.338476 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:01.338456    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80108b11-28c4-4c47-b13e-79cb732806ad-kube-api-access-tg862" (OuterVolumeSpecName: "kube-api-access-tg862") pod "80108b11-28c4-4c47-b13e-79cb732806ad" (UID: "80108b11-28c4-4c47-b13e-79cb732806ad"). InnerVolumeSpecName "kube-api-access-tg862". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:31:01.338574 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:01.338548    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/750356bc-f340-4133-b423-9d37eaa18e68-kube-api-access-44nxn" (OuterVolumeSpecName: "kube-api-access-44nxn") pod "750356bc-f340-4133-b423-9d37eaa18e68" (UID: "750356bc-f340-4133-b423-9d37eaa18e68"). InnerVolumeSpecName "kube-api-access-44nxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:31:01.359585 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:01.359551    2570 generic.go:356] "Generic (PLEG): container finished" podID="80108b11-28c4-4c47-b13e-79cb732806ad" containerID="c500a707518c069dcf523da5049de43fec2aadc635f108ec8e174b8c899b4274" exitCode=0
Jul 28 20:31:01.359772 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:01.359602    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-c38c57-75dcc74898-mplzc"
Jul 28 20:31:01.359772 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:01.359641    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-c38c57-75dcc74898-mplzc" event={"ID":"80108b11-28c4-4c47-b13e-79cb732806ad","Type":"ContainerDied","Data":"c500a707518c069dcf523da5049de43fec2aadc635f108ec8e174b8c899b4274"}
Jul 28 20:31:01.359772 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:01.359705    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-c38c57-75dcc74898-mplzc" event={"ID":"80108b11-28c4-4c47-b13e-79cb732806ad","Type":"ContainerDied","Data":"b2fec0e890c2aa1479356b34146429662aca44dfe87961224757eab329a8f1e3"}
Jul 28 20:31:01.359772 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:01.359735    2570 scope.go:117] "RemoveContainer" containerID="c500a707518c069dcf523da5049de43fec2aadc635f108ec8e174b8c899b4274"
Jul 28 20:31:01.360904 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:01.360883    2570 generic.go:356] "Generic (PLEG): container finished" podID="750356bc-f340-4133-b423-9d37eaa18e68" containerID="c1bc97ed9f63df59990e3d07a0d10aeaf52fb524f6890d6eda1676efca73e2cd" exitCode=0
Jul 28 20:31:01.360969 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:01.360922    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-c38c57-54f4b5977b-kzjkx" event={"ID":"750356bc-f340-4133-b423-9d37eaa18e68","Type":"ContainerDied","Data":"c1bc97ed9f63df59990e3d07a0d10aeaf52fb524f6890d6eda1676efca73e2cd"}
Jul 28 20:31:01.360969 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:01.360934    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-c38c57-54f4b5977b-kzjkx"
Jul 28 20:31:01.361084 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:01.361006    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-c38c57-54f4b5977b-kzjkx" event={"ID":"750356bc-f340-4133-b423-9d37eaa18e68","Type":"ContainerDied","Data":"106aa60c42a9820c057b71c1d5d963c7b588b546753999479a18320595bee95c"}
Jul 28 20:31:01.369694 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:01.369644    2570 scope.go:117] "RemoveContainer" containerID="c500a707518c069dcf523da5049de43fec2aadc635f108ec8e174b8c899b4274"
Jul 28 20:31:01.370141 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:31:01.370111    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c500a707518c069dcf523da5049de43fec2aadc635f108ec8e174b8c899b4274\": container with ID starting with c500a707518c069dcf523da5049de43fec2aadc635f108ec8e174b8c899b4274 not found: ID does not exist" containerID="c500a707518c069dcf523da5049de43fec2aadc635f108ec8e174b8c899b4274"
Jul 28 20:31:01.370264 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:01.370152    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c500a707518c069dcf523da5049de43fec2aadc635f108ec8e174b8c899b4274"} err="failed to get container status \"c500a707518c069dcf523da5049de43fec2aadc635f108ec8e174b8c899b4274\": rpc error: code = NotFound desc = could not find container \"c500a707518c069dcf523da5049de43fec2aadc635f108ec8e174b8c899b4274\": container with ID starting with c500a707518c069dcf523da5049de43fec2aadc635f108ec8e174b8c899b4274 not found: ID does not exist"
Jul 28 20:31:01.370264 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:01.370176    2570 scope.go:117] "RemoveContainer" containerID="c1bc97ed9f63df59990e3d07a0d10aeaf52fb524f6890d6eda1676efca73e2cd"
Jul 28 20:31:01.378185 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:01.378170    2570 scope.go:117] "RemoveContainer" containerID="c1bc97ed9f63df59990e3d07a0d10aeaf52fb524f6890d6eda1676efca73e2cd"
Jul 28 20:31:01.378463 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:31:01.378416    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1bc97ed9f63df59990e3d07a0d10aeaf52fb524f6890d6eda1676efca73e2cd\": container with ID starting with c1bc97ed9f63df59990e3d07a0d10aeaf52fb524f6890d6eda1676efca73e2cd not found: ID does not exist" containerID="c1bc97ed9f63df59990e3d07a0d10aeaf52fb524f6890d6eda1676efca73e2cd"
Jul 28 20:31:01.378463 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:01.378446    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1bc97ed9f63df59990e3d07a0d10aeaf52fb524f6890d6eda1676efca73e2cd"} err="failed to get container status \"c1bc97ed9f63df59990e3d07a0d10aeaf52fb524f6890d6eda1676efca73e2cd\": rpc error: code = NotFound desc = could not find container \"c1bc97ed9f63df59990e3d07a0d10aeaf52fb524f6890d6eda1676efca73e2cd\": container with ID starting with c1bc97ed9f63df59990e3d07a0d10aeaf52fb524f6890d6eda1676efca73e2cd not found: ID does not exist"
Jul 28 20:31:01.385319 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:01.385292    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-c38c57-75dcc74898-mplzc"]
Jul 28 20:31:01.398300 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:01.398272    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-c38c57-75dcc74898-mplzc"]
Jul 28 20:31:01.409536 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:01.409508    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-c38c57-54f4b5977b-kzjkx"]
Jul 28 20:31:01.419412 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:01.415800    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-c38c57-54f4b5977b-kzjkx"]
Jul 28 20:31:01.437081 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:01.437050    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44nxn\" (UniqueName: \"kubernetes.io/projected/750356bc-f340-4133-b423-9d37eaa18e68-kube-api-access-44nxn\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:31:01.437081 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:01.437081    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/750356bc-f340-4133-b423-9d37eaa18e68-plugins-config-volume\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:31:01.437251 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:01.437091    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tg862\" (UniqueName: \"kubernetes.io/projected/80108b11-28c4-4c47-b13e-79cb732806ad-kube-api-access-tg862\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:31:01.437251 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:01.437101    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80108b11-28c4-4c47-b13e-79cb732806ad-plugins-config-volume\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:31:01.573592 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:01.573556    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="750356bc-f340-4133-b423-9d37eaa18e68" path="/var/lib/kubelet/pods/750356bc-f340-4133-b423-9d37eaa18e68/volumes"
Jul 28 20:31:01.573912 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:01.573898    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80108b11-28c4-4c47-b13e-79cb732806ad" path="/var/lib/kubelet/pods/80108b11-28c4-4c47-b13e-79cb732806ad/volumes"
Jul 28 20:31:01.574214 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:01.574199    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c979daa8-7149-4267-a9e0-737e5197f0b1" path="/var/lib/kubelet/pods/c979daa8-7149-4267-a9e0-737e5197f0b1/volumes"
Jul 28 20:31:02.124590 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:02.124547    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-shared-a-c38c57-75dcc74898-mplzc" podUID="80108b11-28c4-4c47-b13e-79cb732806ad" containerName="payload-processing" probeResult="failure" output="dial tcp 10.134.0.63:9004: i/o timeout"
Jul 28 20:31:02.125059 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:02.124543    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-c38c57-54f4b5977b-kzjkx" podUID="750356bc-f340-4133-b423-9d37eaa18e68" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.62:9004: i/o timeout"
Jul 28 20:31:07.711359 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:07.711307    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"]
Jul 28 20:31:07.711943 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:07.711641    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7" podUID="b27b3710-1720-4ab8-a0a7-26bea05c6972" containerName="istio-proxy" containerID="cri-o://36422f725c1420972e700728be6dd746a08c2dc8d8d1a563888d57367b7ff17d" gracePeriod=30
Jul 28 20:31:12.968614 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:12.968588    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:31:13.037898 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.037819    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b27b3710-1720-4ab8-a0a7-26bea05c6972-istio-envoy\") pod \"b27b3710-1720-4ab8-a0a7-26bea05c6972\" (UID: \"b27b3710-1720-4ab8-a0a7-26bea05c6972\") "
Jul 28 20:31:13.037898 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.037852    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b27b3710-1720-4ab8-a0a7-26bea05c6972-workload-socket\") pod \"b27b3710-1720-4ab8-a0a7-26bea05c6972\" (UID: \"b27b3710-1720-4ab8-a0a7-26bea05c6972\") "
Jul 28 20:31:13.038163 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.037898    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prhzp\" (UniqueName: \"kubernetes.io/projected/b27b3710-1720-4ab8-a0a7-26bea05c6972-kube-api-access-prhzp\") pod \"b27b3710-1720-4ab8-a0a7-26bea05c6972\" (UID: \"b27b3710-1720-4ab8-a0a7-26bea05c6972\") "
Jul 28 20:31:13.038163 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.037924    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b27b3710-1720-4ab8-a0a7-26bea05c6972-istiod-ca-cert\") pod \"b27b3710-1720-4ab8-a0a7-26bea05c6972\" (UID: \"b27b3710-1720-4ab8-a0a7-26bea05c6972\") "
Jul 28 20:31:13.038163 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.037951    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b27b3710-1720-4ab8-a0a7-26bea05c6972-workload-certs\") pod \"b27b3710-1720-4ab8-a0a7-26bea05c6972\" (UID: \"b27b3710-1720-4ab8-a0a7-26bea05c6972\") "
Jul 28 20:31:13.038163 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.038013    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b27b3710-1720-4ab8-a0a7-26bea05c6972-istio-data\") pod \"b27b3710-1720-4ab8-a0a7-26bea05c6972\" (UID: \"b27b3710-1720-4ab8-a0a7-26bea05c6972\") "
Jul 28 20:31:13.038163 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.038054    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b27b3710-1720-4ab8-a0a7-26bea05c6972-credential-socket\") pod \"b27b3710-1720-4ab8-a0a7-26bea05c6972\" (UID: \"b27b3710-1720-4ab8-a0a7-26bea05c6972\") "
Jul 28 20:31:13.038163 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.038130    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b27b3710-1720-4ab8-a0a7-26bea05c6972-istio-podinfo\") pod \"b27b3710-1720-4ab8-a0a7-26bea05c6972\" (UID: \"b27b3710-1720-4ab8-a0a7-26bea05c6972\") "
Jul 28 20:31:13.038464 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.038175    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b27b3710-1720-4ab8-a0a7-26bea05c6972-istio-token\") pod \"b27b3710-1720-4ab8-a0a7-26bea05c6972\" (UID: \"b27b3710-1720-4ab8-a0a7-26bea05c6972\") "
Jul 28 20:31:13.038464 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.038213    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b27b3710-1720-4ab8-a0a7-26bea05c6972-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b27b3710-1720-4ab8-a0a7-26bea05c6972" (UID: "b27b3710-1720-4ab8-a0a7-26bea05c6972"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:31:13.038464 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.038328    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b27b3710-1720-4ab8-a0a7-26bea05c6972-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b27b3710-1720-4ab8-a0a7-26bea05c6972" (UID: "b27b3710-1720-4ab8-a0a7-26bea05c6972"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:31:13.038464 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.038420    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b27b3710-1720-4ab8-a0a7-26bea05c6972-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b27b3710-1720-4ab8-a0a7-26bea05c6972" (UID: "b27b3710-1720-4ab8-a0a7-26bea05c6972"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:31:13.038721 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.038491    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b27b3710-1720-4ab8-a0a7-26bea05c6972-workload-socket\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:31:13.038721 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.038512    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b27b3710-1720-4ab8-a0a7-26bea05c6972-workload-certs\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:31:13.038721 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.038509    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b27b3710-1720-4ab8-a0a7-26bea05c6972-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b27b3710-1720-4ab8-a0a7-26bea05c6972" (UID: "b27b3710-1720-4ab8-a0a7-26bea05c6972"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:31:13.039506 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.039476    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b27b3710-1720-4ab8-a0a7-26bea05c6972-istio-data" (OuterVolumeSpecName: "istio-data") pod "b27b3710-1720-4ab8-a0a7-26bea05c6972" (UID: "b27b3710-1720-4ab8-a0a7-26bea05c6972"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:31:13.040211 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.040183    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b27b3710-1720-4ab8-a0a7-26bea05c6972-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b27b3710-1720-4ab8-a0a7-26bea05c6972" (UID: "b27b3710-1720-4ab8-a0a7-26bea05c6972"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:31:13.040335 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.040212    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b27b3710-1720-4ab8-a0a7-26bea05c6972-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b27b3710-1720-4ab8-a0a7-26bea05c6972" (UID: "b27b3710-1720-4ab8-a0a7-26bea05c6972"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:31:13.040409 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.040391    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b27b3710-1720-4ab8-a0a7-26bea05c6972-kube-api-access-prhzp" (OuterVolumeSpecName: "kube-api-access-prhzp") pod "b27b3710-1720-4ab8-a0a7-26bea05c6972" (UID: "b27b3710-1720-4ab8-a0a7-26bea05c6972"). InnerVolumeSpecName "kube-api-access-prhzp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:31:13.040483 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.040470    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b27b3710-1720-4ab8-a0a7-26bea05c6972-istio-token" (OuterVolumeSpecName: "istio-token") pod "b27b3710-1720-4ab8-a0a7-26bea05c6972" (UID: "b27b3710-1720-4ab8-a0a7-26bea05c6972"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:31:13.138947 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.138916    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b27b3710-1720-4ab8-a0a7-26bea05c6972-istio-envoy\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:31:13.138947 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.138945    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prhzp\" (UniqueName: \"kubernetes.io/projected/b27b3710-1720-4ab8-a0a7-26bea05c6972-kube-api-access-prhzp\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:31:13.138947 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.138955    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b27b3710-1720-4ab8-a0a7-26bea05c6972-istiod-ca-cert\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:31:13.139230 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.138963    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b27b3710-1720-4ab8-a0a7-26bea05c6972-istio-data\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:31:13.139230 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.138971    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b27b3710-1720-4ab8-a0a7-26bea05c6972-credential-socket\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:31:13.139230 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.139003    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b27b3710-1720-4ab8-a0a7-26bea05c6972-istio-podinfo\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:31:13.139230 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.139013    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b27b3710-1720-4ab8-a0a7-26bea05c6972-istio-token\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:31:13.420858 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.420823    2570 generic.go:356] "Generic (PLEG): container finished" podID="b27b3710-1720-4ab8-a0a7-26bea05c6972" containerID="36422f725c1420972e700728be6dd746a08c2dc8d8d1a563888d57367b7ff17d" exitCode=0
Jul 28 20:31:13.421053 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.420875    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"
Jul 28 20:31:13.421053 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.420912    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7" event={"ID":"b27b3710-1720-4ab8-a0a7-26bea05c6972","Type":"ContainerDied","Data":"36422f725c1420972e700728be6dd746a08c2dc8d8d1a563888d57367b7ff17d"}
Jul 28 20:31:13.421053 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.420990    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7" event={"ID":"b27b3710-1720-4ab8-a0a7-26bea05c6972","Type":"ContainerDied","Data":"4ae769a1b47b94e0d1fde91af31022944fd1a4a0b1e9a1caf2d5ad125e2a2ea6"}
Jul 28 20:31:13.421053 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.421001    2570 scope.go:117] "RemoveContainer" containerID="36422f725c1420972e700728be6dd746a08c2dc8d8d1a563888d57367b7ff17d"
Jul 28 20:31:13.430156 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.430137    2570 scope.go:117] "RemoveContainer" containerID="d3313f2eb27323034b5d8234a8c14fabe2325c4c315e78ae7cf8460ec83cb917"
Jul 28 20:31:13.438190 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.438168    2570 scope.go:117] "RemoveContainer" containerID="36422f725c1420972e700728be6dd746a08c2dc8d8d1a563888d57367b7ff17d"
Jul 28 20:31:13.438440 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:31:13.438417    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36422f725c1420972e700728be6dd746a08c2dc8d8d1a563888d57367b7ff17d\": container with ID starting with 36422f725c1420972e700728be6dd746a08c2dc8d8d1a563888d57367b7ff17d not found: ID does not exist" containerID="36422f725c1420972e700728be6dd746a08c2dc8d8d1a563888d57367b7ff17d"
Jul 28 20:31:13.438517 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.438451    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36422f725c1420972e700728be6dd746a08c2dc8d8d1a563888d57367b7ff17d"} err="failed to get container status \"36422f725c1420972e700728be6dd746a08c2dc8d8d1a563888d57367b7ff17d\": rpc error: code = NotFound desc = could not find container \"36422f725c1420972e700728be6dd746a08c2dc8d8d1a563888d57367b7ff17d\": container with ID starting with 36422f725c1420972e700728be6dd746a08c2dc8d8d1a563888d57367b7ff17d not found: ID does not exist"
Jul 28 20:31:13.438517 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.438477    2570 scope.go:117] "RemoveContainer" containerID="d3313f2eb27323034b5d8234a8c14fabe2325c4c315e78ae7cf8460ec83cb917"
Jul 28 20:31:13.438712 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:31:13.438694    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3313f2eb27323034b5d8234a8c14fabe2325c4c315e78ae7cf8460ec83cb917\": container with ID starting with d3313f2eb27323034b5d8234a8c14fabe2325c4c315e78ae7cf8460ec83cb917 not found: ID does not exist" containerID="d3313f2eb27323034b5d8234a8c14fabe2325c4c315e78ae7cf8460ec83cb917"
Jul 28 20:31:13.438753 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.438718    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3313f2eb27323034b5d8234a8c14fabe2325c4c315e78ae7cf8460ec83cb917"} err="failed to get container status \"d3313f2eb27323034b5d8234a8c14fabe2325c4c315e78ae7cf8460ec83cb917\": rpc error: code = NotFound desc = could not find container \"d3313f2eb27323034b5d8234a8c14fabe2325c4c315e78ae7cf8460ec83cb917\": container with ID starting with d3313f2eb27323034b5d8234a8c14fabe2325c4c315e78ae7cf8460ec83cb917 not found: ID does not exist"
Jul 28 20:31:13.442839 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.442818    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"]
Jul 28 20:31:13.444398 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.444378    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-c38c57-openshift-default-7cfcb478d8-4h8r7"]
Jul 28 20:31:13.572930 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:13.572898    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b27b3710-1720-4ab8-a0a7-26bea05c6972" path="/var/lib/kubelet/pods/b27b3710-1720-4ab8-a0a7-26bea05c6972/volumes"
Jul 28 20:31:18.804067 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:18.804030    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d170bd-29754510-xms9q"]
Jul 28 20:31:18.810314 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:18.810279    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d170bd-29754510-xms9q"]
Jul 28 20:31:18.841218 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:18.841183    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-d170bd-5f89899758-v79qd"]
Jul 28 20:31:18.841746 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:18.841712    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-d170bd-5f89899758-v79qd" podUID="fcc1e83d-f409-453c-a3d3-066da307b431" containerName="payload-processing" containerID="cri-o://1f3f77b26fc36190bb136d59256b0a0c71e6053b72da21d6993c8cb6413a823c" gracePeriod=30
Jul 28 20:31:18.852995 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:18.852948    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-d170bd-76c6cd8f5b-q8rp6"]
Jul 28 20:31:18.853190 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:18.853164    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-d170bd-76c6cd8f5b-q8rp6" podUID="5dd0f0dc-783f-494b-9143-56b17a5473a6" containerName="payload-pre-processing" containerID="cri-o://0e5ff322a8e74da6035a91b2db46cb17addef7d9c4ec19c6cae02c19137c4412" gracePeriod=30
Jul 28 20:31:19.128711 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:19.128688    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-d170bd-5f89899758-v79qd"
Jul 28 20:31:19.131342 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:19.131313    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-d170bd-76c6cd8f5b-q8rp6"
Jul 28 20:31:19.198727 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:19.198694    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-769lp\" (UniqueName: \"kubernetes.io/projected/fcc1e83d-f409-453c-a3d3-066da307b431-kube-api-access-769lp\") pod \"fcc1e83d-f409-453c-a3d3-066da307b431\" (UID: \"fcc1e83d-f409-453c-a3d3-066da307b431\") "
Jul 28 20:31:19.198727 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:19.198732    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fcc1e83d-f409-453c-a3d3-066da307b431-plugins-config-volume\") pod \"fcc1e83d-f409-453c-a3d3-066da307b431\" (UID: \"fcc1e83d-f409-453c-a3d3-066da307b431\") "
Jul 28 20:31:19.199009 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:19.198775    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92cpv\" (UniqueName: \"kubernetes.io/projected/5dd0f0dc-783f-494b-9143-56b17a5473a6-kube-api-access-92cpv\") pod \"5dd0f0dc-783f-494b-9143-56b17a5473a6\" (UID: \"5dd0f0dc-783f-494b-9143-56b17a5473a6\") "
Jul 28 20:31:19.199009 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:19.198820    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5dd0f0dc-783f-494b-9143-56b17a5473a6-plugins-config-volume\") pod \"5dd0f0dc-783f-494b-9143-56b17a5473a6\" (UID: \"5dd0f0dc-783f-494b-9143-56b17a5473a6\") "
Jul 28 20:31:19.199194 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:19.199160    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5dd0f0dc-783f-494b-9143-56b17a5473a6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5dd0f0dc-783f-494b-9143-56b17a5473a6" (UID: "5dd0f0dc-783f-494b-9143-56b17a5473a6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:31:19.199242 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:19.199172    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcc1e83d-f409-453c-a3d3-066da307b431-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fcc1e83d-f409-453c-a3d3-066da307b431" (UID: "fcc1e83d-f409-453c-a3d3-066da307b431"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:31:19.200914 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:19.200893    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5dd0f0dc-783f-494b-9143-56b17a5473a6-kube-api-access-92cpv" (OuterVolumeSpecName: "kube-api-access-92cpv") pod "5dd0f0dc-783f-494b-9143-56b17a5473a6" (UID: "5dd0f0dc-783f-494b-9143-56b17a5473a6"). InnerVolumeSpecName "kube-api-access-92cpv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:31:19.201013 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:19.200924    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcc1e83d-f409-453c-a3d3-066da307b431-kube-api-access-769lp" (OuterVolumeSpecName: "kube-api-access-769lp") pod "fcc1e83d-f409-453c-a3d3-066da307b431" (UID: "fcc1e83d-f409-453c-a3d3-066da307b431"). InnerVolumeSpecName "kube-api-access-769lp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:31:19.300452 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:19.300412    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5dd0f0dc-783f-494b-9143-56b17a5473a6-plugins-config-volume\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:31:19.300452 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:19.300445    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-769lp\" (UniqueName: \"kubernetes.io/projected/fcc1e83d-f409-453c-a3d3-066da307b431-kube-api-access-769lp\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:31:19.300452 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:19.300454    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fcc1e83d-f409-453c-a3d3-066da307b431-plugins-config-volume\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:31:19.300452 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:19.300463    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92cpv\" (UniqueName: \"kubernetes.io/projected/5dd0f0dc-783f-494b-9143-56b17a5473a6-kube-api-access-92cpv\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:31:19.459295 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:19.459258    2570 generic.go:356] "Generic (PLEG): container finished" podID="fcc1e83d-f409-453c-a3d3-066da307b431" containerID="1f3f77b26fc36190bb136d59256b0a0c71e6053b72da21d6993c8cb6413a823c" exitCode=0
Jul 28 20:31:19.459473 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:19.459309    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-d170bd-5f89899758-v79qd"
Jul 28 20:31:19.459473 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:19.459353    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-d170bd-5f89899758-v79qd" event={"ID":"fcc1e83d-f409-453c-a3d3-066da307b431","Type":"ContainerDied","Data":"1f3f77b26fc36190bb136d59256b0a0c71e6053b72da21d6993c8cb6413a823c"}
Jul 28 20:31:19.459473 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:19.459403    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-d170bd-5f89899758-v79qd" event={"ID":"fcc1e83d-f409-453c-a3d3-066da307b431","Type":"ContainerDied","Data":"1487f688f8738d61d85c8005d48d168d26965de205ff52b1fd61c2f7e03275db"}
Jul 28 20:31:19.459473 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:19.459437    2570 scope.go:117] "RemoveContainer" containerID="1f3f77b26fc36190bb136d59256b0a0c71e6053b72da21d6993c8cb6413a823c"
Jul 28 20:31:19.460728 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:19.460699    2570 generic.go:356] "Generic (PLEG): container finished" podID="5dd0f0dc-783f-494b-9143-56b17a5473a6" containerID="0e5ff322a8e74da6035a91b2db46cb17addef7d9c4ec19c6cae02c19137c4412" exitCode=0
Jul 28 20:31:19.460824 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:19.460738    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-d170bd-76c6cd8f5b-q8rp6"
Jul 28 20:31:19.460824 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:19.460735    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-d170bd-76c6cd8f5b-q8rp6" event={"ID":"5dd0f0dc-783f-494b-9143-56b17a5473a6","Type":"ContainerDied","Data":"0e5ff322a8e74da6035a91b2db46cb17addef7d9c4ec19c6cae02c19137c4412"}
Jul 28 20:31:19.460913 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:19.460858    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-d170bd-76c6cd8f5b-q8rp6" event={"ID":"5dd0f0dc-783f-494b-9143-56b17a5473a6","Type":"ContainerDied","Data":"34d523687c2ef956776e6a1ff869981b111af4a633df9f3520b69cfcd0150033"}
Jul 28 20:31:19.468509 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:19.468455    2570 scope.go:117] "RemoveContainer" containerID="1f3f77b26fc36190bb136d59256b0a0c71e6053b72da21d6993c8cb6413a823c"
Jul 28 20:31:19.468795 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:31:19.468771    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f3f77b26fc36190bb136d59256b0a0c71e6053b72da21d6993c8cb6413a823c\": container with ID starting with 1f3f77b26fc36190bb136d59256b0a0c71e6053b72da21d6993c8cb6413a823c not found: ID does not exist" containerID="1f3f77b26fc36190bb136d59256b0a0c71e6053b72da21d6993c8cb6413a823c"
Jul 28 20:31:19.468864 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:19.468809    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f3f77b26fc36190bb136d59256b0a0c71e6053b72da21d6993c8cb6413a823c"} err="failed to get container status \"1f3f77b26fc36190bb136d59256b0a0c71e6053b72da21d6993c8cb6413a823c\": rpc error: code = NotFound desc = could not find container \"1f3f77b26fc36190bb136d59256b0a0c71e6053b72da21d6993c8cb6413a823c\": container with ID starting with 1f3f77b26fc36190bb136d59256b0a0c71e6053b72da21d6993c8cb6413a823c not found: ID does not exist"
Jul 28 20:31:19.468864 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:19.468836    2570 scope.go:117] "RemoveContainer" containerID="0e5ff322a8e74da6035a91b2db46cb17addef7d9c4ec19c6cae02c19137c4412"
Jul 28 20:31:19.477195 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:19.477179    2570 scope.go:117] "RemoveContainer" containerID="0e5ff322a8e74da6035a91b2db46cb17addef7d9c4ec19c6cae02c19137c4412"
Jul 28 20:31:19.477490 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:31:19.477467    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e5ff322a8e74da6035a91b2db46cb17addef7d9c4ec19c6cae02c19137c4412\": container with ID starting with 0e5ff322a8e74da6035a91b2db46cb17addef7d9c4ec19c6cae02c19137c4412 not found: ID does not exist" containerID="0e5ff322a8e74da6035a91b2db46cb17addef7d9c4ec19c6cae02c19137c4412"
Jul 28 20:31:19.477546 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:19.477497    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e5ff322a8e74da6035a91b2db46cb17addef7d9c4ec19c6cae02c19137c4412"} err="failed to get container status \"0e5ff322a8e74da6035a91b2db46cb17addef7d9c4ec19c6cae02c19137c4412\": rpc error: code = NotFound desc = could not find container \"0e5ff322a8e74da6035a91b2db46cb17addef7d9c4ec19c6cae02c19137c4412\": container with ID starting with 0e5ff322a8e74da6035a91b2db46cb17addef7d9c4ec19c6cae02c19137c4412 not found: ID does not exist"
Jul 28 20:31:19.485852 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:19.485827    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-d170bd-76c6cd8f5b-q8rp6"]
Jul 28 20:31:19.491583 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:19.491562    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-d170bd-76c6cd8f5b-q8rp6"]
Jul 28 20:31:19.501668 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:19.501648    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-d170bd-5f89899758-v79qd"]
Jul 28 20:31:19.505675 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:19.505656    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-d170bd-5f89899758-v79qd"]
Jul 28 20:31:19.577580 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:19.577543    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5dd0f0dc-783f-494b-9143-56b17a5473a6" path="/var/lib/kubelet/pods/5dd0f0dc-783f-494b-9143-56b17a5473a6/volumes"
Jul 28 20:31:19.577833 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:19.577819    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86297d19-d2e6-41f5-9199-1c0ad9ced636" path="/var/lib/kubelet/pods/86297d19-d2e6-41f5-9199-1c0ad9ced636/volumes"
Jul 28 20:31:19.578125 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:19.578111    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcc1e83d-f409-453c-a3d3-066da307b431" path="/var/lib/kubelet/pods/fcc1e83d-f409-453c-a3d3-066da307b431/volumes"
Jul 28 20:31:25.678037 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:25.677969    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"]
Jul 28 20:31:25.678480 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:25.678267    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8" podUID="6bafdd96-d434-4862-95b5-4de5ee060250" containerName="istio-proxy" containerID="cri-o://6e3a7375716338fb661c188634aff763b8b65ad820e708261d9fabcd90aa45bb" gracePeriod=30
Jul 28 20:31:30.929638 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:30.929611    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:31:31.005346 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.005251    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bafdd96-d434-4862-95b5-4de5ee060250-istiod-ca-cert\") pod \"6bafdd96-d434-4862-95b5-4de5ee060250\" (UID: \"6bafdd96-d434-4862-95b5-4de5ee060250\") "
Jul 28 20:31:31.005346 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.005305    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bafdd96-d434-4862-95b5-4de5ee060250-istio-podinfo\") pod \"6bafdd96-d434-4862-95b5-4de5ee060250\" (UID: \"6bafdd96-d434-4862-95b5-4de5ee060250\") "
Jul 28 20:31:31.005346 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.005325    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bafdd96-d434-4862-95b5-4de5ee060250-workload-certs\") pod \"6bafdd96-d434-4862-95b5-4de5ee060250\" (UID: \"6bafdd96-d434-4862-95b5-4de5ee060250\") "
Jul 28 20:31:31.005638 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.005360    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bafdd96-d434-4862-95b5-4de5ee060250-istio-data\") pod \"6bafdd96-d434-4862-95b5-4de5ee060250\" (UID: \"6bafdd96-d434-4862-95b5-4de5ee060250\") "
Jul 28 20:31:31.005638 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.005378    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bafdd96-d434-4862-95b5-4de5ee060250-workload-socket\") pod \"6bafdd96-d434-4862-95b5-4de5ee060250\" (UID: \"6bafdd96-d434-4862-95b5-4de5ee060250\") "
Jul 28 20:31:31.005638 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.005392    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bafdd96-d434-4862-95b5-4de5ee060250-istio-envoy\") pod \"6bafdd96-d434-4862-95b5-4de5ee060250\" (UID: \"6bafdd96-d434-4862-95b5-4de5ee060250\") "
Jul 28 20:31:31.005638 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.005411    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78vlf\" (UniqueName: \"kubernetes.io/projected/6bafdd96-d434-4862-95b5-4de5ee060250-kube-api-access-78vlf\") pod \"6bafdd96-d434-4862-95b5-4de5ee060250\" (UID: \"6bafdd96-d434-4862-95b5-4de5ee060250\") "
Jul 28 20:31:31.005638 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.005472    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bafdd96-d434-4862-95b5-4de5ee060250-istio-token\") pod \"6bafdd96-d434-4862-95b5-4de5ee060250\" (UID: \"6bafdd96-d434-4862-95b5-4de5ee060250\") "
Jul 28 20:31:31.005638 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.005498    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bafdd96-d434-4862-95b5-4de5ee060250-credential-socket\") pod \"6bafdd96-d434-4862-95b5-4de5ee060250\" (UID: \"6bafdd96-d434-4862-95b5-4de5ee060250\") "
Jul 28 20:31:31.005947 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.005695    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bafdd96-d434-4862-95b5-4de5ee060250-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6bafdd96-d434-4862-95b5-4de5ee060250" (UID: "6bafdd96-d434-4862-95b5-4de5ee060250"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:31:31.005947 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.005750    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bafdd96-d434-4862-95b5-4de5ee060250-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6bafdd96-d434-4862-95b5-4de5ee060250" (UID: "6bafdd96-d434-4862-95b5-4de5ee060250"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:31:31.005947 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.005903    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bafdd96-d434-4862-95b5-4de5ee060250-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6bafdd96-d434-4862-95b5-4de5ee060250" (UID: "6bafdd96-d434-4862-95b5-4de5ee060250"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:31:31.006158 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.006006    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bafdd96-d434-4862-95b5-4de5ee060250-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6bafdd96-d434-4862-95b5-4de5ee060250" (UID: "6bafdd96-d434-4862-95b5-4de5ee060250"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:31:31.006330 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.006304    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bafdd96-d434-4862-95b5-4de5ee060250-istio-data" (OuterVolumeSpecName: "istio-data") pod "6bafdd96-d434-4862-95b5-4de5ee060250" (UID: "6bafdd96-d434-4862-95b5-4de5ee060250"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:31:31.007650 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.007620    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6bafdd96-d434-4862-95b5-4de5ee060250-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6bafdd96-d434-4862-95b5-4de5ee060250" (UID: "6bafdd96-d434-4862-95b5-4de5ee060250"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:31:31.007758 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.007663    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bafdd96-d434-4862-95b5-4de5ee060250-istio-token" (OuterVolumeSpecName: "istio-token") pod "6bafdd96-d434-4862-95b5-4de5ee060250" (UID: "6bafdd96-d434-4862-95b5-4de5ee060250"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:31:31.007804 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.007753    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bafdd96-d434-4862-95b5-4de5ee060250-kube-api-access-78vlf" (OuterVolumeSpecName: "kube-api-access-78vlf") pod "6bafdd96-d434-4862-95b5-4de5ee060250" (UID: "6bafdd96-d434-4862-95b5-4de5ee060250"). InnerVolumeSpecName "kube-api-access-78vlf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:31:31.007842 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.007796    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bafdd96-d434-4862-95b5-4de5ee060250-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6bafdd96-d434-4862-95b5-4de5ee060250" (UID: "6bafdd96-d434-4862-95b5-4de5ee060250"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:31:31.107154 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.107116    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bafdd96-d434-4862-95b5-4de5ee060250-istio-data\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:31:31.107154 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.107146    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bafdd96-d434-4862-95b5-4de5ee060250-workload-socket\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:31:31.107154 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.107156    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bafdd96-d434-4862-95b5-4de5ee060250-istio-envoy\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:31:31.107154 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.107165    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78vlf\" (UniqueName: \"kubernetes.io/projected/6bafdd96-d434-4862-95b5-4de5ee060250-kube-api-access-78vlf\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:31:31.107434 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.107175    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bafdd96-d434-4862-95b5-4de5ee060250-istio-token\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:31:31.107434 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.107184    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bafdd96-d434-4862-95b5-4de5ee060250-credential-socket\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:31:31.107434 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.107192    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bafdd96-d434-4862-95b5-4de5ee060250-istiod-ca-cert\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:31:31.107434 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.107200    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bafdd96-d434-4862-95b5-4de5ee060250-istio-podinfo\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:31:31.107434 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.107207    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bafdd96-d434-4862-95b5-4de5ee060250-workload-certs\") on node \"ip-10-0-131-248.ec2.internal\" DevicePath \"\""
Jul 28 20:31:31.520520 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.520486    2570 generic.go:356] "Generic (PLEG): container finished" podID="6bafdd96-d434-4862-95b5-4de5ee060250" containerID="6e3a7375716338fb661c188634aff763b8b65ad820e708261d9fabcd90aa45bb" exitCode=0
Jul 28 20:31:31.520709 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.520530    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"
Jul 28 20:31:31.520709 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.520558    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8" event={"ID":"6bafdd96-d434-4862-95b5-4de5ee060250","Type":"ContainerDied","Data":"6e3a7375716338fb661c188634aff763b8b65ad820e708261d9fabcd90aa45bb"}
Jul 28 20:31:31.520709 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.520609    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8" event={"ID":"6bafdd96-d434-4862-95b5-4de5ee060250","Type":"ContainerDied","Data":"094adde98759a35c7682589e8866bd5a8bc63dd65ab814c52dbc44abd010c381"}
Jul 28 20:31:31.520709 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.520631    2570 scope.go:117] "RemoveContainer" containerID="6e3a7375716338fb661c188634aff763b8b65ad820e708261d9fabcd90aa45bb"
Jul 28 20:31:31.530065 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.530042    2570 scope.go:117] "RemoveContainer" containerID="6ffad74111bf59eb7b23839ca74f97b58ce883dd19e6e53075b2dd04a6c7a071"
Jul 28 20:31:31.538230 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.538210    2570 scope.go:117] "RemoveContainer" containerID="6e3a7375716338fb661c188634aff763b8b65ad820e708261d9fabcd90aa45bb"
Jul 28 20:31:31.538492 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:31:31.538466    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e3a7375716338fb661c188634aff763b8b65ad820e708261d9fabcd90aa45bb\": container with ID starting with 6e3a7375716338fb661c188634aff763b8b65ad820e708261d9fabcd90aa45bb not found: ID does not exist" containerID="6e3a7375716338fb661c188634aff763b8b65ad820e708261d9fabcd90aa45bb"
Jul 28 20:31:31.538594 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.538496    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e3a7375716338fb661c188634aff763b8b65ad820e708261d9fabcd90aa45bb"} err="failed to get container status \"6e3a7375716338fb661c188634aff763b8b65ad820e708261d9fabcd90aa45bb\": rpc error: code = NotFound desc = could not find container \"6e3a7375716338fb661c188634aff763b8b65ad820e708261d9fabcd90aa45bb\": container with ID starting with 6e3a7375716338fb661c188634aff763b8b65ad820e708261d9fabcd90aa45bb not found: ID does not exist"
Jul 28 20:31:31.538594 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.538515    2570 scope.go:117] "RemoveContainer" containerID="6ffad74111bf59eb7b23839ca74f97b58ce883dd19e6e53075b2dd04a6c7a071"
Jul 28 20:31:31.538746 ip-10-0-131-248 kubenswrapper[2570]: E0728 20:31:31.538728    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ffad74111bf59eb7b23839ca74f97b58ce883dd19e6e53075b2dd04a6c7a071\": container with ID starting with 6ffad74111bf59eb7b23839ca74f97b58ce883dd19e6e53075b2dd04a6c7a071 not found: ID does not exist" containerID="6ffad74111bf59eb7b23839ca74f97b58ce883dd19e6e53075b2dd04a6c7a071"
Jul 28 20:31:31.538788 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.538750    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ffad74111bf59eb7b23839ca74f97b58ce883dd19e6e53075b2dd04a6c7a071"} err="failed to get container status \"6ffad74111bf59eb7b23839ca74f97b58ce883dd19e6e53075b2dd04a6c7a071\": rpc error: code = NotFound desc = could not find container \"6ffad74111bf59eb7b23839ca74f97b58ce883dd19e6e53075b2dd04a6c7a071\": container with ID starting with 6ffad74111bf59eb7b23839ca74f97b58ce883dd19e6e53075b2dd04a6c7a071 not found: ID does not exist"
Jul 28 20:31:31.542524 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.542501    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"]
Jul 28 20:31:31.546696 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.546674    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-d170bd-openshift-default-7868fd996d-cz8x8"]
Jul 28 20:31:31.572877 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.572844    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bafdd96-d434-4862-95b5-4de5ee060250" path="/var/lib/kubelet/pods/6bafdd96-d434-4862-95b5-4de5ee060250/volumes"
Jul 28 20:31:31.825055 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:31.824965    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7f867cc9-qwphn_ad9a952e-9c20-40af-a631-c0ff7489676b/manager/0.log"
Jul 28 20:31:32.404000 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:32.403948    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9ddd48bbd-rljx4_1d28e390-a160-4cad-92b5-a367376e5c83/copy-manifests/0.log"
Jul 28 20:31:32.414015 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:32.413986    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9ddd48bbd-rljx4_1d28e390-a160-4cad-92b5-a367376e5c83/manager/0.log"
Jul 28 20:31:32.876316 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:32.876291    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29754480-8lrzt_50d7b3e9-8456-442a-a70e-a550ff75c9ac/cleanup/0.log"
Jul 28 20:31:33.101078 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:33.101052    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29754510-25c29_18912c3d-6e0a-459e-9659-ecaf08da454b/cleanup/0.log"
Jul 28 20:31:33.212031 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:33.212000    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-z4wmz_7c6398d2-3fd8-4c67-a985-78e2258967f9/postgres/0.log"
Jul 28 20:31:35.760051 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:35.760015    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-zsbhm_04facac8-04e5-413d-855a-a1bb83e0ee66/discovery/0.log"
Jul 28 20:31:36.319520 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:36.319477    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-tvdt2_28205bd5-94b7-4dfc-8adb-adabf45f8e19/payload-processing/0.log"
Jul 28 20:31:37.079889 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:37.079844    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq52t6_47392ca8-5f18-495f-b59f-70f20fc2e78a/main/0.log"
Jul 28 20:31:45.814450 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:45.814423    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4qqck_e6ef696c-5387-4f59-9157-de961fedb6de/global-pull-secret-syncer/0.log"
Jul 28 20:31:46.041814 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:46.041784    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-w2bkk_673e4708-36af-4e9f-8157-d34e64c16ef8/konnectivity-agent/0.log"
Jul 28 20:31:46.066638 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:46.066546    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-248.ec2.internal_66c7900c897da2db768e7d8f675c61eb/haproxy/0.log"
Jul 28 20:31:54.047822 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:54.047789    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-cpc6v_e6df31cb-3324-4f86-a181-2924a89f6ca8/kube-state-metrics/0.log"
Jul 28 20:31:54.072304 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:54.072276    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-cpc6v_e6df31cb-3324-4f86-a181-2924a89f6ca8/kube-rbac-proxy-main/0.log"
Jul 28 20:31:54.096706 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:54.096675    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-cpc6v_e6df31cb-3324-4f86-a181-2924a89f6ca8/kube-rbac-proxy-self/0.log"
Jul 28 20:31:54.281209 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:54.281182    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rtm75_785591be-b6ff-4a03-9693-f97139f3d9bc/node-exporter/0.log"
Jul 28 20:31:54.307502 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:54.307420    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rtm75_785591be-b6ff-4a03-9693-f97139f3d9bc/kube-rbac-proxy/0.log"
Jul 28 20:31:54.330780 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:54.330758    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rtm75_785591be-b6ff-4a03-9693-f97139f3d9bc/init-textfile/0.log"
Jul 28 20:31:54.548175 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:54.548149    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a255cfcd-4539-4711-98c1-e30b575c6494/prometheus/0.log"
Jul 28 20:31:54.575908 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:54.575836    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a255cfcd-4539-4711-98c1-e30b575c6494/config-reloader/0.log"
Jul 28 20:31:54.601938 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:54.601914    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a255cfcd-4539-4711-98c1-e30b575c6494/thanos-sidecar/0.log"
Jul 28 20:31:54.627192 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:54.627167    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a255cfcd-4539-4711-98c1-e30b575c6494/kube-rbac-proxy-web/0.log"
Jul 28 20:31:54.652135 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:54.652084    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a255cfcd-4539-4711-98c1-e30b575c6494/kube-rbac-proxy/0.log"
Jul 28 20:31:54.677567 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:54.677536    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a255cfcd-4539-4711-98c1-e30b575c6494/kube-rbac-proxy-thanos/0.log"
Jul 28 20:31:54.704214 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:54.704191    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a255cfcd-4539-4711-98c1-e30b575c6494/init-config-reloader/0.log"
Jul 28 20:31:55.484177 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.484138    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2456d/perf-node-gather-daemonset-w6lqr"]
Jul 28 20:31:55.484566 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.484476    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f27894a-de6e-4510-bc97-30b63731c24d" containerName="revoke-keys"
Jul 28 20:31:55.484566 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.484487    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f27894a-de6e-4510-bc97-30b63731c24d" containerName="revoke-keys"
Jul 28 20:31:55.484566 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.484498    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b27b3710-1720-4ab8-a0a7-26bea05c6972" containerName="istio-proxy"
Jul 28 20:31:55.484566 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.484504    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b27b3710-1720-4ab8-a0a7-26bea05c6972" containerName="istio-proxy"
Jul 28 20:31:55.484566 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.484517    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bafdd96-d434-4862-95b5-4de5ee060250" containerName="istio-proxy"
Jul 28 20:31:55.484566 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.484522    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bafdd96-d434-4862-95b5-4de5ee060250" containerName="istio-proxy"
Jul 28 20:31:55.484566 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.484530    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcc1e83d-f409-453c-a3d3-066da307b431" containerName="payload-processing"
Jul 28 20:31:55.484566 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.484535    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcc1e83d-f409-453c-a3d3-066da307b431" containerName="payload-processing"
Jul 28 20:31:55.484566 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.484542    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b27b3710-1720-4ab8-a0a7-26bea05c6972" containerName="istio-proxy"
Jul 28 20:31:55.484566 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.484548    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b27b3710-1720-4ab8-a0a7-26bea05c6972" containerName="istio-proxy"
Jul 28 20:31:55.484566 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.484555    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="750356bc-f340-4133-b423-9d37eaa18e68" containerName="payload-pre-processing"
Jul 28 20:31:55.484566 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.484560    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="750356bc-f340-4133-b423-9d37eaa18e68" containerName="payload-pre-processing"
Jul 28 20:31:55.484566 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.484569    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dd0f0dc-783f-494b-9143-56b17a5473a6" containerName="payload-pre-processing"
Jul 28 20:31:55.484968 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.484575    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dd0f0dc-783f-494b-9143-56b17a5473a6" containerName="payload-pre-processing"
Jul 28 20:31:55.484968 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.484584    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80108b11-28c4-4c47-b13e-79cb732806ad" containerName="payload-processing"
Jul 28 20:31:55.484968 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.484589    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="80108b11-28c4-4c47-b13e-79cb732806ad" containerName="payload-processing"
Jul 28 20:31:55.484968 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.484595    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bafdd96-d434-4862-95b5-4de5ee060250" containerName="istio-proxy"
Jul 28 20:31:55.484968 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.484600    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bafdd96-d434-4862-95b5-4de5ee060250" containerName="istio-proxy"
Jul 28 20:31:55.484968 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.484647    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcc1e83d-f409-453c-a3d3-066da307b431" containerName="payload-processing"
Jul 28 20:31:55.484968 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.484654    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5dd0f0dc-783f-494b-9143-56b17a5473a6" containerName="payload-pre-processing"
Jul 28 20:31:55.484968 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.484662    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bafdd96-d434-4862-95b5-4de5ee060250" containerName="istio-proxy"
Jul 28 20:31:55.484968 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.484668    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="750356bc-f340-4133-b423-9d37eaa18e68" containerName="payload-pre-processing"
Jul 28 20:31:55.484968 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.484674    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b27b3710-1720-4ab8-a0a7-26bea05c6972" containerName="istio-proxy"
Jul 28 20:31:55.484968 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.484680    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b27b3710-1720-4ab8-a0a7-26bea05c6972" containerName="istio-proxy"
Jul 28 20:31:55.484968 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.484685    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bafdd96-d434-4862-95b5-4de5ee060250" containerName="istio-proxy"
Jul 28 20:31:55.484968 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.484691    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f27894a-de6e-4510-bc97-30b63731c24d" containerName="revoke-keys"
Jul 28 20:31:55.484968 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.484696    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="80108b11-28c4-4c47-b13e-79cb732806ad" containerName="payload-processing"
Jul 28 20:31:55.489421 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.489398    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2456d/perf-node-gather-daemonset-w6lqr"
Jul 28 20:31:55.491989 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.491955    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2456d\"/\"kube-root-ca.crt\""
Jul 28 20:31:55.492113 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.492020    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2456d\"/\"default-dockercfg-wvrm8\""
Jul 28 20:31:55.492113 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.491955    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2456d\"/\"openshift-service-ca.crt\""
Jul 28 20:31:55.495528 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.495508    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2456d/perf-node-gather-daemonset-w6lqr"]
Jul 28 20:31:55.511963 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.511926    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdxp5\" (UniqueName: \"kubernetes.io/projected/6eb33ceb-7a11-438e-9ff6-32ff02064097-kube-api-access-xdxp5\") pod \"perf-node-gather-daemonset-w6lqr\" (UID: \"6eb33ceb-7a11-438e-9ff6-32ff02064097\") " pod="openshift-must-gather-2456d/perf-node-gather-daemonset-w6lqr"
Jul 28 20:31:55.512153 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.511968    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6eb33ceb-7a11-438e-9ff6-32ff02064097-proc\") pod \"perf-node-gather-daemonset-w6lqr\" (UID: \"6eb33ceb-7a11-438e-9ff6-32ff02064097\") " pod="openshift-must-gather-2456d/perf-node-gather-daemonset-w6lqr"
Jul 28 20:31:55.512153 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.512037    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6eb33ceb-7a11-438e-9ff6-32ff02064097-lib-modules\") pod \"perf-node-gather-daemonset-w6lqr\" (UID: \"6eb33ceb-7a11-438e-9ff6-32ff02064097\") " pod="openshift-must-gather-2456d/perf-node-gather-daemonset-w6lqr"
Jul 28 20:31:55.512153 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.512109    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6eb33ceb-7a11-438e-9ff6-32ff02064097-podres\") pod \"perf-node-gather-daemonset-w6lqr\" (UID: \"6eb33ceb-7a11-438e-9ff6-32ff02064097\") " pod="openshift-must-gather-2456d/perf-node-gather-daemonset-w6lqr"
Jul 28 20:31:55.512153 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.512144    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6eb33ceb-7a11-438e-9ff6-32ff02064097-sys\") pod \"perf-node-gather-daemonset-w6lqr\" (UID: \"6eb33ceb-7a11-438e-9ff6-32ff02064097\") " pod="openshift-must-gather-2456d/perf-node-gather-daemonset-w6lqr"
Jul 28 20:31:55.613068 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.613029    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6eb33ceb-7a11-438e-9ff6-32ff02064097-proc\") pod \"perf-node-gather-daemonset-w6lqr\" (UID: \"6eb33ceb-7a11-438e-9ff6-32ff02064097\") " pod="openshift-must-gather-2456d/perf-node-gather-daemonset-w6lqr"
Jul 28 20:31:55.613068 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.613064    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6eb33ceb-7a11-438e-9ff6-32ff02064097-lib-modules\") pod \"perf-node-gather-daemonset-w6lqr\" (UID: \"6eb33ceb-7a11-438e-9ff6-32ff02064097\") " pod="openshift-must-gather-2456d/perf-node-gather-daemonset-w6lqr"
Jul 28 20:31:55.613335 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.613099    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6eb33ceb-7a11-438e-9ff6-32ff02064097-podres\") pod \"perf-node-gather-daemonset-w6lqr\" (UID: \"6eb33ceb-7a11-438e-9ff6-32ff02064097\") " pod="openshift-must-gather-2456d/perf-node-gather-daemonset-w6lqr"
Jul 28 20:31:55.613335 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.613131    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6eb33ceb-7a11-438e-9ff6-32ff02064097-sys\") pod \"perf-node-gather-daemonset-w6lqr\" (UID: \"6eb33ceb-7a11-438e-9ff6-32ff02064097\") " pod="openshift-must-gather-2456d/perf-node-gather-daemonset-w6lqr"
Jul 28 20:31:55.613335 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.613171    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6eb33ceb-7a11-438e-9ff6-32ff02064097-proc\") pod \"perf-node-gather-daemonset-w6lqr\" (UID: \"6eb33ceb-7a11-438e-9ff6-32ff02064097\") " pod="openshift-must-gather-2456d/perf-node-gather-daemonset-w6lqr"
Jul 28 20:31:55.613335 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.613178    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdxp5\" (UniqueName: \"kubernetes.io/projected/6eb33ceb-7a11-438e-9ff6-32ff02064097-kube-api-access-xdxp5\") pod \"perf-node-gather-daemonset-w6lqr\" (UID: \"6eb33ceb-7a11-438e-9ff6-32ff02064097\") " pod="openshift-must-gather-2456d/perf-node-gather-daemonset-w6lqr"
Jul 28 20:31:55.613335 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.613226    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6eb33ceb-7a11-438e-9ff6-32ff02064097-lib-modules\") pod \"perf-node-gather-daemonset-w6lqr\" (UID: \"6eb33ceb-7a11-438e-9ff6-32ff02064097\") " pod="openshift-must-gather-2456d/perf-node-gather-daemonset-w6lqr"
Jul 28 20:31:55.613335 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.613267    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6eb33ceb-7a11-438e-9ff6-32ff02064097-sys\") pod \"perf-node-gather-daemonset-w6lqr\" (UID: \"6eb33ceb-7a11-438e-9ff6-32ff02064097\") " pod="openshift-must-gather-2456d/perf-node-gather-daemonset-w6lqr"
Jul 28 20:31:55.613335 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.613272    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6eb33ceb-7a11-438e-9ff6-32ff02064097-podres\") pod \"perf-node-gather-daemonset-w6lqr\" (UID: \"6eb33ceb-7a11-438e-9ff6-32ff02064097\") " pod="openshift-must-gather-2456d/perf-node-gather-daemonset-w6lqr"
Jul 28 20:31:55.621659 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.621634    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdxp5\" (UniqueName: \"kubernetes.io/projected/6eb33ceb-7a11-438e-9ff6-32ff02064097-kube-api-access-xdxp5\") pod \"perf-node-gather-daemonset-w6lqr\" (UID: \"6eb33ceb-7a11-438e-9ff6-32ff02064097\") " pod="openshift-must-gather-2456d/perf-node-gather-daemonset-w6lqr"
Jul 28 20:31:55.800483 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.800387    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2456d/perf-node-gather-daemonset-w6lqr"
Jul 28 20:31:55.958606 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:55.958439    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2456d/perf-node-gather-daemonset-w6lqr"]
Jul 28 20:31:55.961604 ip-10-0-131-248 kubenswrapper[2570]: W0728 20:31:55.961579    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6eb33ceb_7a11_438e_9ff6_32ff02064097.slice/crio-f95f0752df3cbd6c34e5d528a85f58082bce849a45060f346108651caa350c13 WatchSource:0}: Error finding container f95f0752df3cbd6c34e5d528a85f58082bce849a45060f346108651caa350c13: Status 404 returned error can't find the container with id f95f0752df3cbd6c34e5d528a85f58082bce849a45060f346108651caa350c13
Jul 28 20:31:56.634953 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:56.634920    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2456d/perf-node-gather-daemonset-w6lqr" event={"ID":"6eb33ceb-7a11-438e-9ff6-32ff02064097","Type":"ContainerStarted","Data":"455bfbcfe30d0747f120a7d9b1a4532a3f03e302be4459fdb7cf63370ea87d30"}
Jul 28 20:31:56.635370 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:56.634997    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2456d/perf-node-gather-daemonset-w6lqr" event={"ID":"6eb33ceb-7a11-438e-9ff6-32ff02064097","Type":"ContainerStarted","Data":"f95f0752df3cbd6c34e5d528a85f58082bce849a45060f346108651caa350c13"}
Jul 28 20:31:56.635370 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:56.635030    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2456d/perf-node-gather-daemonset-w6lqr"
Jul 28 20:31:56.653946 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:56.653888    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2456d/perf-node-gather-daemonset-w6lqr" podStartSLOduration=1.6538705679999999 podStartE2EDuration="1.653870568s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:31:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:31:56.651571828 +0000 UTC m=+3729.603604160" watchObservedRunningTime="2026-07-28 20:31:56.653870568 +0000 UTC m=+3729.605902914"
Jul 28 20:31:59.185029 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:59.184997    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-djnj4_874474d2-7dc6-411c-a19f-7bd31b13376d/dns/0.log"
Jul 28 20:31:59.212540 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:59.212511    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-djnj4_874474d2-7dc6-411c-a19f-7bd31b13376d/kube-rbac-proxy/0.log"
Jul 28 20:31:59.317235 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:59.317205    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-msmdc_d1744c82-4def-4eba-84c8-89528fef43f6/dns-node-resolver/0.log"
Jul 28 20:31:59.890239 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:59.890206    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-659fddc559-z465b_bcbd5685-8540-4327-9141-3d01e32b41fd/registry/0.log"
Jul 28 20:31:59.916914 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:31:59.916886    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7dtx2_b06b9cd0-9672-452d-b310-bcbb04b7a3d9/node-ca/0.log"
Jul 28 20:32:01.087274 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:32:01.087237    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-zsbhm_04facac8-04e5-413d-855a-a1bb83e0ee66/discovery/0.log"
Jul 28 20:32:01.280290 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:32:01.280260    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-tvdt2_28205bd5-94b7-4dfc-8adb-adabf45f8e19/payload-processing/0.log"
Jul 28 20:32:02.107046 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:32:02.107016    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5v2j9_bbf2a53c-71f8-469f-9fb4-d5aa608b3dbf/serve-healthcheck-canary/0.log"
Jul 28 20:32:02.648848 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:32:02.648824    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2456d/perf-node-gather-daemonset-w6lqr"
Jul 28 20:32:02.853416 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:32:02.853384    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hc5np_e43e2c26-51ea-4924-a62d-257b690ca836/kube-rbac-proxy/0.log"
Jul 28 20:32:02.895019 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:32:02.894964    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hc5np_e43e2c26-51ea-4924-a62d-257b690ca836/exporter/0.log"
Jul 28 20:32:02.922895 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:32:02.922865    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hc5np_e43e2c26-51ea-4924-a62d-257b690ca836/extractor/0.log"
Jul 28 20:32:05.738636 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:32:05.738592    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7f867cc9-qwphn_ad9a952e-9c20-40af-a631-c0ff7489676b/manager/0.log"
Jul 28 20:32:05.768125 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:32:05.768094    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-zsbhm_04facac8-04e5-413d-855a-a1bb83e0ee66/discovery/0.log"
Jul 28 20:32:05.952688 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:32:05.952658    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-tvdt2_28205bd5-94b7-4dfc-8adb-adabf45f8e19/payload-processing/0.log"
Jul 28 20:32:06.179456 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:32:06.179421    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9ddd48bbd-rljx4_1d28e390-a160-4cad-92b5-a367376e5c83/manager/0.log"
Jul 28 20:32:06.219470 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:32:06.219385    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9ddd48bbd-rljx4_1d28e390-a160-4cad-92b5-a367376e5c83/copy-manifests/0.log"
Jul 28 20:32:07.592693 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:32:07.592656    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-zsbhm_04facac8-04e5-413d-855a-a1bb83e0ee66/discovery/0.log"
Jul 28 20:32:07.646496 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:32:07.646465    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6c85c6bd85-pkk97_b8de741e-dcac-43aa-ad48-15fef51e17a9/manager/0.log"
Jul 28 20:32:07.750594 ip-10-0-131-248 kubenswrapper[2570]: I0728 20:32:07.750566    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-tvdt2_28205bd5-94b7-4dfc-8adb-adabf45f8e19/payload-processing/0.log"